Raise the quality, if you have the 'registered' version, size it very high like 1800 x 1440 and save it in Terragen regardless of how pixelish the sea looks.
Now, open Photoshop and go scale it down to whatever you were planning the image to be sized, doing this will lessen the pixelation.