Is it worth paying more for an ocean-view condo that is not directly on the beach?

Sometimes, but the view alone is not enough to justify the premium. Compare recent sales in the same building or nearby buildings, paying attention to balcony orientation, how much ocean you can actually see, beach access, floor level, and the possibility of future obstructions. Also compare association finances and insurance-related costs; a less expensive view can become costly if the building faces major repairs.