The more photogenic part of this palm oasis is off limits for swimming (and the water is cold)