The glamorous Florida town has attracted socialites, celebs, and even royalty through the years.