Once the most prosperous seaport in the USA, and still preserving some gracious 18th century colonial homes, it grew famous in the 19th century as a fashionable playground for ostentatiously wealthy industrialists like the Vanderbilts and Astors - all competing to outdo each other in the building of opulent summer mansions, many of which are now open to the public.