Interested in a little ancient history between beaches and cocktails and shoe-shopping in Capri? Head to Villa Jovis. Once home to the Roman emperor Tiberius, this 1st century C.E. villa, still impresses hundreds of years later. Strategically located on the second-highest peak on the island, it is said that the debauched emperor held many a party in this vast villa with incredible views. Check to make sure the villa is open before you take the 45-minute uphill climb from La Piazzetta; it can have capricious hours. Keep your eyes open for the villa’s very cute resident goats.