Beneath the ramparts of Québec City's Citadelle, the 'Rue du Petit-Champlain' is one of the oldest streets in North America. From its beginnings in the 1600's, this French colonial lane became a neighborhood of Irish immigrants in the 19th century and today it's a pedestrian quarter full of boutiques and art galleries. Sure it's touristy, but it's historic and the Saint Lawrence River is just a block or two over.
In summer, grab a maple-sugar-coated ice-cream cone and wander the neighborhood. Watch out for the birds.