For late, late-night local music, head to Frenchmen Street in nearby Marigny. Once a local hang, visitors have discovered that playing until 4 a.m. can be a lot of fun. Plus, restaurants there serve late into the morning. Even better, head there during Mardi Gras for an unforgettable NOLA experience.