24-hour places are far and few between, especially in the Bible Belt they call "The Dirty South". You get Waffle House, McDonalds, a handful of gas stations and Amelie's French Bakery--not to be confused with the lowbrow 24-hour options of the past.
Amelie's is heaven on earth. Despite the loooong (looooooooong) line to pick out your pastries, the whole bakery is a wonderful place to be. There are plenty of seats, bistro seating with tiny tables and tiny chairs as well as overstuffed furniture to settle into with your laptop (for the free wi-fi).
Everyone will suggest to you that you get the salted caramel brownie. And you should, if you like your caramel poured on thick with a thin layer of brownie. But rest assured: whatever you choose, you will love it all.