Basset Street Brunch Club is a great centrally located place to grab brunch in downtown Madison. Since it's connected to a hotel it offers free parking which is uncommon downtown!
I will say that weekend brunch is usually a 30 min. to an hour wait depending on what tim you go! If you like your sleep, you will be waiting!
I will say my only complaint is that the menu is very meh. Nothing super exciting but everything always comes out good.