Update: on my most recent visit, I realized that they do indeed now have some bistro tables and chairs, as well as an espresso machine. Not overwhelmingly quaint or cozy, but they are trying.
P.S. We liked the Marble cupcakes so much, we went back 2 days in a row. The Cookies & Cream cupcake didn't wow us as much.