For coffee this is the place to go (the other locations are equally good on this count). That is their focus and they have it down. Once in a great while they do burn the coffee on the brewer at this location, and it is obvious in contrast to the otherwise superlative brew they normally serve. I can immediately smell it before I even taste the cup, and they will happily swap me for a different pot.
Beans to go are also the best in town. The mid range varieties (like Cost Rica) are an excellent deal.
Their baked goods selection has some real jewels, but the inventory is overwhelmed by a dozen varieties of pound cake, which is mediocre.
The Bakery Square location has a great patio area around it for nice days. On inclement days, you can count on one environment inside: cold. Summer or winter it is the low 60s, so dress appropriately.
All in all, a top spot for the coffee aficionado. For pastries and a lounging vibe there are better options.