Ah the Library - it's a dive and a bit grotty, but it's good.
The best thing about this venue is the space. It's open and welcoming to large groups, and pretty laid back. Another plus is the rooftop patio - which is really nice in the summer, and also good in the winter if you're with a group that smokes and don't want to have to fend off the Yonge-Dundas wildlife every time someone nips off for a cigarette.
It's comfortable with well worn leather couches, good lighting and I've never found myself having to yell over music to be heard. It's a proper pub and hangout, one that friends and I have frequented often after a long shift at work.
They serve pub grub food rather late, it's decent enough for the price - quite large portions, and free popcorn to boot.
It may not be the cheapest for a pitcher, but given the location you'd be a bit hard pressed with other choices in the area for a drink being overpriced stressed out chains.
All in all, the Library is a great dive to head to with a group if you want to actually talk and relax.