The Duke of Richmond seems to be busy all of the time. It doesn't seem to matter what time it is during the day. I've been there many times with friends, workmates and with groups after networking events. It's loud and has the folks from City Hall, the shoppers from the Eaton Centre, Tourists and everything in between.
I've looked for reasons to not like this place and I can't find one. The service is consistant and attentive despite the huge crowds. The food is good in fact, they have these little baskets of things that are great for sharing (practical and inexpensive). I think that they have 5 items for $20. I think......They have lots of beer on tap. The washrooms are clean and on the ground level.
** if you are with a group and need a spot to go that will accommodate a group, this is the place.**
***Also, try the deep fried pickles (they are on the sharing/cheap menu) if you haven't had tried them before. They are a bit weird at the start and then you get into it***