I usually end up at Paupers only because it's located in a good spot. While there's nothing ostensibly wrong with it, I can't say anything about the food has ever really jumped out at me. And I've had experiences with really awesome service, but I've had just a couple more experiences where the service was pretty slow and inattentive. It always seemed to be under-staffing, but who knows?
There ARE times where I seek Paupers out, and that's because of the awesome rooftop patio. Certainly one of the best views in Toronto. That said, the last time I made it up there, there were a number of pigeons hanging around the overhang and bombing bird crap danger close.
EDIT:
Thanks for the reply Janet! Can't wait for patio season :)