Scaramouche lies in the corner of a residential building. So unless you know about it, you won't be able to spot it on your own. The interior of the restaurant was nice, the decorations were exquisite but a little dark, very little. If you get a chance you can sit next to the window which has the view of downtown.
Full review (+Pictures): http://cdn.xplean.com/2015/07/scaramouche-in-toronto-french-social.html