If you want to visit Toronto and do touristy things, go to Dundas.
This is where locals go. Trust me I know, I visited it!
Kensington Market is a fun neighborhood to kill some time in, get a little drunk, eat some small grub and maybe buy something from a flea market.
Some places look dilapidated but that just goes with the vibe of the neighborhood. Some stores and houses are actually beautiful and very colorful. Streets are small and have more a European feel.
The bars are a great to stop in to get a quick drink or relax for awhile. They also gave great family owned restaurants. Authentic cuisine from a lot of different cultures. The flea markets sell vintage stuff or pop culture related clothing. Not one of the best flea markets I've been to but I hear the Pedestrian Sundays get a bit better with their selection.
Definitely worth a visit.