I'll be living in Seattle and I want to regularly visit Vancouver. I'll be on an au pair (J-1) visa. I'm Brazilian.
As you hold a Brazilian passport, no you can not.
Here is a full list of entry requirements to Canada by country.
In general, having an American visa does not provide any entry privileges to Canada.