Why not try President choice (PC) at Loblaw. The money is
physically with Amicus of CIBC and insured by CDIC (for C$60,000). The saving account interest rate is 2.75%. You can open a checking and saving accouts and use checking for daily transactions and saving for interests. You can withdraw money from all CIBC and PC machines. No fee for any transaction no matter what your balance is. You also can accumulate points for grocery shopping at loblaw. I don't think they offer service for other currency such as RMB.
The other visual bank is IngDirect which doesn't have any branch. They have offices in Toronto and Montreal. The rate for saving account is 3%. It's also CDIC insured. This is mainly good for saving.