With green card, of course you can leave US but may not be able to enter Canada without a Canadian Visa. It is clear on CIC web site, "anyone who does not have citizenship in a country that is on the Canadian VISA-waiver list needs a VISA to enter Canada."
That being said, with your green card, you may be able to get one in a Canadian airport.