That's one of the funny things many people who don't exercise like to say.
Cold air doesn't damage your lungs. It may hurt your throat though, if you breath mistakenly with your mouth. In case someone gets a delicate throat, a 10c paper dust mask over his nose and mouth would warm the air enough.
I'm open to more excuses why people don't exercise in Winter, and in Summer as well.