I went to see the doctor, she said it was because the room is too dry when turning on the heater.
She recommended me to use the Aveeno 24 hr dry skin relief, and it did work for me.
However, I still recommend you to see the doctor if it become worse...