He is an adult and can't wait to get rid of you! So it is not a problem for him.
But one thing as parents you should be very careful. The first year in university is crucial. A lot of students cannot handle the transition well and failed. So the best time to leave is in his sophomore year.