If your man has said that, not just once or twice when both you and your husband are in bad mood, then you should start to look for a job for yourself.
I have to say your husband is cheap. Now let him handle the kids for just a week, and see what he would say?