This is way too messy. You could have problems in regard to provincial credits and child benefits, etc. You need to have one single address for the three of you.
The addresses on both your returns are not necessarily the same. You may even be able to claim more housing credit because of involuntary seperation due to work or study. You can also call CRA hotline for more info.