I've test driven both. Other than the changes mentioned above, the 2005 model got a new suspension. On highway the 2005 model got lower noise level, which is good, as the major complaint about 2002-2004 RSX is its noise level.
Personally I like the 2005's look, as it's more mature. The 2004 model looks like a girl's car. But it's just personal taste.