10K or 100K??? That's too much to ask for. mp3 is already very good at compression while preserve most of the original quality. You can try to set it for lower bitrate such as 64kbps in your mp3 ripper to get a smaller file.
You can use a large size CF card or Memory stick, depends on what your machine uses. And store all the mp3 files there. Then you won't be limited to its internal memory size any more.
10K,100K.
rm can reach several hundreds K.
If you convert your music to single channel, voice quality,you might
be able to reach several hundreds K by Mp3.But it's not music anymore.
It sounds like 20 years ago's AM radio.