Although Apple’s iPod is definitely the portable music player to have at the moment, there are plenty of other options out there to fit your criteria: cheaper, better battery life, lighter.
The Register has a round up of the current crop of MP3 players, link below. Devices like Sony’s ATRAC-based Memory Stick Walkman aren’t covered as they’re not proper MP3 players.