StarTribune.com

Take the MP3 Challenge

Posted on June 1st, 2009 – 11:04 AM
By Randy A. Salas

Can you tell the difference between an MP3 and its CD version? Try this test to see.

Whenever I write about MP3s, I invariably receive comments from people decrying the quality of the compressed audio files. So I thought I’d put together this MP3 Challenge to see if the people who complain really know what they’re talking about. I was one of those people — until I got past the regurgitated arguments against MP3s that stemmed from the early years, when they really were bad. The key with MP3s is the bitrate — the higher the number, the better the quality (and the more space the files consume on hard drives). Amazon and iTunes offer most downloads at 256 kilobits per second — good enough for most people. The highest bitrate is 320kbps, available at several classical music sites and what I’ve ripped my collection at.

Of course, even the highest bitrate MP3 — a compressed audio format — doesn’t offer the lossless (that is, uncompressed) audio quality of an original CD track. But can you hear the difference?

The samples below reflect a variety of musical styles and recording (actually, production) quality. Click on each link to hear the samples, which are randomly ordered, or right-click on each link and use “Save Target As” to download the file. Compare them, and then post a comment telling me which selection is a 256kbps MP3, which is a 320kbps MP3 and which is the original CD file for each sample. You should be able to play the files directly through your computer. But you can also connect your computer to play through a home stereo, listen using headphones or download the files and burn them to a CD for scrutiny.

(All of the files are in the lossless WAV format. I edited each ~30-second sample as a WAV file. Then  I saved that file at both MP3 bitrates. Then I saved those MP3 files back to WAV format, preserving the audio quality of the MP3 version while creating the blind test of seemingly identical files. ) 

This should be easy, right? Try it and see. I’ll post the answers at some point later.

CONTEMPORARY POP
“Hollaback Girl,” Gwen Stefani
Here’s a 2004 recording from Love. Angel. Music. Baby. that all the kids should know.
Sample A
Sample B
Sample C

ACOUSTIC ROCK
“I Never Thought I’d Live to Be a Million,” Moody Blues

This is off the 1969 album To Our Children’s Children’s Children, from the recent remaster prepared for SACD. The Moodies were known for using state-of-the-art recording equipment.
Sample A
Sample B
Sample C

ORCHESTRAL
“Ruslan and Ludmilla Overture,” Mikhail Glinka (Fritz Reiner conducting the Chicago Symphony Orchestra)
Reiner made many classic recordings for the esteemed RCA Living Stereo series. This 1959(!) performance is taken from the 2004 SACD remaster.
Sample A
Sample B
Sample C

CONCERT BAND
“Rocky Point Holiday,” Ron Nelson (Jerry Junkin conducting Dallas Wind Symphony)
This concert-band gem was recorded in 1996 for Reference Recordings, a high-end classical label that also has several Minnesota Orchestra releases.  
Sample A
Sample B
Sample C

JAZZ
“Freddie Freeloader,” Miles Davis
This is from the trumpeter’s classic 1959 album Kind of Blue, as remastered a few years ago for a DualDisc release.
Sample A
Sample B
Sample C

SPOKEN WORD/INSTRUMENTAL
“The Eve of the War,” Richard Burton

This is taken from the opening of Jeff Wayne’s Musical Version of The War of the Worlds, one of the first 48-track recordings. The 1977 album was remastered for SACD several years ago, the source of this sample.
Sample A
Sample B
Sample C

Note: Yes, there are other compressed audio file formats, such as Ogg Vorbis. But MP3s are by far the most popular. This is just about MP3s. Claims about how LPs offer better sound quality than anything else aren’t relevant to this challenge, either. Let’s just keep this to MP3 quality, please.

10 Responses to "Take the MP3 Challenge"

tyler says:

June 1st, 2009 at 2:45 pm

Ok, I’ll bite. Here’s my guesses:

Gwen Stefani:
A – 320 MP3
B – 256 MP3
C – CD copy

Moody Blues
A – 320 MP3
B - CD
C – 256 MP3

Glinka
A – 320 Mp3
B – CD
C – 256 Mp3

Nelson
A – 320 MP3
B – CD
C – 256 Mp3

Davis
A – 256 MP3
B - 320 MP3
C – CD

Burton
A – 256 – MP3
B – 320 MP3
C - CD

I’ve missed most of the discussion about MP3 quality, but I’d like to throw in the following: in my experience, there’s diminishing returns. With modern MP3 encoders, 192 kbps (v2 encoding), the source material is “close enough” for most consumer-grade players and home systems. The core sounds sound acceptable like themselves - even cymbals and transients, which used to completely fall apart. Beyond 192kpbs, high frequency clean up a little bit, but more importantly the stereo image solidifies and become more apparent.

You really need good equipment to hear that, though. I used Sony studio headphones for this test (MDR-7509) and used to be a live sound engineer (tuned ear, but not a golden one)…and I’m betting I still got most of these wrong.

I think it’s silly that people make a big deal out of this - if it doesn’t sound good, fix it. Besides, winning an Internet Argument doesn’t get you a trophy.

Randy A. Salas says:

June 1st, 2009 at 5:50 pm

Tyler, thanks for taking the time to share your comments. I agree on the caliber of equipment needed. That also reminds me about the fallacy that MP3s sound bad on home stereos. That was true of old iTunes downloads, which were generally at a paltry 160kbps. But I haven’t found any problems with my collection (at 320).

Frink says:

June 2nd, 2009 at 7:08 am

It’s a trick - they all sound the same. If they were encoded differently my company supplied 10 year old, cell phone signal capturing, frayed wire, Labtec speakers would have certainly produced tonality differences that would have made the encoding obvious.

Technobabble » Blog Archive » Don’t forget to take the MP3 Challenge says:

June 2nd, 2009 at 11:47 am

[…] MP3s are that bad, you should be able to tell easily, right? Prove it! Take my MP3 Challenge. Simply post which of three choices of the same song sample is from the original CD and which are […]

Technobabble » Blog Archive » Blu-ray goes portable — for $800 says:

June 5th, 2009 at 9:40 am

[…] TAKE THE MP3 CHALLENGE! Can you tell the difference between MP3s and the original CD? […]

Technobabble » Blog Archive » Blu-ray player selling for $119 says:

June 8th, 2009 at 4:54 pm

[…] TAKE THE MP3 CHALLENGE! Can you tell the difference between MP3s and the original CD? […]

Technobabble » Blog Archive » A good DVD-tracking app? says:

June 9th, 2009 at 2:15 pm

[…] TAKE THE MP3 CHALLENGE! Can you tell the difference between MP3s and the original CD? […]

Technobabble » Blog Archive » Readers pick top iPhone apps — most free! says:

June 15th, 2009 at 8:10 pm

[…] TAKE THE MP3 CHALLENGE! Can you tell the difference between MP3s and the original CD? […]

Technobabble » Blog Archive » Drum and bugle corps go techno says:

June 24th, 2009 at 4:40 pm

[…] TAKE THE TECHNOBABBLE MP3 CHALLENGE! Can you tell the difference between MP3s and the original CD? […]