On the Measurement and Audibility of Headphone Break-in Page 3

Intermodulation Distortion (IMD)
In any non-linear system (and they all are to some extent), when you mix two pure sine waves, you get two additional signals at the sum and difference frequencies. This is called intermodulation distortion. I did measure IMD over the course of the test. In the graph above of the audio spectra, you can see the high level 500Hz and 3000Hz probe tone peaks, and the intermodulation distortion peaks of the sum and difference products at 3500Hz and 2500Hz.

I used 500Hz because I was interested in effects that happen in the diaphragm, and if I had used a low frequency I might run into problems with driver excursion limiting non-linearities or mechanical resonances. I used 3000Hz because that should be a low enough frequency not to run into too many acoustic resonances from the concha and ear canal, but high enough to be solidly in the treble, which is where I assume break-in can be heard most readily. Most people claim, and I've experienced, a smoothing-out or less harsh sound from headphones as they break-in.

From Wiki here:

Audio engineers usually strive to avoid intermodulation because, for anything other than extremely simple input waveforms, it introduces frequency components that are not harmonically related, which tends to sound unmusical and unpleasant.

So, I plotted the amplitude of the two peaks at 2500Hz and 3500Hz over time ... and guess what?

111229_blog_burnin_IMDproducts

Ka-ching! Here we can see a clear downward trend of IMD products over time. While the data is a bit noisy, all IMD products are reducing in level about 1.5dB each over the course of the test. I included IMD in the test because I thought that the type of differences I've heard over time might be due to this type of distortion.

I double checked the data because changes at a particular frequency could be due to slight frequency variations in the audio generator causing the peak to move away chosen frequency of the analyzer. I didn't see that in the data. But I did have data at two frequencies that were just a few dB apart, so I averaged them to help rid the measurement of any amplitude fluctuations due to frequency shifting. I also looked at the amplitude of the probe tones in the data and they were rock solid. As a result, I'm fairly confident that these data are accurate.

The question is: is this break-in?

ARTICLE CONTENTS

COMMENTS
flatmap's picture

Here's a thought. Consider listening to music while a mosquito buzzes nearby. The listening experience is much less enjoyable even though the amplitude of the mosquito's sound is small. But ridding yourself of the mosquito may have a large subjective change in listening pleasure.

This suggests that a small measurable change can still be significant subjectively.

inarc's picture

Thank you and Arnaud for this excellent work!

My personal take on break-in is that it does exist in some physical form or another ("everything flows") but that it is too subtle to be subjectively significant, if even audible.
The kind of break-in that is mostly talked about happens on the receiver's end.

Tyll Hertsens's picture
... the kind of break-in that is mostly talked about is mythic keyboard enthusigasm.
MacedonianHero's picture

Fantastic write up and investigation! Thanks Tyll! :)

KikassAssassin's picture

It would be interesting to see the same test done on a headphone that isn't considered to benefit much from break-in, and see how it compares to this. One thought I have about this is that if the differences people hear with break-in mostly happen in their heads, and the K701 is widely considered to change significantly with break-in when the measurements show otherwise, I wonder if this might mean that there's some aspect of the K701's sound that just isn't very pleasant, and it takes more time than usual for people's brains to adjust to it.

arnaud's picture

Hi Tyll,

Many thanks for this interesting article! I am sorry to hear you will not repeat the test with another headphone as I find it fascinating!

On the sudden jumps:
> All the headphone responses are normalized by the maximum amplitude for the equalized response (so around 150Hz it seems for this headphone) so, apart from a sudden change in the frequency content of the excitation, the jumps in the response shouldn't be related to the MLS sequence
> On the other hand, since the FRF and CSD graphs are extracted from single impulse response data (not your typical average of 5 or so positions), they are sensitive to the headphone position
> I can't recall, but didn't you say you had to reseat the headphones one time or something (for instance the jump between 104 and 105 hours would seem like an effect of reseating).

cheers,
arnaud

Tyll Hertsens's picture
Well ... I said I'd likely not be doing more. I'm a geek ... ya never know what might get my attention. But I do have ideas for other things that need looking at.

"I can't recall, but didn't you say you had to reseat the headphones one time or something (for instance the jump between 104 and 105 hours would seem like an effect of reseating)."

The headphones weren't reseated between the series after 100+ hours; I just restarted the test, the door was never opened. I was careful to leave the door closed and not even enter the room unless I had to.

arnaud's picture

Thanks for the clarification on the experiment Tyll. The sudden jumps are quite puzzling and I still can't imagine they're related to the excitation signal. One thing that came back to my mind is that the input signal is (fortunately) taken out of the equation when measuring the impulse response by MLS. The impulse response is obtained from cross-correlation between the input signal into the amp or heaphone and that of the microphone.
So, as long as some noise is injected over the audio range, you'll get the same frequency response function (assuming the system measured doesn't change) even if the input signal varies a bit in level and other frequency characteristics.
The puzzling part is that the jumps don't occur at fixed interval (every 50 hour +/-15 hours) but they all do the same thing (increase level by up to 2dB, the higher the frequency, the more visible it is). Another puzzling bit is it would appear all the responses after the jump are similar, so it's like resetting the response to about what it was at the last jump...

The one thing that makes sense is that the variations are more pronounced at high frequencies since it's where the response is most sensitive to slight perturbations in the system.

You know your test rig better than anyone, but I wonder if you could get more representative results by performing standard 5 position average tests every 50hours of burn-in or so and compare that against another pair of same headphone which would also be measured every 50 hours but not being used in between tests.
With such test, you would not only address the question on measurability of burnin effects but you would also show if any variation observed can be just as much attributed to burnin as simply natural uncertainty in the measurements (temperature, spurious noise and vibration, ....). BTW, you also wouldn't have to monopolize the test rig for the whole duration of the experiment in that scenario and you could make sure you control some of the environment variables (temperature, exterior noise/vibration...).

Considering some people often try to dismiss measurements when a headphone is objectively criticised or large variations are observed between several pairs of the same model, addressing the level of uncertainty in the measurement would be extremely useful to do (not just for the fun of it but simply to give more authority to the results presented on this site).

End of long rumbling post ;)

jeckyll's picture

This is why I come to this site. I've personally experienced disappointment with new headphones sounding very closed in and 'disappointing'. Only to find that after a bit of time (not hundreds of hours) I enjoyed them much more.

It's cool to see an attempt to find at least a bit of scientific basis for this type of phenomenon :)

Jazz Casual's picture

Wait 'til the mythbusters over in the Head-Fi sound science forum see this! A link to this article should be posted in every forum thread where someone inanely posts "it needs at least (insert number here:) ... hours of burn-in before it really begins to open up."

I suppose I fall into the burn-in sceptic camp. I've never noticed any discernible change in the sound of my headphones over time, and that's not through want of trying. The results from Tyll's testing gives me no reason to alter my view at this stage.

dalethorn's picture

Generally I'm agnostic on break-in, but I would like stronger assurance that these high-quality headphones were not played on a test bench before shipping. I have read many articles stating that many electronics manufacturers play their products for awhile as part of their automated Q/A. It costs them little, since it's automated.

My second thought, based on much reading of different products and websites, is that Grado is widely regarded as a significant break-in candidate, especially on the lower models, and even by Grado themselves. I don't recall any other manufacturers claiming that break-in is needed.

Alfred's picture

Thanks for the great article Tyll!

I've found that just playing noise for breaking/burning in (whatevas) didn't work well for me. I use variety of songs (and noise would be used too, but only a portion of it) and plug the cans into a powerful amp for breaking/burning in.

And yes even the lower cans need 100 hours at least.

IMHO I also feel that the higher cans need like a thousand hours to really open up.

Jeff Graw's picture

It's obvious that all of these changes are slight, and each one by itself is probably more or less not preceptable.

Perhaps the whole is greater than the sum of the parts though?

thune's picture

Nice article with sensible advice.

One point: For loudspeaker woofers, break-in is known to lower the resonance frequency and slightly change the woofer TS parameters. (With the woofer spec being for the broken-in condition.) A simple impedance sweep before and after break-in shows this change.

One potential experiment: take a dynamic headphone (or several) with a low frequency resonance characteristic (not the Q701 or planars), and show an impedance sweep before and after a burn-in period. This experiment might provide insight into claims of "better bass" after burn-in.

Tyll Hertsens's picture
Thanks for the tip, I'll keep it in mind.
Milton's picture

I found your results very interesting! Will your findings effect how you review headphones in the future? In other words, have you concluded that it would be a waste of time to break in headphones before reviewing them? Or will you take the "chicken soup" point-of-view (i.e. Maybe it doesn't help, but it couldn't hurt.) Thanks again for posting these results!

Milton

Tyll Hertsens's picture
I've got a burn-in station where I can run in headphones 24/7. I always give stuff a quick listen when I get it to get a first read on whether I like it or not, then I drop it in burn-in til I want to listen to it again or other cans come in and pushes it off the burn-n station. I'll usually make sure a headphone has a hundred hours on them or so before I seriously listen to them. I want to give the cans their best shot.
CarlSeibert's picture

>The miracle is in your head ... not in the headphones.

Yup. That's the biggest part of the system. I would say, you're not imagining the effects that your mind and body introduce to the system, but actually, the end product of a music system IS imagination, so, well, I won't. ;-)

This Wall Street Journal story on placebo effect is interesting. (Executive summary: In cases where your brain is part of the equation, "placebos" can be so effective I'd hesitate to call them that. It's not just that you THINK you can see or hear better, you actually can.)

http://online.wsj.com/article/SB1000142405297020472020457712887388647198...

It's interesting that break-in may center on IM effects. It seems like a few things that we are having trouble measuring now come home to IM. When we can measure IM effects better, lots of stuff might come into better focus. Remember when all "competently designed amplifiers sounded the same" because they measured the same? Well, they never did sound the same. They don't measure the same anymore, either.

Kudos to Tyll for being the voice (and ears) of reason.

The Monkey's picture
One of the things that fascinates me about the burn-in "debate" is the defensiveness with which the placebo effect is dismissed by the true believers. I simply do not understand the "YOU DON'T KNOW WHAT I HEAR BUT I DO AND I HEAR IT LALALALA!" Regardless of one's position on burn-in, I would like to believe that people are willing to bring more intellectual curiosity to the table. I know that's a tall order. I suspect that the "I BELIEVE IT CUZ ITS REALZ CUZ I HEAR IT" crowd's fear of the placebo effect is a combination of, among other things: (a) deep insecurity; (b) a fear of the inner-workings of their own minds (i.e., a pre-disposition against any notion of the subconscious); (c) a lack of critical thinking; and (d) a fundamental lack of understanding about the difference between a fact and an opinion. I suspect that Tyll's groundbreaking work will do little to even open the minds of the true believers, and that's unfortunate because they seem to be taking over certain sites dedicated to this hobby. I suppose, in some ways, that's indicative of a broader national "discourse," but that's a subject for another day.
Tyll Hertsens's picture
... and rightly so, of course.

And, my dear friend, that's exactly why I wrote three articles and spent so much time on the subject: to try to put this topic into some sort of rational context --- pour a little cool, clear water on the heads-a-fire crowd.

The Monkey's picture
I think you've accomplished what you set out to do and then some. Case in point, the intermodulation distortion data should not be ignored, even by a cynical old monkey like me. There are too many people whose ears I respect in this hobby who swear that break-in exists for me to just dismiss it, though I have remained skeptical. In some ways, your data provide fodder for both sides, but your data coupled with your sensible conclusions more helpfully provide a path forward for perhaps actually resolving this debate. Well done!
Jazz Casual's picture

The headphone listening experience is inherently subjective. It is unlikely that "burn-in" believers will renounce their faith in the face of headphone measurements that are ultimately inconclusive. The "debate" should continue ad infinitum regardless of the data, as battles between belief and "science" do. What never ceases to astound me is our capacity (I'm referring to blokes here) to obsess and vehemently argue over the minutiae of life. It's almost endearing. ;-)

Tyll Hertsens's picture
Thanks Carl. Your absolutely right, we're running around with a personal experiencing device that won't be matched in this century tucked neatly in our noggin. It's capable of doing all sorts of cool stuff ... un measurable stuff, but cool stuff nonetheless.

People think to much. I think we should more often just relax and experience things.

dalethorn's picture

Are we all going to assume what we assume on the basis of the AKG only? And without knowing if they had break-in at the manufacturer? Seems like someone would have that knowledge or at least not make assumptions based on not knowing.

Tyll Hertsens's picture
Or are we thinking too much about this?
dalethorn's picture

I don't know if anyone is thinking *too much* about break-in, but they sure as heck are thinking a *lot* about break-in.

zobel's picture

Thanks Tyll for your work at trying to make quantifiable measurements that tell us something real about headphone performance. The frequency response graphs look really wacky on the top end, and are probably not how we perceive those frequencies, but I am glad you stuck to a single response correction in all your tests so we can make some sort of general comparison between headphones. As you know, Sennheiser makes headphones for audiologists to use to measure people's hearing, and those must be very flat in frequency response. Also, I'm sure that you know that all the best headphones have a fairly flat and smooth frequency response, as we perceive them. It would be cool if we could measure and chart what the cans actually are doing, or can we? I think your measurement system just needs recalibration on the high end to reflect what we actually hear. Would FFT be more accurate?
I've never noticed much difference in a "broken in" set of cans over new ones. I have noticed much more difference between different runs of the same model, built in different locations.
I love hearing your reviews of all the cans, and from the ones I've heard, I always agree with your ears. Thanks.

halcyon's picture

Very good work, as always. Such a pleasure to read your measurements and comments.

Two things of note here, obvious to Tyll, but not perhaps to everybody else.

1)

The human hearing is much more sensitive to intermodulation distortion, even down to 0.5 dB differences (or below, not enough data exists on this). This is highly dependent on the frequency distribution of the IMD artifacts. Lower Q resonances, as they cover more of critical critical bands, is more audible, even at lower absolute amplitude than a higher Q artifact.

Also, the frequency of the IMD artifact is of high importance and at typical playback volumes, the upper range presence region IMD artifacts are most audible due to diminished masking effects from increased hearing sensitivity at that region.

2) The biggest break-in in human hearing is it's constantly adaptive and compressive/expansive capacity. It is not a fixed, nor a non-linear instrument. Any sound you feed it long enough will form as the new baseline against which other things are *relatively* measured.

This psychological break-in has at least two phases: almost instantaneous effect that starts after a few seconds after the echoic memory fades and gets re-inforced after instant repeated simultaneous plays. This is the reason why a lot of the long-duration A/B blind switching trials succeed during the first 3-7 listens and then decline rapidly towards the pure random variation. It is unsure - to me at least - whether this happens at cochlea level or at cortical level - or perhaps even somewhere in between.

2)
The second break-in is (probably) more a function of cortical excitation changes where the action potentials from continued exposure to a certain repeated signals get lowered and the initial higher level of excitation is diminished. In layman's terms: you may have perhaps heard of the cat with electrodes implanted to her auditory center to produce a constant phantom "beeeep" sound. The cat goes berserk for a while until the brain adjusts and baselines this signal as normal. Then as the electrodes are removed along with the baselined signal, the cat goes berserk again for a while, until the cortical response is baselined.

A similar thing happens in a human brain. It cannot be unlearned, it cannot be avoided, it happens to all of us. Regardless of how trained ears, how much experience or book knowledge we have. That's why all gear tends to sound different after hundreds of hours of repeated acoustic exposure to them. For better or worse.

In summary: does audible break-in exist?

Of course it does! It would be silly to deny the human hearing along with its adaptive properties as (see point 2) as the fundamental measurement instrument of this test. Human hearing does adapt, thus does the audible signal, thus there is break-in. With everything you listen to repeatedly: Stradivarius, that new headphone amplifier or a jack-hammer.

However, whether there is absolutely measurable non-psychoadaptive signal changes attributable to 'break-in effects' of headphones AND are these changes actually psychoacoustically perceptible AND to whom of us (this skill is partially trainable), well let me say that the jury is still out on that one for me.

Further measurements on IMD resonance at low Q-levels in the upper presence-region which is the most sensitive part in equal loudness contours might turn out something interesting.

So, until the next time!

Mkubota1's picture

Thank you so much for doing this. It will serve as a good point of reference when discussing the topic. As the saying goes, "Extraordinary claims require extraordinary proof." Until an equally rigorous demonstration is done showing the contrary, in my mind there is little need to struggle with this any further. Thanks again (Arnaud!).

borispmchan's picture

Hi Tyll,

I'm slightly surprised by your findings because I think I've witnessed break-in on my Ultimate Ears Super.fi 3.

I have bought it around 2 or 3 years ago, and when I took it right out of the box for a listen, it was pretty unbearable. The bass wasn't quite there and the sounded quite sterile indeed. I wasn't happy with it and just left it plugged to my computer for breaking in and around a week later, I gave them another shot and they sounded pretty nice indeed. Far from sterile, got some real punch and deep bass. I'm not sure about K701, actually I tend to believe they've been tested and somehow broken-in before being shipped. I may be wrong though. Anyway, any measurement of break-in effects on balanced armature IEMs would be nice.

Cheers,
Boris

Grizzled Geezer's picture

...when I reviewed headphones for Stereophile, I noticed that their sound changed as they "broke in". So I ran all 'phones overnight with noise, at a fairly high level.

Conventional dynamic headphones showed only a slight change. But planar headphones -- both electrostatic and "orthodynamic" -- showed much more-noticeale changes. As interesting as these tests are, it would be even more interesting to see how a pair of STAX 'phones change. (Does anyone else make 'stats? Sennheiser?)

There's another headphone issue that needs research. It seems that the brain "adjusts" to headphone colorations -- reducing their subjective effects -- in a way that does not occur with speakers. (That's been my experience, anyway>)

jimmyjames's picture

Audio folks have often said about component break in that it's not the component that's breaking in, it's our ears. Hmmm?

Also, from KikassAssasin: "I wonder if this might mean that there's some aspect of the K701's sound that just isn't very pleasant, and it takes more time than usual for people's brains to adjust to it." --

Couldn't have said it better myself except that my brain never adjusted to the 701's sound. Argh!

Dick Emery's picture

I have read your comparisons with keen interest and what caught my eye was how you mentioned that the characteristics changed throughout a 24 hour period and could possibly be attributed to temperature changes throughout the day. That got me thinking. For testing purposes the cans are put on a dummy head. Something that is not alive and does not emit any real heat of it's own.

Humans are made of flesh and bone and have heat variances from one moment to the next. When you place a set of headphones onto your head your own body heat permeates into the cans body and ultimately the drivers and electrical components.

My theory based on your measurements is that body heat can have a dramatic effect on the overall response. The temperature variances on the artificial head were probably slight. Whereas on a human head I would imagine those self same variances would be rather more extreme.

What do you think?

Tyll Hertsens's picture
But they'll certainly change a bit as they warm up next to your head. It's all pretty small potatoes, I think.
aphocus's picture

I read I think on nswavguy's blog about very high predictably in people preferring audio of as little as 0.1dB louder, with no other alternations, mind you this effects the entire sound, and not -60dB below peak, at 115hrs there's a sudden drop in almost 1dB this is probably the mostlikely point at which the change would be most audible.

The other idea would be that the IMD is audible but very subtle maybe to the point of almost inaudible, and when it reaches a certain critical point, it becomes inaudible, and the human's auditory processing centers no longer have to filter it out, requiring less effort on the brains part to achieve meaningful information. people with say an auditory processing disorder could possibly sense that as a "night and day" change.

X