PDA

View Full Version : Evaluation methodologies



magiccarpetride
07-05-2010, 20:06
Most of us often go through a rather stressful (or sometimes delightful) process of evaluating hi fi components, with the eventual purchase in mind. However, since hi fi usually implies substantial bucks, we want to be sure we're not just frivolously pissing our hard earned money away. In other words, what's the point in spending big bucks on some component if it doesn't really improve anything in our listening experience?

So how do we go about it? Basically, there's no other way but to rely on our feeble memory. Meaning, first we listen to the chosen music track with the new component thrown in, then we listen to the same track with the existing audio chain (or vice versa, whatever the case may be). The trick is to retain as accurate as possible the memory of how did the previous system sound at the moment when we engage in listening to the new one.

So the issue basically boils down to a few things:

1. Rapid switching between the two systems vs. prolonged switching
2. Fresh ears vs. saturated ears
3. Blindfold tests vs. sight tests

In the first case, some people prefer the rapid switching between two systems (say, 2 - 3 seconds of listening to the first systems, after which switch to 2 -3 seconds of listening to the second system, back and forth)

In the second case, some people only trust their aural judgment while their ears are fresh. Meaning, after a prolonged period of silence (no music), listen to one system for a minute or so; give it a rest (couple of minutes of silence) after which listen to the second system for a minute or so, and then just walk away. Then make your notes. Maintain freshness of the initial impressions.

Some, on the other hand, insist that they need to spend prolonged time on one system, let it soak in real well, before moving on to the second system. Let that one soak in, then make your comparative notes.

Lastly, some people only trust the so-called double blindfold test, while others rely mostly on the sight testing (i.e. seeing what system is playing when).

Which approach describes you the best? I must say that, after some protracted testing, I prefer the fresh ears approach. It's been giving me the most reliable results in the long run.

aquapiranha
07-05-2010, 21:45
I think that as I lsiten to my system almost every day, I tend to notice subtle changes more easily than if I had not listened for a few days. At least that seems to be my experience.

John
08-05-2010, 06:21
For me its about listening to music I know really well. At home I am just enjoying the music not evaluating it when comparing I pay my more attention to the subtle changes in pace detail etc and guess because I been to so many concerts and play guitar I want it sounding as natural and real as possible

monya
08-05-2010, 07:04
I usually pick a few short tracks that I know inside out. Often first impressions are the best as the ear soon accommodates changes.
If you think you have a positive result, live with it for a week, then go back to the original system. Often quite illuminating!
Bottom line - if you like the sound, fine. Forget others' ears. Everyone has their own idea of what they want, or do they? :rolleyes:

The Grand Wazoo
08-05-2010, 08:40
Always, always go back & check...........

Themis
08-05-2010, 19:46
I usually pick a few short tracks that I know inside out. Often first impressions are the best as the ear soon accommodates changes.
If you think you have a positive result, live with it for a week, then go back to the original system. Often quite illuminating!
Bottom line - if you like the sound, fine. Forget others' ears. Everyone has their own idea of what they want, or do they? :rolleyes:
Same as Robin. ;)

goraman
09-05-2010, 16:03
I have learned that this kind of thing can make you a crazy old bird long before your time.
If the music transports you and brings you out of your dulldrums to a better world it's going to work out well.
If it has something lacking youll know it fairly fast.

DSJR
09-05-2010, 16:48
+1, with knobs on :lol:

Alex_UK
09-05-2010, 22:58
+ another 1, but no tone control knobs on :D

DSJR
10-05-2010, 09:21
I wasn't talking about tone controls, dear chap... ;)

Alex_UK
10-05-2010, 09:30
I didn't mean you were - I should've put some brackets in there, but my feeble joke still wouldn't have been funny! :o

DSJR
10-05-2010, 10:35
:lol:

Aspergics Anonymous' rule.......

StanleyB
10-05-2010, 11:18
I use a set selections of tracks to judge differences on different pieces of equipment. I don't necessarily concentrate on each instrument etc. in each track. I might only use one or more 'events' within a track. I don't need double blind testing for such tests. Either I hear the details I am looking for, or I don't.

MartinT
10-05-2010, 12:20
Some, on the other hand, insist that they need to spend prolonged time on one system, let it soak in real well, before moving on to the second system. Let that one soak in, then make your comparative notes.

This is me. I find that a relaxed musical environment is the best way to hear changes in systems, some of which can be very subtle and take some time to emerge and be recognised.

When I make a system change I just listen without any prejudice or expectation of hearing an improvement. This works well if you can train yourself to only hear what you hear and not expect a change.

What I cannot stand is rapid A/B changes or blind tests where you are expecting to hear change in a very presurised and unnatural environment for the enjoyment of music.