Think of it as the opposite to musical instrument design. In designing a clarinet you want resonance, but you want that resonance to be musically correct, in tune, and you are looking for the typical timbre / sound of a clarinet as opposed to oboe, bassoon etc. Tuned resonant frequency of reed, body, bell, throat, note holes, timber (or not) used in construction, even key and pad all join in to create this *character*. And you have to bend yourself (train) to be in sympathy with that character.
In hi-fi design you have to selectively take out as much character as you can so it doesn't interfere with the character of the musical instrument (playing a musical instrument *through* another musical instrument). But the same as in musical instrument design it is instinct and ear that creates masters not scientific theory and equation and test gear. You cannot design a clarinet with test gear nor can you design hi-fi with test gear, you can get the genus and the application, but then the ear of the maestro has to be applied.
Try to get rid of all and you end up with a big wet flannel, understand what can be kept, and sometimes enhanced, creates song. And when a system sings your natural test equipment on the back of you neck (little hairs), which are directly linked into your emotional recognition system, tell you it is right.