No that isn't the case, music is pretty much done by 8Khz look at a chart of the frequency ranges of instruments. We're actually missing out on very little.
https://i.ibb.co/DHhhCfqs/freqrange.jpg
Got to a concert grand and hit the top key, you can hear that at any age unless you have serious hearing damage in which case you'd be using hearing aids.

