Must admit, I don't recall any probs like that when I used my 1st DAC-01A in preamp mode.
But then I don't listen as LOUD as Justin does.

I'm still loving mine - tbh it's all the DAC I'll ever need.
-- but I'm sure there will come a time when I'll be tempted to listen with my wallet rather than my ears again.