May I ask what power amp you use.
I am using an Art Audio Quintet and find that I need to use my Rothwell attenuators otherwise the noise floor is too high and I do not have enough control on the volume (max at 9 O clock)
Art Audio told me that using the attenuators is not a problem and said that it was the correct thing to do.
I love the Conrad Johnson PV9a. to me is sounds so right and very neutral, so I am curious as to your matching power amp.
PS: Vinyl Rocks