Do you have a separate phono stage?
If so, try earth wires between the phono stage, pre and power amp, and combinations of this to see if it resolves the matter.
Also, try moving your components around, that may help.
“Music has always been a matter of energy to me, a question of fuel. Sentimental people call it inspiration, but what they really mean is fuel. I have always needed fuel. I am a serious consumer. On some nights I still believe that a car with the gas needle on empty can run about fifty more miles if you have the right music very loud on the radio”
Hunter S Thompson