I've coincidentally been contemplating this point recently, and it seems that there are conflicting factors to consider.

I agree Marco about your conclusion from an earthing standpoint, but this means that the other items, often drawing much more current, eg. power amps, will draw that current past the sensitive items, possibly causing a voltage drop which may appear in series with paths of the sensitive ones.