Speakers are the worst generators of distortion of almost any audio system, electrostatics being the odd exception. Jitter has been low enough for ages now (and good stable cures have been available for the old bad offenders for about as long).
I'd add that PASSIVE speakers are potentially the worst of all, as many crossover networks introduce all manner of nasties, no matter how good the components in the best examples are...
Tear down these walls; Cut the ties that held me
Crying out at the top of my voice; Tell me now if you can hear me