It's more to do with the leading edge of transients, Jerry. Does a drum kick pressurise the air or 'suck' on the initial kick?
Are you in front of the drums or behind them?
How about a test that doesn't involve the reproduction chain? Just stand on different sides of a real sound source and try to work out if it sounds different..