Yes, you could do that although the noise performance may suffer as Aurorasound provide shorting plugs for the disused sockets.