To be clear: even if the PSU is left in place it must be disconnected before an external PSU is connected to the main PCB. So must the off-board regulator transistor. Frankly, after doing the above, removing the old gubbins is easy!