Absolutely, and that's precisely what I've always done

Thing is, if a room is really bad and your chosen speakers just aren't working in it, then the detrimental effect of that will far outweigh any benefit a good source component makes....

Like Dimitri alludes to, forget 'first anything' and simply prioritise things equally. Remember that you're building a system, not a disparate collection of boxes.

Marco.