Modern design means blinds instead of curtains, no carpets, no clutter of any kind and non-traditional (i.e not big and stuffed) furniture) so if your room is like that I'd expect some changes could be wrought by adding a bit more absorption and diffusion. If the photos of people's set ups are anything to go by a lot of people live like that now.
On thing never mentioned is that it does depend at what volume you play at. Quiet listening won't really get things bouncing around. My room has big stuffed couches and heavy floor to ceiling curtains, plus bookshelves and lots of irregularities that soak up a lot of the sound that bounces about. However I have notices that recently, since I improved things and can now play at much higher spl with no distortion, that the sound is bouncing around in the 'hard' space in the corner where the front door (which is just a plain, solid chunk of wood) and side wall (just plastered brick) meet just to the left of me as I listen. Never noticed this before in 18 years of listening in this room. Might need some absorption on the door I think.
Having the speakers 'too close' to the wall may not be so bad, depending on the speakers. Some sound better like that. Okay it does compromise imaging a little bit, it reduces the sense of depth, but half of what we call imaging is imaginary anyway. It depends how important that factor is to you. On the plus side it reinforces bass and makes it a little more 'solid'. It might be easier to change the speakers if they don't work well close to the wall, rather than stick a bunch of stuff behind them which, in itself, may not have a high WAF.
Current Lash Up:
TEAC VRDS 701T > Sony TAE1000ESD > Krell KSA50S > JM Labs Focal Electra 926.