That’s the point. Everything else matters so much more that it is better to invest the money in speakers (including subs) amps, speaker placement and room treatment (electronically, physically or both) first.
You can later on upgrade the sources.
Investing tons of money in hi-res while the industry has no standard for it yet is for pioneers that can afford the fast depreciation of expensive electronics for a very small selection of music.
Most real hi-res music (not the upsamplesd stuff), is recorded and masters in high quality by experts that know what they are doing and sound generally speaking very good because of the skills of the studio masters. That music is however often available in redbook and often also vinyl, still sounds much better than poorly recorded music.
Then there is a huge factor: that is ease of use.
Perhaps owners of EUR 40.000 systems can hear a significant difference in SQ between hi-res and redbook CD, and if you have that kind of money burning in the pocket it’s Good for you.
But don’t go around and burn down decently intended attempts to standardize digital audio (MQA) or upgrades (APPLE music).