If money were no concern...like that would ever happen!...I'd build a dedicated room and bring in an internationally-recognized acoustician to design it. The speakers would almost be an afterthought.
You're right that all speakers have their own color. The goal is to get ones that are as close to neutral as possible. Fortunately, there are many products out there that come reasonably close for a reasonable price.
But regardless of cost the most basic prerequisite is that they need to reproduce all the frequencies that you care about. If you have no bass guitars or bass drums in your music, and no mic rumble, then not hearing anything below 100Hz might not be a problem.