You can get dedicated bus controllers or monitor mix matrices. Unless you already own one, I'm not sure what to suggest. I would try to decide what is your summing point and take it from there. It sounds like your taking a long trip for a shortcut to me. There's always an easier way.
For example, if I was using 12 track/4 bus mixer I would always keep in mind my main output will be my summing point. So in a way, you could split that to a monitor control which allows you hear your mix through different speakers without sending multiple group sends. If that makes sense.