We do this to avoid it being too aggressive on the CPU. If you want to experiment with more aggressive load balancing, you can tweak the MinPluginLoadBalancingBufferSamples setting all the way down to 32 samples. It defaults to 128 samples where it wont load balance unless the audio buffer size is at least 2x that. Its described in the documentation.
Keep in mind that load balancing is not a cpu saver. Its actually the opposite, it attempts to use as much available CPU power to get the job done faster. For audio processing, finishing the job faster means fewer dropouts even with high loads. With more aggressive load balancing you can get diminishing returns esp with projects that are already very high load. Hence we chose to keep the default settings moderate.