Same issue here with X2a and UA plugins.
As long as each FX bin has contiguous UA plugins, there is no issue.
I think it's the UA plugin manager.
It gets confused when you sandwich other plugins inbetween its plugins.
Maybe it has to do with reporting latencies to the DAW?
... it's a mystery at this point...