I think that convoluted reverb plugins, such as Perfect Space, by their nature - add a bunch of latency, because of the way they process.
BUT, this is not really an issue, except if you are using a plugin like Perfect Space while you are still tracking/recording.
Plugins that use look-ahead processing, or otherwise chew up massive CPU, are not really intended to be used during the initial recording of a track. These kinds of plugins are meant for use once you are PAST tracking and have moved on to mixing/mastering.
What I do is to use run of the mill reverb plugins during recording, because I run with my ASIO Buffer Size set to 128 while recording, and sometimes even run at 64.
Once I finish recording and am ready to mix, THAT's when plugins like Perfect Space or Boost11 are intended to be used, and to give them the horsepower to do their thing, I adjust my ASIO Buffer Size WAY up to 1024. That bigger buffer makes trying to record pretty much impossible, but it works GREAT for mixing, because I no longer need to worry about the latency.
So, generally speaking, for the rest of time I will be following the above approach for projects: tracking with low-latency plugins and a small ASIO Buffer Size (64 0r more typically 128), and then for mixing jacking up the ASIO Buffer Size to 1024 and loading up the more demanding plugins like Perfect Space or Boost11.
If you already have plugins loaded up and do not want to swap them out to achieve what I do as posted above, you could instead leave those plugins there and finish the recording with your effects bypassed (hitting the 'E' key on your computer keyboard will toggle on/off the bypass of all the effects loaded into that project). Once done with recording, you could then hit 'E' again to toggle the effects processing back on, THEN make the change to your ASIO Buffer Size, then move on to mixing.
I hope some of the above is helpful to you - best of luck with it all,
Bob Bone