Konradh - I hope it works.
I struggled with this for ages when trying to track guitars through GP5 and Amplitube3. I knew my PC was powerful enough, and the CPU always looked barely used. I had started to think it was a problem with the Windows7 drivers for my interface. Killing Perfect Space stopped the latency issue in its tracks...
Now, I tend to use something like Pantheon LE if I need reverb on during tracking, and replace it later with Perfect Space or Reverberate. Or i just turn them off whilst recording. I guess you could freeze them instead, I'll try later.
Let me know how you get on.
Jonathan.