@dtboos - while you can, I suppose, use the 'E' bypass to allow you to continue to track, I was suggesting you try it only as a 'test' - to see if the problems were from one or more of the loaded effects.
You might now consider temporarily swapping out the problem plugins - just until you are completely done with tracking, and then when you move to the mixing phase you could put those effects back in (and adjust your ASIO Buffer Size way up to allow them to do their thing properly).
The kinds of effects that are really meant for mixing/mastering include those that use something called 'look-ahead' processing, or otherwise consume lots of CPU. Examples of these kinds of plugins would be: Boost 11, Perfect Space, LP-64 EQ, etc.
So, swap out if you want to hear effects while tracking, or if nearly done and are OK with it - perhaps simply bypassing would work for you.
Next project - don't load plugins that cause latency problems, until you are completely through with the recording process, then crank up the ASIO Buffer Size and load them in for mixing/mastering.
But, glad you now have an idea of why you were having the issues.
Bob Bone