I COMPLETELY agree, concur, flat out go along with, and think it to be so, what Mr brundlefly has posted.
What happens if you load this project and hit 'E' on your computer keyboard? (This has a key binding to toggle 'Bypass All Effects' off/on).
If your latency issues clear up immediately after bypassing the effects, then one or more of them is likely meant for mixing/mastering, and will require the ASIO Buffer Size to be set WAY higher. In addition, these kinds of plugins make it just about impossible to use while tracking (recording), because of the need to crank up the ASIO Buffer Size to accommodate them.
Some folks have to turn their ASIO Buffer Size up to 1024 or even higher, depending on the plugins used during mixing/master, but that is fine, since you aren't concerned with recording at that point.
Soooo, low latency through a small ASIO Buffer Size and lean plugins during tracking, and then high latency through a large ASIO Buffer Size and look-ahead processing plugins (and CPU-hungry ones) during mixing/mastering. You will for the rest of time be adjusting your ASIO Buffer Size back and forth, as you switch back and forth between recording and mixing/mastering. It is the nature of it.
Bob Bone