Input Monitoring Latency

Sanderxpander
Do you still get the lag if you hit E to bypass all plugins? 

Jim Roseberry
Latency has but two sources:

• Your audio interface
• Latent plugins

 
The audio interface's latency is fixed (determined by the ASIO buffer size and the size of the driver's safety-buffer - which is often hidden from the user).
 
Virtually all modern DAW applications feature automatic plug-in delay compensation (automatic PDC).
If a latent plugin is inserted *anywhere* in the project, all other audio is delayed by that amount to maintain sample-accurate sync.  "Mastering" or "convolution" type plugins are commonly latent (add latency).
Avoid using latent plugins while tracking... or temporarily disable PDC while tracking (making sure to re-enable prior to mixing).
 
There are no other sources of latency.
Your issue is one (or both) of these. 

Sanderxpander
Normally a softsynth shouldn't cause latency by itself. Perhaps it has some internal fx though. Likely culprits tend to be:
- Impulse based reverbs (can include ampsims) 
- Limiters/compressors with lookahead (brickwall limiters for sure) 
- Linear phase EQ (usually not a lot) 
- Transient designers (which are really a variation on compressors)

razor

Sanderxpander
Normally a softsynth shouldn't cause latency by itself. Perhaps it has some internal fx though. Likely culprits tend to be:
- Impulse based reverbs (can include ampsims) 
- Limiters/compressors with lookahead (brickwall limiters for sure) 
- Linear phase EQ (usually not a lot) 
- Transient designers (which are really a variation on compressors)

You wouldn't think, but the latency continued after bypassing all fx. I thought at first that fixed it, but then realized the latency was still there after bypassing all fx. At that point I closed kontakt and the latency went away right then and hasn't come back.