Are you using any different plug-ins than normal? Could it be latency inducing plugs, such as PC Concrete Limiter, LP64 Multiband Compressor, LP64 EQ, Transient Shaper, Convolution reverb (e.g. Perfect Space), etc?
Does latency disappear if you press "E" on qwerty keyboard?
Just a thought.