Go up to the top bar in Kontakt and click on Options.
Go down through the settings on the left of those and look for something there. It may show as high as 4096 ms.
Also, if using Kontakt 4, on page 11 of the manual, there's a Latency Optimization slider to be aware of.
Lastly, check you're audio interface settings.
Sometimes jumping from a DAW or VST setting to stand alone may cause the latency setting to jump. I had this with Studio One & my Studio Live 16.4.2 mixer.
I couldn't figure out what happened - then I noticed that my 16.4.2 interface setting had jumped to 4096ms - ouch!