Possibly Dumb Latency Question

I keep my ASIO driver low when tracking (like 256 or lower) and high when mixing (like 1024).  When I freeze a soft synth (like a Kontakt instrument) does this make any difference?  In other words, if I am at a high setting like 1024, will there be delays when I freeze the track, or will it freeze on time?
 
For example, playing the track back at 1024 will cause some delays so the kick and bass don't hit right together.  If I freeze at the higher setting will this delay get frozen in?  Do I need to freeze at a lower setting (which I fear will cause drop outs or static)?\\I am not freezing in real time: I am using the fast setting.

I freeze tracks a lot, and did even more before I upgraded to an SSD for Hollywood Strings. I have frozen tons of tracks at various buffer settings and have never noticed a problem.  

As others have indicated, normally, the size of the buffer would not affect the playback timing of  a frozen synth, but there is one exception. Bitbridge has a bug that will cause an empty buffer to be included in the freeze of a 32-bit synth such that the track will play back delayed by the size of buffer. I've run into this with Dropzone and BFD Eco. The third-party JBridge does not have this issue.