Even this thread is older, maybe I have a hint.
I also use sometimes Cool Soft. I struggled about this latency Problem also. But after a bit of thinking it might be clear, that Cool Soft is a virtual midi device, like the gm midi device. This means, the Audio is routed to the Audio device directly. So the latency depends on your Standard Audio Driver.
However, plugins like tts-1 or other VST Soft Synths use the Audio device of the DAW (Sonar e.g.). The midi ist routed to the VST and the Output of the vst is routed back to sonar. I experienced also bad latency, when i tried to make a mix from TTS & Coolsoft. The Coolsoft has noticable more latency then the "internal" synths.
The round trips in Sonar cannot measure this, as the Audio Output from Coolsoft never comes back to sonar.
Does this makes sense for anyone ?