A 128-sample buffer wouldn't account for 3/4 of a second. Something else is causing the unresponsiveness, but I have no idea what it might be, as I've never observed it.
I have, however, experienced keypresses not having any effect, e.g. hitting "W" to rewind. That has always turned out to be a focus issue, e.g. a plugin's UI has focus and "W" means something special to it.