It's hard to say because each system is different.
I'm not familiar with your sound card, I took a quick look and see it's no longer available and that it's made by Creative. That's enough for me to question if it's drivers are up to the task.
Example..I used to use a Tascam us1641 and would have those same problems you are having. Since I switched to a Focusrite the issues have gone away. It's the drivers.
Other than that make sure you optimize your computer and check with Latency Mon for background issues.