Note that like some other drivers, the TASCAM drivers don't get along with ASIO4ALL. If you have TASCAM drivers that work for you, uninstall (not just disable) ASIO4ALL and you will likely have better performance.
 
I knew someone who was giving a presentation and using the TASCAM US-366. He was in a panic because he had to choose really high latency and he still had crackles. I found out he had ASIO4ALL on his system and recommended he install it. As soon as he did, his problems disappeared.
 
Sometimes ASIO4ALL works well and sometimes it doesn't. In either case, I'm glad you solved your problem.