This happens to me every time I change the buffers on my M-Audio Fast Track Ultra.
There's a whole process I have to go through.
The only difference is, I don't have to reboot like you do.
I get an error message about an 'Audio Dropout', then I get an error message saying "No audio recording device", then I click ok, play the project again, and it works.
Don't laugh (LOL), but have you checked Tascam's web site for a firmware update to your unit? LOL!
Sorry for laughing, but this is one of those
rare cases where that may actually help if there is one available.
Firmware is the internal software on the chips inside your unit. Since your drivers are updated and you still see this, it may be a chipset software (AKA Firmware) problem.