Thanks for all the other replies. I tried forcing it to not switch, but it did not work.
Only setting to Audio Driver Bit Depth to 16 from 24 works.
I'll need to use X3 if I want 24 bit depth.
I really am very thankful to all those that took the time to send help and replies.