i had a 2496 card, before i got my audiophile 192 card, never experienced any issues at all.
if the same thing happened with two different cards, then i'd say the problem is in your pc setup.
sound like a clocking problem, or, something in your pc's OS is stepping on the card signal.