I've had this issue years ago running duel 1010's running on win 7.
PCI audio interfaces seldom to never have latency issues as do external USB and Firewire interfaces do.
Which pretty much narrows it down a physical failure and or corrupted drivers.
I had solved my issues by covering as many of those bases by simply pulling out the 1010's cleaning dust from the cards themselves and blowing out the PCI slots as well, and swapping them out between PCI slots, which will force the drivers to install to the new locations.
However uninstalling the drivers, rebooting the computer, and reinstalling the drivers fresh gives a better guarantee against driver package corruption.
Certainly worth a try, but make sure you have and know where a saved your I/O patching and configuration settings to a user defined file to save yourself a considerable amount of extra work and frustration.
If problem persists I'd pull one and try running 1010 at a time to isolate the problem for component failure on one of the cards. Keep in mind these 1010's are at least 15+ years old.
I was still running win 98SE when I installed my first Delta 1010 LoL. I'm actually shocked and amazed that M-Audio supported them all the way up to win 7x64!
They do NOT offer support to win 10 where they may or may not be usable, 'tis a crap shoot.
I've read reports of some using them without issues in win10, some reports that they don't work at all. The last of my 1010's got extremely flaky and unstable in my living room computer which was just used for playing music and surround sound DVD playback, (nothing hooked to it supported ASIO drivers) went PITA after upgrading to win10 and would always default the clock setting to 44.1k/Hz upon boot up and have to be manually set to 48 k/Hz to get any sound at all.
I'm thinking it didn't like the new and improved Windows sound drivers? Why does the clock need to be set to 48 k/Hz to even play CD's or .mp3's in Windows Media Player???
And what even more confusing is how in the name of Zeus's butt hole did my grand daughter figure THAT one out?