Your picture can scare people, the buffer was way too big

I am sure I was getting better numbers, but that was several years ago, under different OS (and so with different drivers). So at the moment, without looking what is installed (I have connected nothing to X-Fi since I have installed Win10):

So well, at the moment I have some latency with my X-Fi...
But can you publish the picture for your 6i6 ?
I have tried to measure latency in Sonar, a kind of method you proposed before. But since Sonar is "smart" to compensate different delays, the only reliable way I can imagine:
* put some file on another player (phone) and connect one channel from it to the interface
* loop one output to another channel (on the interface)
* echo original input to looped output
* record both channels into second track....
* check shift between channels
I can not test with SB now (I do not have required cables in hands), but for my Audiophile I have just checked that, ~11msec, as reported by RTL Utility.