I am not sure if I caught everything in this thread, but wanted to throw a few things out for thought.
You mentioned you tried "ASIO" but wanted to hear other things too. There are two points with this specifically...
1) ASIO is the most efficient CPU/latency usage you can get, so please consider this when you are trying to cut down on CPU. ASIO (and WDM) drivers, bypass the windows kernel, so streamline audio and CPU usage from that alone.
2) As you realize you have CPU issues, throwing another driver mode (particularly MME if you are using that) into the mix is "just asking for pain."
A second point is latency and I/O buffers. Have you adjusted your interface latency and I/O buffers for X1? This is an important step and is system specific, and should be done any time you make a change to the system.
Just for clarification, can you please let us know what driver mode you are using with X1? If I missed that someplace, I apologize. I saw MME, but please clarify this (that is the absolute worst choice you can make for driver mode). Research and read up on "ASIO/WDM versus MME."
Edit: I glazed over codamedia's response to you... so think MME is correct.