If you are happy with the end result, no need to change. A lot of the better quality of the sound would be lost if you can't listen at loud, reasonable levels. And as Sycraft says, a better headphone amp for your headphones if more important than raw conversion power if you are using headphones. Some interfaces will have better latency, but that doesn't seem to be a problem for you, either.
Unless you just want to spend money, the answer is no. If you do have money to burn, the Tascam uh-7000 is great w/o breaking the bank. Superior conversion and preamps, good headphone amp, usable latency. For the money, it is one of the best interface deals around. I could hear the difference between it and my TC Konnekt 48, which is on par w/ RME hardware, which is very good.
@