I'm sure no-one can tell the difference between 6 ms and 9 ms latency. 6-9 ms roundtrip is very good by any standards, even though many can get even under 6.
If you play high-transient instruments, you can feel the difference in response between 6ms and 9ms total round-trip latency. Triggering drum samples, I'd want round-trip latency to be 5ms or less. The Roland units can do 7.4ms at a 48-sample ASIO buffer size (this assumes the machine can sustain the load).
Don't think you can tell the difference in feel between latency settings?
Play your favorite piano sample library at a 64-sample ASIO buffer size.
Then shoot the ASIO buffer size to 256-samples.
Which feels more immediate/responsive?
Generally speaking, to achieve low round-trip audio latency:
-DPC latency must be low/consistent. If you're trying to work at a 64-sample ASIO buffer size or smaller, this is paramount.
-Use a USB controller that's integrated into the Intel chipset. Using a 3rd-party USB-3 controller doesn't work well (or as well) with many USB-2 audio interfaces.