Thanks guys. I feel a lot better about this now. It sounds like I don't have much to lose by testing the latency and at least compare it to what my driver is reporting. If it's off, I might as well fix it.
And it doesn't sound like interface latency settings are a dynamic evolving parameter like I thought - thanks for clearing that up. Any dynamics in latency associated with other things appear to be dealt with by the DAW, so that's comforting.
Latency really becomes an issue for fast percussive instrumentation and I want to aim for the best precision that is reasonably possible. Was reading a helpful thread in another forum, that I am not a member of, and the guy was setting his offset based on a microphone sitting next to his ear, aimed at the monitors he would be listening to when tracking guitar. The difference between the speakers and his head adding 1.8 ms - and he figured that in.
That might be a little much for me, but I admire the commitment, ha ha.