Rain
In which case, my original question could probably interpreted as - if your converters are of average quality and don't support higher sampling rates, could the higher frequencies actually be affected (even if just marginally) maybe because you're basically running them at maximum capacity?
IOW, could better converters help reduce artifacts even at 44khz? Or is the notion of pushing them to their limits a bad analogy between analog and digital?
It's dangerous to try and view how digital works in terms of experience with analog - sometimes they behave very similarly, but sometimes it's just totally and completely different.
A few points:
In terms of things like digital amp sims (and also some synths), anytime you create distortion (or certain synth waveforms) you are creating high frequencies which will cause aliasing in digital. But for this reason in the modern world (where CPU power is abundant) any competent programmer upsamples their amp sim/synth plugins internally to avoid this problem. So it's not clear why running at higher rates is of any benefit for modern plugins (assuming whatever "quality" settings they have are set to their highest settings). If it was beneficial to upsample even more, the programmers just should have made an even higher quality setting available. Older plugins may or may not be a different story.
For things like a high EQ shelf, the shape of the EQ curve at high frequencies will definitely vary depending on the sample rate. But don't assume "different" means "better" here (or even audible).
In general, any time a higher sampling rate is necessary for optimal processing, in the modern world any competent programmer would upsample as necessary.
An ADC contains an analog low pass anti-aliasing filter at the front end. Does your converter have different analog filters for its different sample rates, or does it just use the same analog filter (since it oversamples anyway)? Everything may be actually getting sampled identically at the exact same rate, with the only difference being a sample rate change (SRC) at the output. SRC's are not particularly problematic in the modern world.
And most importantly:
You could buy a real nice guitar/bass for the difference in price between inexpensive converters and new "high end" ones.