Sorry, Craig, but you're inadvertently propagating well-intentioned misinformation.
... amp sims, virtual instruments, etc. can easily generate signals that go above the clock, and fold back into the audio range.
This is a true statement, but anti-aliasing will be handled internally within a well-designed synth or distortion processor.
If you have to increase your sample rate to make some plugins work better, then you need better plugins. If AD sounds harsh at 44.1KHz it's a design flaw in AD. What is the sample rate for AD's samples? 44.1 KHz. Playing them back at the same rate they were recorded should yield the best fidelity.
If it doesn't, and the reason is aliasing, then there is distortion happening within AD that either shouldn't be there or that should have been handled internally with upsampling and filtering.
Consider the most common scenario for generating "illegal" frequencies within your project: harmonic distortion. You might call it an exciter, an amp sim, a tape sim, a revitalizer, a tube emulator, or a saturator - they're all adding harmonics that can potentially include frequencies above Nyquist.
Such processors most often add odd-order harmonics. For example, a distorted 10 KHz signal's third harmonic of 30 KHz would exceed Nyquist at 44.1 KHz but not at 96 KHz. However, the fifth, seventh and ninth harmonics still exceed Nyquist, even at 96 KHz. IOW, raising your sample rate is only a partially-effective band-aid for mitigating problems in your plugins
that shouldn't be there in the first place.
A simple test using a sinewave and a spectrum analyzer will tell you whether a plugin is causing aliasing. Many do, especially older plugins and freebies. The better ones absolutely do not, and will perform equally well at 44.1, 48, 88.2 or 96 KHz.