John
OK but why would they be there anyway if (the higher frequencies) frequencies above half the sample rate are filtered out? And if this is happening than it must be considered a distortion.
Distortion is exactly why it happens. The audio interface takes great pains to assure that no frequencies above Nyquist enter the system, and if you only mixed pure audio tracks with no intentional distortion you'd never have to worry about aliasing. But if distortion happens within a plugin, intentional or otherwise, harmonics are going to be generated.
Plugins whose primary purpose is distortion, such as amp sims, are designed to deal with it because the designer knows up front that it's going to be a problem. That's why the better products offer 4x or higher oversampling, followed by filtering. Illegal frequencies are still generated internally within the plugin, but none of them make it back out to the DAW.
...wishing the problems weren't there in the first place doesn't make them go away; raising the sample rate does. Most of the foldover with 96kHz bounces back into a range that's above 20kHz so we don't hear it.
This implies that aliasing is an inherent and unavoidable byproduct of DSP. It isn't. Many types of processing never produce aliasing/distortion. For example, "boosting the treble" does not cause harmonic distortion. It will, however, exacerbate any existing distortion by boosting the harmonics.
Adding saturation does cause harmonic distortion, but again if your saturator causes aliasing it's the saturator's fault, not your choice of sample rates. Raising the sample rate would only be a band-aid to cover up perhaps half the fallout from uncontrolled harmonic distortion. That saturator will still sound bad at 96 KHz, just marginally less-bad.
Does 96 KHz push "most of the foldover...above 20 KHz"? Hmm, maybe. Depends on how you define "most". "Most" harmonics on most distorted sounds easily fall under the Nyquist frequency even at 44.1 KHz.
Let's look at a practical example, an electric guitar played through a high-gain amp sim. You play a very high note on your guitar, say with a fundamental frequency of 1.3 KHz (an octave above an open high-E string). The amp sim will generate harmonics at 3x, 5x, 7x, 9x, etc. The 15th harmonic is 19500 Hz,
still legal at 44.1 KHz. You have to get up to the
17th harmonic before changing the sample rate would deliver any benefit. I didn't do the math, but the level of the 17th harmonic is going to be down more than 90 dB from the fundamental. IOW, inaudible.
Synthesizers are a different can o' worms. A so-called "supersaw" contains both even and odd harmonics plus many sum and difference frequencies from the interplay between multiple pitch- and phase-modulated voices. Synthesizer designers have to anticipate such harmonic complexity. Improperly designed oscillators can indeed generate out-of-control harmonics. If Z3ta+ falls into that category, then I maintain that it's a design flaw. Zebra, for example, does not do this as far as I can tell.
I agree upsampling and oversampling helps, but both rely on interpolation and in the case of oversampling, stuffing in zeroes and interpolating on playback because attempting to interpolate while recording creates its own issues. Running at 96kHz for sounds that are generated synthetically provides "real" data for each sample.
There is nothing inherently bad with how upsampling works, even the "stuffing in zeroes" part. In fact, this is what happens every time you record
anything! Your audio interface isn't recording at 96 KHz, it's recording at some multiple of 96 KHz, at
least 64x that rate. So you're using upsampling
all the time. If it were messing up fidelity we'd still be recording directly at 96 KHz like they did in the early 60's when 96 KHz became the standard - precisely because of the lack of oversampling at the time.
Sample rate determines the highest frequency you can process. Period. It has nothing to do with "precision". Calculations aren't going to be more precise at 96 KHz. Precision is determined within the code itself, e.g. whether or not the programmer uses double-precision floating point values for all the internal math.
Saying I need better plug-ins is all well and good, but that's sort of like saying all my plug-ins should be 64-bit, which they should be. But some aren't, so I have to use bridging, which is a flawed technology but serves its purpose.
Careful, let's not bring bit-depth into the discussion. It's irrelevant to the topic. In fact I would
not be the one to say that all your plugins should be 64-bit, because I know that would have no discernible impact on fidelity.
Now, I do understand and agree with your underlying argument, which is that
you're stuck with the tools at hand, and a higher sample rate may improve the performance of some of them. I certainly couldn't afford to replace all of my plugins! So yeah, if I found out that most of my plugins were deficient I'd be seriously bummed and looking for any way to work around their limitations.
To put your premise another way, you could rephrase it thus: "if your plugins are substandard, a higher sample rate
might or might not help". I'm good with that.