Well, I wanted to play the game so I downloaded the WAV files. However it is not possible to do a real evaluation or a null test
because they are not the same musical passage - the notes are different. Perhaps the differences relate to the discussions about the need to do real-time synth recording because of varying randomized synth parameters. If a couple oscillators had started at a different point on their cycle and maintained that delta throughout the recording, then the test is meaningless from the start anyway.
Another potential complication...
SoundblendWindows 10 Pro 64bit / 4Gb Ram / Radeon HD 6870 / Cakewalk Sonar Platinum / Steinberg Ci1
From the Voxengo web site (Italics added) :
"This plug-in is compatible with Windows XP computers (2 GHz dual-core or faster processor with at least 1 GB of system RAM recommended).
Note that this plug-in may not work correctly on the latest Windows versions that expose more than 2 GB of available memory to the host audio application. Otherwise it is suggested to run this plug-in by bridging (for example, by using
jBridge).
Also note that this plug-in may not work correctly with some 64-bit host audio applications via bridging." We don't know what "working correctly" means - does it mean a crash, or perhaps something more subtle like distortion? I presume the former, but I don't know for sure.
Another issue is whether the SONAR export was fast bounce or real time. Any issues with latency, even if not immediately audible, will not occur with fast bounce. I presume Recorder is inherently real-time?
For a truly scientific test, the file that's rendered should be EXACTLY the same source material. Also we do not know what the synthesizer output is supposed to sound like, so we can't judge whether one file is better than the other at reproducing the actual sound of the synth. For an extreme example, some people prefer the sound of an MP3 file over a WAV file, even though the WAV file is more accurate.
You would need to render the same musical passage over some other programs as well without Recorder to see if those audio engines sounded more like what's coming out of SONAR or what's coming out of Recorder. If the majority sound like SONAR, you'd likely conclude Recorder had a problem
with accuracy. If the majority sound like Recorder, you'd likely conclude SONAR had a problem
with accuracy. But for now, there's no way I see to draw any meaningful conclusions from this test.