I, too, have eliminated most of my 32-bit plugins, and for the same reason: the possibility that they could misbehave. However, in practice there have actually been very few that have had any issues.
The only problem I have with the ones I still use is no more than an annoyance: they do not pass keypresses on to the host, so I have to click off them before I can hit the spacebar to stop/start playback. Aside from that, my remaining 32-bit plugins still do the job just fine.
In particular, there are four plugins that have no 64-bit replacement but are just too darn good to let go of: Kjaerhus Classic Compressor, Kjearhus Classic Chorus, PerfectSpace and the above-mentioned Hbasm Stereoizer. All of which perform flawlessly under 64-bit SONAR.