Yes, you want to uninstall the 32 bit versions and install the 64 bit versions.
Technically you don't "need" to, as the 32 bit versions would automatically get "bridged" by Sonar. It's just ideal to have the native 64-bit plugins if you're running 64 bit Sonar.
Of course, that means that if you have any 32-bit plugins with no 64-bit versions, you can leave it installed, as it should get bridged and work that way.
As a rule or thumb, you should keep 32 bit and 64 bit plugins in separate folders.
**Edit** Doh!! I just reread your post and realized you were asking about the sample data and not plugins in general. Hm, I have no idea if that data is the same between the 32 and 64 bit versions, but if it were me, I'd reinstall everything just in case.