You would lose V-Vocal for sure.
If you do decide to do this, I recommend you do not let the removal process remove the X2 plugins, as many are the same as in X3.
Also, you may want to hold off for a while, since you may need X2 to open any projects that were created in X2 or prior and unable to open for some reason in X3.
Bob Bone