Leadfoot
I've got a roller nut on one of my guitars and don't like it. It causes a nasty string resonance between the nut and the tuners that comes through in my recordings. I ended up putting some foam under the strings to stop it. I want to put a regular nut on it, but the foam has taken care of it for now.
It sounds like something is very wrong there. Is it a Fender-style or a tilt back headstock? Fender/LSR roller nut or something else?
The only actual problems I'm aware of with the LSR's is like anything they need to be installed properly (including using the right shims), they may not work with tilt back headstocks, they require a 1 11/16" nut width, they aren't available left handed, they have some limits on string gauges, and they require a different shelf for mounting than a normal nut slot (so they aren't an easily reversible mod).