I usually transform the clips after moving them to the PRV.
Just highlight the "inappropriate clip" as a whole, and move the velocity slider (bottom view of PRV) until it's close to the one with the "right" velocity.
If I really get picky, i'll do it separately for kick, snare, hihats, etc.