Problem with Remove Silence

Remove Silence changes the display of clips. Example: Vocal clips correctly displayed at measure 1, apply Remove Silence - the clip display is moved to measure 4, but not necessarily by exactly 4 measures. No rhyme or reason there. The audio still plays when the cursor reaches measure 1 even though the display has moved. I can't work like that so I have to undo and refrain from using Remove Silence. Only happens on tracks containing vocals. Anyone heard of that or know how to fix it? Thanks - rev