Something's not right there. The nudge definitely shouldn't affect the click & drag, the snap value does that. If snap is off you should be able to move by any amount you want be that large or small.

With snap on the drag move will be constrained by those settings, but you should still be able to set those as small as a number of samples, ticks, seconds or frames. Intensity will also affect how effective it is.