it will be helpful if you can give us a lot more information.
are you dragging and dropping an audio loop drum track or a MIDI track? if MIDI, what is the OUTPUT of that track? (are you using a softsynth or are you using the MS GS Wavetable / your soundcard or what?)
Buffers = 4 is just the number of buffers you're using, not the size of each buffer. what are your audio settings for hardware buffers? and which driver mode are you using?
what soundcard are you using?