I have a similar issue, but with audio. The audio drifts gradually out of sync with the music if I leave the loop running. I can normally manage about 2 or 3 loops of 4-8 bars before I hear a noticeable difference, then it gets progressively worse!
Same as you, it's not tragic, a couple of taps on the spacebar and we're good to go, but it shouldn't happen.
The metronome fix sounds bizarre, but I'll give it a go.