Like the OP says, you can slice and dice loops to build your own patterns, but I personally have never used loops, the PRV is so familiar and comfortable for me that I can't imagine doing it any other way, except for maybe hiring a drummer and telling him/her what to do.
I guess it's all in what you're comfortable with. The better you know and understand a given tool or technique, the more the tools get out of your way and allow you to focus on the music. In that regard, if loops do it for you, that should be where you work. On the other hand, I suspect (but I don't know for sure) that MIDI gives you some capabilities that are harder to manage with loops.
For example, I think Addictive Drums for one is pretty smart about using different samples for the same piece of kit based on velocity settings, which is one area that I would think MIDI might be superior to loops. I monkey with velocity all the time and would miss that feature an awful lot if loops didn't allow me to do the same thing.