yah, no super easy way. An envelope would be the best feature of all, because you could select part of it or all of it, which in this case would be the dream solution for the poster.
I hear him, I insert gobs of small tempo changes to "humanize" a performance. I've never tried to alter the whole thing after that tho.
I think the easiest way is to bounce it all down and then Audiosnap the mix, where it's much easier to speed up.