Craig's approach sounds great but still involves clips being split. And the moment you split clips you really have to check how things sound over the boundaries. Longhand, in real time. There is still no quick way. You will have to reconsolidate the file too.
What I like about an editor is once the VO has been recorded I open up the whole full length file no matter how long it is. It is real fast to recognise the breaths and just swipe the area with one action. Then I have got a key command setup so one button press drops the breath by 10 db or removes it. Then you just rewind a little and have a listen and move on.
Occasionally you might get a click right on the end of the previous word or the start of the next word in the swiped area but mostly not. Often there will no sounds there at all just the breath gone or dropped well down.
Sometimes too you may want to remove an area of silence because the reader just hesitated or took a slight pause for some reason. In the editor you can also swipe the area of extended silence and in one key command it gets chopped out and the whole file to the right moves back in an instant. That is what I mean by fast.
It is easy to undo anything too in an editor.
Then you just save the newly edited file with a new name and you are away. You can always open up the original file too if you need to and go back.
I have always believed anyway that a decent editing program is a must alongside your DAW. Especially if you are doing lots of serious VO work.
I open up every track of a multi track mix before mixing in the editor and do some prep work there. There is ton of stuff you can do there that will save buckets of time later. Checking levels with a VU meter being one of them too. Any quiet bits can be easily lifted or loud bits pulled down a tad. Stray noises removed. Noisy sections noise reduced out etc...