For an audio book I would be aiming for a very even voice level in the final master. For the reasons you have already mentioned. Playback environments will vary a lot. And you want to hear the voice clearly all the time. The way to this is to edit the initial recording.
I would record the wide range of input sounds/levels. Capture all that without clipping. eg (
use K System level of -20 as the reference) Maybe even tame the dynamic range going into the DAW a little by acting only on loud peaks first e.g. limiting with high threshold setting.
Then I go in and cut the vocal read into smaller segments. Studio One makes changing clip gain like this on individual audio events easy and possible. Also as the waveform height does change as you change gain, this end up being a really handy feature for roughly evening up vocal phrases by eye. Looking at the
rms or
meat of the sound. Louder phrases down a little and softer ones up. You don't even everything up either. That sounds unnatural. Preserve some of the initial dynamic range read, just reduce it. A long read takes less time than you think to do this process.
Then you put a compressor over the whole track but you are now feeding in a much more consistent rms levels for each phrase. Add some makeup gain there. Light compression settings here. Like 2:1 max ratio and only 2 to 3 dB gain reduction too.
By the time you hit your limiter and add further 3 dB or so of rms level, you will be sounding very loud on your CD.
Forget preserving the dynamic range of the initial read. That is not the point of the exercise. It is better to create a very clear voice over read. All the emotion can be put in at various levels, but the same emotion can still be conveyed when all the vocal phrasing is much more even in level. The editing extends far beyond the read itself. I like to add a final touch EQ and even add a very small room reverb at a very low level to just add some depth the to vocal sound too. This reverb should not even be obvious. If there is music and effects under, then that requires balancing too.
(Small mono speaker at low volume works wonders here !!)