brundlefly summed it up perfectly when he said "the digital sweet spot is pretty wide, and signal to noise ratio in the acoustic environment gets to be an issue long before you run out of digital resolution at 24 bits".
You can think of each bit as 6dB of dynamic resolution. Not using the topmost bit means decreasing the signal-to-noise ratio by 6dB (don't anybody nitpick over my numbers here, this is rule-of-thumb stuff). With 24-bit audio, that means you've raised your theoretical noise floor from -144dB to -138dB, which is still WAY below the threshold of audibility, and way below the analog noise you added yourself when you recorded your tracks.
To put that into perspective, your favorite tape-recorded records, including those that won Grammys for engineering, won't have a noise floor below -70dB. You can "lose" a lot of bits (10 or 11 of 'em easily) before you're as noisy as those Grammy-winning records!
One other thought...analogies to analog equipment don't work. It's true that every amplifier has a "sweet spot", but that mainly has to do with the (non)linearity of transistors and tubes, as well as staying sufficiently above the noise floor. Inside the computer, any non-linearity is an intentional effect, and the noise floor is so far down it's a non-issue.