Joey, all the answers above explain what a limiter is, but so far nobody's addressed your real question, which is how to balance loudness from one song to the next. A limiter does come into play, but the primary tool you'll need is actually a good meter. That will let you set how hard the limiter is driven and thereby adjust the perceived volume.
A good place to start with metering is
Voxengo SPAN. It's easy to use, it's free, it supports a widely-used standard for gauging levels called the K-system, and it's an excellent tool for adjusting loudness to whatever standard you choose.
You can get more scientific with an EBU loudness meter, but I'd hold off on that for now. Get a copy of SPAN and insert it on the master bus, at the end of the chain after everything else. Put it into Mastering Mode, set the meter to K-14 and adjust the input to the limiter until your levels are hovering around the 0 dB mark (which is actually 14 decibels below the real 0 dB, and that's the point of the K system).
With your levels bouncing around the 0 dB mark, if your song is still too dynamic and/or not loud enough, add a bus compressor in front of the limiter. But if you can get the desired results without master bus compression, that's better.