Beeps: Just read your last long post. Well said. Just remember, this stuff will always be subjective once you get the blatant issues out of the way. It's ok to be you and do what you feel is best. This is why we have mixes from people that sound so different. It's good you want grit in your mixes. However, the idea should be to try and get things clear first...then add the grit. And once you get a handle on everything, you might even add the grit destructively to your mixes...which is ok too as long as you know how to handle it. Like I said...crawl before you run brother.
This low end mud you're referring to on drums and guitars....you have to know where the mud is. Just high passing can sometimes hurt you as it can take out the GOOD stuff too if you're not careful. You need to first determine if there is mud and then find out where it is. Most times with samples, you can high pass selectively and then pull out some of the other nasty stuff if need be. But it's always different and depends on the kit you use. Personally, I think this layering thing is where the problem may be.
Try working with one good drum kit, 2 rhythm guitars and a lead guitar. Go for less is more and see what you can do there. See man, the key with layering is...you MUST gear the instruments to be orchestration pieces. Meaning, if you use 4-6 guitars, they all have to be eq'd differently to support each other and they can't be clones. They must be physically played or all you do is add to the mayhem of noise...in a bad way. I say keep it simple and lets learn how to deal with this stuff and do some "sound identifying". This will be much easier with less instrumentation. Once you learn what constitutes a good, solid sound, then you play with the orchestration pieces.
For example, an old song here...but check out Creed's "Overcome" when you get a minute. What I like about that song is how controlled the low end is as well as how the guitars are layered and it has a really good drum sound. When the middle of the song comes about and there are just two guitars, you hear how much the layering has made a difference. I hate that middle section guitar tone. It's so thin, raspy and uggh...but man, when the others hit in the chorus, it sounds amazing and full. So the key with layers is you have to be able to eq each part to make a difference for the better.
You also want to use a totally different sound too so it adds to the layer. Again, no cloning. As soon as you clone parts, you're out of the layer mode because it's the same exact part being played unless you time adjust it or move it a few ticks etc. Even there, the layered effect is much more dominant when you physically play the parts as opposed to cloning.
With your drums, you can get away with layering and hybridding. BUT...like the guitars, try to stay away from that for right now. Let's get a good mix up in its infant stage so we can check it out further and see what you're getting out of the gate. With drums, I like to layer when I hear something in a drum instrument that is a one trick pony. Meaning, some kick drums just have this awesome thud to them. No matter what you do, you can't get the right beater attack out of them...so heck, you just add another that DOES have some beater attack, and you mix the two together. Same with snares. You may get a snare that has a big sound, but it just doesn't crack hard enough nor does it have enough sustain. So you add in a pic snare or something with a bit of "ting" and resonance to the big snare, and you're golden.
A note on cymbals: Remember that they are percussive instruments...they should never dominate. Our ears gravitate towards bass and high end at times. Thus, you sometimes have a lot of bass in a mix or excessive highs while stripping out mids because we think we are cleaning up the mix. The mids make it big and have body...as long as we don't over-do it and congest the mix with mids.
But cymbals should just be heard enough to where you never question "did I hear that?" as long as they don't dominate. Hats will always be the loudest of the cymbal family, but you have to be careful there because the last thing you want is tssssss tssssss tsssss all over the song. The most important part to remember about cymbals, is the opposite of what we do with bass. I'll explain...
There are times when you may need more high end in the cymbals. When that's the case, you always pull down the fader when increasing any high end. You have to determine whether or not to raise the fader, lower the fader, raise the high end or lower the high end. This is as difficult as raising the low on a bass, or removing some low end and just dropping the bass fader. Most times, the best choice is to lower the eq you are questioning and raise the fader because little things like that (which can become big annoying things if you're not careful) can actually be fixed via mastering if they aren't too jacked up.
You made a mention about your faders nearly being all the way up or something? Before I mix something, I zero everything out to off and start instrument at a time. When I do this, my instrument levels start out at about -10 dB peak per instrument and my faders are usually under unity/0/center position. If you find you are way low when you are at unity (in the center of the fader) you probably need more level from the drum sampler output. Anything I record audio wise goes in at -6 dB peak so I'm usually in good shape there. But if you are seeing low levels, you probably need to make adjustments in your drum program.
For drums I like to use a little template that sort of makes me do what a live soundman would do. For example, I create this little project one time that has 8 kick hits, 8 snare hits, etc until all the drums are done. Then I play the entire kit. When I know what drum module I am going to use for a project, I create it in this little project and then set up all the levels in the drum program as well as fader levels and gains, pans etc. When this is done, I save the drum template for that drum module. So when I go back into the real project that needs drums, I bring that drum instrument template in, and I have a good starting point. Once you do this one time for each module, you can just bring the drum modules of your choice into ANY project and you're already in good shape with only subtle tweaks to make.
Anyway, keep some of this in mind and know that I'm really proud of you for taking this as far as you have. It only gets better from here brother. And nothing you've done should ever be considered "Stupid". We all learn every day. We try things....that's the fun of it...trial and error. I'm all about that. I can't even tell you what some of the theory in recording is called. If you put me up against a new Full Sail grad and we get quizzed on terms, I lose hands down. I'm talking obliterated. LOL! If you put me up against that person in a mix situation, I'm either right with them or teach them something about being in the field for the years I've been at it...so trial and error is great. We just have to make sure we truly learn from the trial as well as the error. :) I'll be looking for more stuff from you. Got the pm also...thanks man.
-Danny