Totally understood, Drew. But even if you do the test, and the results are bad, are you getting good results from ARC or do you believe it's just one of those tools that work for some, fail for others? If the flat line was a bit optimistic and you found flaws, does it matter if your sound is still consistent everywhere and it doesn't take you 2 weeks to do a mix? LOL! See, that's my whole point really.
I also get where you're coming from when you mention ears, science art etc. My point there is, is it necessary to know about the science part if something just works and you can go back to using your ears while not worrying or caring what is scientifically happening? Ok, some care about that stuff and want to know every little detail. I get all that. :)
For example, I like to think of myself as a fairly credible audio engineer. But there are some things you might ask me that are theory based, science based or more technical that I wouldn't even try to answer because I simply do not know. The reason I may not know is because I probably felt that particular subject was not something I felt would do much for me for what I'm interested in as far as audio goes.
That said, I know some of that is important in the grand scheme of things and can make a difference. However, if I don't know about these things and am still achieving good results that are working on a large scale...does it all really matter?
Like, if I were to bury my head in some of the stuff I've seen you talk about on here, it would probably take me a good 5 years to be able to understand some of it. You come out with some answers to things that totally blow me away...and I mean that in the most respectable way. But for a guy like me that has the attention span of a flea when something doesn't pique my interest, the whole science part just kinda bores me. I would think that the lab work I do in the engineering field would get me closer to what *I* need from it moreso than the science part, don't you? Like I mentioned before about guys talking about meters for 4 pages. Sure, I've calibrated my meters etc, but that's the extent of it. I see if I'm peaking or I make adjustments if I HEAR something that sounds like peaking even if my meters are reading ok.
I'll be the first to admit I'm probably the garbage man of audio engineers. LOL! I'll never claim to be anyone that is better than anyone else...but I can hang fairly well to where I and several clients have been satisfied with my work even though I have a grade 5 mentality. Just recently, a pretty big star produced an album for a friend of mine. I was called in to mix the album. The star was a bit skeptical since he had never heard of me and wanted to hire some of his people. The friend of mine said "no, you have to let this guy do it...trust me, you'll love his work."
So I talked to this star dude and told him what I was about, what I planned to do and how I planned to mix the record. He flew from Cali to my studio so we could work together. I had everything mapped out and presented him with a finished product just to show him what *I* would have done as the producer/engineer. He sat and listened to the whole thing without saying a word. When it was done, he looks at me and says "who are you dude, and why haven't I heard of you!?" I showed him some of the stuff I had done for other "stars" as well as who I've worked with, who I know etc. He called me "our best kept secret", smiled, shook my hand and said "will you be available for April? I'm starting my album then, are you interested?"
He changed just about NOTHING in my mixes other than we adjusted a few instrument levels here and there. No eq curves altered, no effects taken away, no effects added, he said everything sounded exactly like he would have done it and was just in awe of the job I had done. Maybe he was lazy and because I did the work, he didn't want to? There is that possibility. But 2 weeks later, I get a call from him and will start recording his album in April. :) Why the secrecy? I'm not one that ever name drops publicly or even on my site. I don't need the business that bad to have to do it that way. Word of mouth is fine by me. :)
My point? I'm just a normal dude that dropped out of college after 6 months....I took a few courses on audio at studio's that offered classes, they sucked, I barely learned a thing, bought some gear, set it up, learned either by trial and error or reading manuals until I learned what I was looking for, and here I am. I can't tell you the science of a meter, a transformer, how a room reflects sound, how to build a pre-amp, how to fix electrical problems, what some of these recording techniques people talk about mean, why converters work the way they do, what truncates and why, 32 bit float, 64 bit mix engines...I'm clueless!
But ask me how to record something, how to polish a turd or make a mix sound 100% better....I'll tell ya that one every time. :)
-Danny