I'd sum up my view like this: higher sample rates are not a particularly
strong influencer of final perceived quality. Certainly, all analogue recordings ever made have lower bandwidth. Lower still once you whack them onto vinyl.
I'm not saying that a theoretical low quality of the final medium means it doesn't matter. I'm saying that what might seem, by the numbers, to be lower quality actually garners superb results.
44.1 was a well-chosen standard. The point of it was that it was
way higher than you'd ever actually need.
Back to my opening point. When setting out to record something, I'm concerned about the performances, the instruments, the amps, the sound of the room, the mics, the mic placement, in that order of importance. I'm not sure where sample rate comes in terms of priority, but it's probably not even right behind mic placement. Pres are probably more important, and in truth, pres aren't all that important, once you're at a given level of transparency.
Basically, I decided to stop worrying about it and get on with making records.