I have to say that USB mics have improved considerably over the years. They used to be cheap and, as mentioned, mostly designed for podcasting. However I picked up an Audio-Technica AT2020 USB mic a few years ago to take on the road for doing narration, and aside from being of great interest to the TSA when you have a cylindrical object in your luggage, it's been a really rugged mic that sounds like, well, the non-USB 2020. I also checked out an MXL 007 which is an inexpensive stereo condenser mic, and it performed much better than I expected.
However many of these are made to be class-compliant, which means they use non-specialized drivers. As a result there is latency, so if you want to monitor the mics, you'll want to use an interface's direct monitoring.
There's no
technical reason why USB mics can't sound good, but there are cost constraints - a company is not going to put a $100 A/D converter sub-system in a $200 mic. But as converters get better and cheaper, USB mics will follow suit.