First check there are no HF radio transmitters in the near, such as mobile phones. To check that, connect the speaker to some other source (mp3 player for example).
It case the noise comes from computer, it is most likely an interference from motors. HDD/CD/cooler. I could never find out either it comes more throw "air" or throw power circuit. On some computers it is too loud, on some acceptable. But the only solution to completely eliminate it is to avoid build in / internal sound card.
But what you can in existing setup:
- Check that inputs are not mixed into output. So, in your software mixer switch off/pull down all volumes from all inputs (line input, mic, CD, etc..) Even when not delivering the signal, they deliver noise.
- In case you have front panel audio connectors, you can test without the wires connected to the sound card. These wires can work like antenna for interferences.
- With HDD/CD it is easy to check, just disconnect them (without HDD the system will not boot, but that is not important for the test). I DO NOT recommend disconnecting CPU cooler, even for short time !. But in case you have other (case) coolers, you can try to disconnect them. If you have other power supply, try it.