I would have said maybe hard drive failing, but you already swapped that out. And clean installed Windows, so that is ruled out.
First unplug all external cables and devices except for monitor, keyboard, mouse, power. If you have any PCI or PCIe card installed other than GPU, pull them.
So that would leave these possibilities (in no particular order):
Power supply (try swapping in a spare).
RAM (if you have more than one stick, run with one at a time to eliminate that).
Check that all fans are running well, especially the CPU cooler.
Graphic card (try a spare, if available, since no integrated video to test with)
Reseat the CPU heat sink with new thermal compound. If that seat is loose, the CPU could be overheating.
Motherboard (sometimes it is just an age thing, capacitors wear out and start bulging and leaking). This is probably the last resort, but if all else is OK, options are getting low.