I know there are strong opinions on MAC vs PC, but lets say for the sake of argument I'm opting for a PC setup.
What should I be looking for in terms of hardware that gives me minimum latency and maximum performance.
As I'm at home and don't perform anywhere with my kit, I am assuming desktop gives me more bang for the buck compared to laptop(?)

Here's my thinking so far:
A Dell desktop Quad core i7 processor
A decent graphics card
1 TB internal SSD
16GB RAM
Now, for the sound card, interface, I am not sure

Appreciate any input...

MACs are expensive PCs from the hardware perspective, but honestly Linux. But not really great support for it so moving on...

First thing to ask is whether you want an internal PCI interface which will probably be great for performance, or external for max flexibility.. Decide what bus you are wanting to opt for. From there you can narrow down your interfaces...

In my opinion, the audio interface that you pick will be the determining factor, considering the computer specs that you mentioned.   Having a solid interface and more importantly, solid drivers, will go a far way in determining the stability of whatever computer you decide on.
 
My suggestions for PC would be:
 
RME UC or UCX (Really solid hardware and drivers)
UAD Twin USB3 (New, supposedly shipping this month.  Can't wait to order one.) 
Presonus Studio 192 USB3 (Looks good on paper)
 
 

3 drives will be a better option. E.g. System drive (SSD 256GB is sufficient), Samples (audio content) drive (Hybrid 1-2GB is a good choice), Music Projects drive (1-2GB hybrid or regular HDD 7200rpm). From my experience this setup gives me the best performance despite outdated CPU. YMMV.
Focusrite Scarlett serves well as an audio interface. I bet there will be plenty recommendations on audio card, though.   

Rock solid audio interface?
RME or MOTU

When I last checked a PCI card always gave slightly better latency than USB/Firewire, so I'd look there. Also, I'd suggest going with one of the guys who specialize in audio PC's rather than a Dell...http://www.studiocat.com or http://www.adkproaudio.com come to mind. They're both forum members and good folks to work with.
 
Dean

Dell is fine I have one. HP Z workstations is what I would consider nowadays.

 RME, Lynx are two that still have products using the PCI bus.

I am very happy with my RME Ucx. Stable, and low RTL.
Best of luck.

I think your specs with Windows 10 will be a good system -  but consider the throughput of the entire system is important when you use terms like minimum and maximum.  i7 is meaningful, but theres a fairly large spread between low cost i7 and the fastest i7 CPU.  Same goes for RAM - theres a very wide spectrum for throughput, and latency. We don't know your track count for recording at the same time, nor your track count when mixing, or what other VST tools you might want to be using.  What are you trying to accomplish?
 
I agree with gustabo - the latest MOTU AVB line is rock solid - and a disclaimer of sorts - in my application.  I record with multiple MOTU's.  I decided that I would try using the entire home as the recording office for a while - and AVB makes this possible for me with my CAT5 home infrastructure.   Drums sound particularly good, recorded in my living room. This part of the hardware is equally important when in comes to those two words, minimum and maximum.  Latency is not an issue for performance monitoring when you let this part of the hardware do the heavy lifting. While I do not know about Apollo and RME or others that folks give accolades towards, I can't imagine that they don't have queue monitoring or unit linking in spades.  
 
Best regards,
 
Lance