I'd run Latency Monitor to make sure you don't have some background processes running.
Clicks and pops are usually related to things like Wi Fi or background processes taking over CPU and interupting. THey can also be from setting your buffer too low for the system to handle.