Pragi
The steinberg UR 22 is a good choice.
The in - out  latency is lower as of the focusrite scarlett series -

Thanks everyone!
 
Peter, I did check out the Steinberg's. They are certainly budget friendly but from what I read, there are no true Windows drivers available for their low end models anymore and even their website suggest using ASIO4All drivers. Is that what you are using?

Cactus Music
But be warned, you are not going to get true low latency performance from any interface under $500. You'll be in the "hidden buffer" zone with those. Best is going to be around 5-8ms RTL. Which might be fine for you. Below those RTL specs your looking at Motu, RME etc. 

Ya..I'm expecting that...I have a Babyface Pro, but there is no way it's getting out of my home studio...
But I was kind of hoping there was a (cheap) hidden gem out there that could bring me latency around 4-5ms as I'm not going to use tons on plugins/tracks....

At $!50 there really isn't a lot of good choices. 
The Scarletts, Tascam 2x2, Stienberg 22 and PreSonus? 
Not sure about this Zoom one but --https://www.sweetwater.com/store/detail/U24  
All will be in the same ballpark for RTL around 7ms, all will have same sound quality (objective) but then you do need to look at features because this is where they are different. In the price point the Tascam 2x2 has the best features in/out wse as well as both buss and wall wart power. 
 
Another option for you might be what I use which is a Tascam handy recorder. You can use it to record you guitar and vocals and dump it into Sonar. That's how a lot of my songs start. 
 Zoom makes porta studios that have drums and whatnot built in. Talk about portable.    https://www.sweetwater.com/store/detail/R8zoom  

For the same purpose you have described I have bought Ubisoft Rocksmith cable (c. $40). If you are not familiar with it is a simple USB cable on one side and guitar plug on the other, so it is a guitar directly into laptop. Sonar tracks see Rocksmith as a possible input. Turn your Sonar into Wasapi exclusive mode, monitor your project with your laptop speakers or headphones. Works well with TH3, you can set Wasapi to pretty low latency. If the project is modest you should be fine. My laptop is three years old (and specs were pretty average)  -   it handles well a project with drum synth, couple TH3 instances, reverb and few other plugins. Price and convenience - incredible.

Thanks Pawel.
I did see this cable while web searching, but wasn't sure if it was worth it.
I will definitely check it out.

Cactus Music
At $!50 there really isn't a lot of god choices. 
The Scarletts, Tascam 2x2, Stienberg 22 and PreSonus? 
Not sure about this Zoom one but --https://www.sweetwater.com/store/detail/U24  
All will be in the same ballpark for RTL around 7ms, all will have same sound quality (objective) but then you do need to look at features because this is where they are different. In the price point the Tascam 2x2 has the best features in/out wse as well as both buss and wall wart power. 
 
Another option for you might be what I use which is a Tascam handy recorder. You can use it to record you guitar and vocals and dump it into Sonar. That's how a lot of my songs start. 
 Zoom makes porta studios that have drums and whatnot built in. Talk about portable.    https://www.sweetwater.com/store/detail/R8zoom  

Thanks for all you suggestions, Johnny.
Basically, I really like TH3 and messing around with different amp tones really inspires my songwriting. That's the only purpose of buying a new interface for my laptop. Just need something small and stable enough to plug and play.
Guess I got spoiled with RME's latency, so maybe I'm putting my hopes a little to high..... 

slyman

... Guess I got spoiled with RME's latency, so maybe I'm putting my hopes a little to high..... 

I have seen people on this forum saying that they managed to get latency in Wasapi exclusive mode under 9ms (!).  I am quite happy with 12-14 ms and it is achievable with my old laptop and Rocksmith.

Afrodrum

slyman

... Guess I got spoiled with RME's latency, so maybe I'm putting my hopes a little to high..... 

I have seen people on this forum saying that they managed to get latency in Wasapi exclusive mode under 9ms (!).  I am quite happy with 12-14 ms and it is achievable with my old laptop and Rocksmith.

Thanks.
I'll see if any music stores around here have this in stock. 12-14 ms seems acceptable, but I would have to give it a try first.
 
 

12 ms would not work for me with guitar sims. We each have our tolerance for RTL latency and mine needs to be around 6 before I stop noticing it. 
You didn't mention wanting to work with amp sims as that really changes everything. I'm afraid that makes it tricky as you will need real good drivers and a CPU that can handle low buffer settings. 

Cactus Music
12 ms would not work for me with guitar sims. We each have our tolerance for RTL latency and mine needs to be around 6 before I stop noticing it. 
You didn't mention wanting to work with amp sims as that really changes everything. I'm afraid that makes it tricky as you will need real good drivers and a CPU that can handle low buffer settings. 

I did mention TH3 in my initial post. 
But I agree with you that at around 6-7 ms it starts to be distracting, to say the least......