I have 2 controllers and 1 USB-connected cheap keyboard. They are an Axiom-Pro 61, an M-Audio Keystation 88, and a Yamaha YPG-235.
I only have the Yamaha because it has local sounds, and when I gig, I always want to have one of my on-stage boards have local sounds, in case the computer rig goes belly up in the middle of a set. (has happened on more than one occasion - we always keep a full set of tunes available that require nothing more than the local sounds on that keyboard, which then gives me time to fix the issues in between sets).
To be quite honest, the Yamaha keyboard only cost something like $239 brand new, and it has about 400 local sounds on it - passable piano, good electronic piano, and piano/strings, as well as Clavinet, strings, brass, etc... which for many stock cover tunes covers them quite well.
I never use the advanced features of the Axiom-Pro 61, but it is built like a tank, and that is why I use that live.
The Keystation 88 has almost no useful controller functionality, but does have 88 keys, which for the super small number of songs that need it, allows me to cover them whenever I feel like it. I really bought it not for the extra keys, but because I was able to get it brand new for $119, and for a controller with that many keys, that was a no-brainer.
Whatever you buy, buy for it meeting whatever real-world situations you will be in with it, and make sure that you can cover your needs with whatever you are likely to pick up. Most of the controller functionality present on my $500 controller is NEVER going to be used outside of a studio, so why dump a bunch of money into those features if you are just looking for something to use live.
Ultimately - I recommend you buy what you need to fill the requirements you are most likely to have for such a device, and save your money for other items - like new cables, better mics, etc...
Bob Bone