I just had to replace the CR2032 battery in my Korg X5 after 18 years. I bought it new, my how time flies.
I don't know if your keyboard has a holder. If not, and there's enough room, while you're in there, see if you can mount a holder for that CR2032 so you don't have to solder it. There's different kinds of CR2032's. Button type and ones with solder tabs.
In my experience, the newer CR2032 don't last nearly as long as the ones made 15 ~ 20 years ago.
My Korg X5 was surface mount, but I made room for a holder. I anticipate having to replace the battery every couple of years now.
Mine did all kinds of funky things, changing the battery fixed it. I also Super Glued a broken key while I had it apart that had been bugging me for years.
Good luck!