^^^ Correct. "Polarity inversion" is the correct term to use when referring to microphone and speaker wiring, but "phase inversion" is the proper term for electronics and digital audio. That, btw, is why the the Greek letter phi (
ϕ), the electrical and mathematical symbol for phase, is also the near-universal icon for this switch on both hardware and software mixers.
The confusion, I think, stems from the way the switch has traditionally been used to correct improperly-wired microphone cables or to invert their signals (e.g. top and bottom snare mikes). In this case, we're using phase inversion to effectively implement polarity inversion.