Not a bad idea - maybe just high/low latency mode is enough, and these configurable in preferences.
Does all drivers have these buffers like ASIO - I'm not so sure of that - it may not be available always.
And some only through each drivers own panel - some firewire I tested did that.
But if any options to freeze etc, I would like that to be configurable.
It contradicts a bit the purpose - switching to high latency mode will let you run more synths in realtime - so less need for a freeze.
And mixing phase may also incorporate writing automation in realtime - and then you want short latency - to make it respond immediately on what you do.
Tracking is normally activated with the PDC button in control bar, letting armed tracks bypass pdc for monitoring.
Cubase got this ASIO Guard that has a similar purpose - latency is added unless rec-armed and configurated plugins say they are affected by ASIO Guard or not. You can set and forget kind of - nothing armed, higher latency.