No no, there's a way!
You have to switch Track, Bus and Clips to Absolute Time from Musical Time on order to preserve clip locations and envelope information.
On the track inspector, check the Clip and Track tabs for the
TIME BASE setting.
Tracks have to be set one at a time, but you can ctrl+a to select all clips and then ctrl+click the Time Base to Absolute.
Next, open the Markers View and double click your markers and check the Absolute Time checkbox.
Click select all + the lock icon in the Markers view to change this setting for all at once.
Now, you should be able to change tempos with impunity, but remember ctrl+z if it doesn't go your way the first time. Also, view lots of the project in track view when you make the change so you can tell if it goes wrong.