I have a plugin that advises a much lower processing latency at high sample rates.
A high sample rate indeed creates bigger files, but if they therefore will have also have high latency I'm not sure.
Maybe a computer will just need more time and power to create a high sample rate file and indeed a huge project with many tracks / effects etc and a not superstrong computer is likely gonna crash.