IMO it often depends on whether you've read the book before seeing the movie or vice versa.
For example the typical routine of cutting down the number of characters for the film, or compiling one film character using material of several characters from the book, can be very disturbing both ways.