There are a few reasons this can occur:

1) Internet Explorer High Memory Usage
Below is the default value for caching viewer content for records in the item list grid. This setting is located in "C:\Program Files\Accessdata\Map\Web.config", and affects all users.
You can lower this setting all the way to '0' which turns off caching completely. The '3' means your end users are caching 4 total documents as they move forward in linear review, i.e. it will always be cached 3 ahead. So if your users jump around the grid, lower this option to reduce memory consumption on Internet explorer.
Note: This solution has also been shown to work in preventing, or greatly reducing, an intermittent notification to install Adobe Flash that can occur with the "Standard viewer" mode of the viewer.

2) Loading Large Native into Alternate Viewer
Another value that affects end user experience is the native viewer max which you would adjust down to prevent large files from even attempting to load into the Alternate Viewer. By default it is on 50 MB.
Error Message: The current document’s file size is larger than the current settings allow to display.

If you have a specific format that causes the Alternate Viewer issue, you can add the extension.

3) Corrupt Browser Cache Content
Lastly if you never have cleared your Internet Explorer cache, especially after an upgrade, please use the following script. This would be done on each workstation.

@echo off

ECHO Clearing IE cache...
RunDll32.exe InetCpl.cpl,ClearMyTracksByProcess 9
RunDll32.exe InetCpl.cpl,ClearMyTracksByProcess 2
ECHO Job complete