Picture selection for video skimming

Some embodiments of the invention provide a video preview generator that quickly generates preview displays of different parts of a video. The preview generator includes a skimming tool and a picture generator. The skimming tool is moveable across a representation of a video clip in order to identify different video pictures within the video clip. As the skimming tool moves across the video clip representation, the picture generator identifies and displays different video pictures for different positions of the skimming tool on the video clip. For at least some of the positions of the skimming tool, the picture generator presents a video picture that is not at the location identified by the skimming tool, but rather is at a nearby location and is easier to present in the preview than the video picture at the identified location.