System and method for labeling a collection of images

Various embodiments of a system and methods for labeling images are described. An image labeling system may receive multiple images. A subset of the images may be labeled to identify image content or elements, such as faces. The system may display some of the labeled image elements in different portions of a display area. Unlabeled image elements may be displayed in the same display area. The display size and position of each unlabeled image element may be dependent on similarities between the unlabeled image element and the displayed, labeled image elements. The system may receive input which indicates that one or more of the displayed, unlabeled image elements should receive the same label as one of the displayed, labeled image elements. Similarities between image elements may be re-analyzed, dependent on the assigned labels, and the display of unlabeled images may be updated.