Saliency from hierarchical adaptation through decorrelation and variance normalization

This paper presents a novel approach to visual saliency that relies on a contextually adapted representation produced through adaptive whitening of color and scale features. Unlike previous models, the proposal is grounded on the specific adaptation of the basis of low level features to the statisti...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Image and vision computing 2012-01, Vol.30 (1), p.51-64
Hauptverfasser: Garcia-Diaz, Antón, Fdez-Vidal, Xosé R., Pardo, Xosé M., Dosil, Raquel
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:This paper presents a novel approach to visual saliency that relies on a contextually adapted representation produced through adaptive whitening of color and scale features. Unlike previous models, the proposal is grounded on the specific adaptation of the basis of low level features to the statistical structure of the image. Adaptation is achieved through decorrelation and contrast normalization in several steps in a hierarchical approach, in compliance with coarse features described in biological visual systems. Saliency is simply computed as the square of the vector norm in the resulting representation. The performance of the model is compared with several state-of-the-art approaches, in predicting human fixations using three different eye-tracking datasets. Referring this measure to the performance of human priority maps, the model proves to be the only one able to keep the same behavior through different datasets, showing free of biases. Moreover, it is able to predict a wide set of relevant psychophysical observations, to our knowledge, not reproduced together by any other model before. ► Novel model of saliency based on the contextual adaptation of low level features. ► Outperforms existing models in predicting fixations, in both performance and robustness. ► Comparison with single subject priority performance reveals strong design biases in other models. ► Improved capability of reproducing psychophysical results.
ISSN:0262-8856
1872-8138
DOI:10.1016/j.imavis.2011.11.007