Pair comparison based progressive subjective quality ranking for underwater images

Underwater images contain an interacting mixture of distortions due to the physicochemical properties of the water, suspended organic matter and floating particles in water. Unlike images in traditional natural image quality databases, underwater images are often difficult to acquire with reference images and sets of images with gradient distortion. Therefore, it is even more difficult for the viewers to assign an absolute psychophysical scale to the quality of underwater images. In this paper, we propose a pairwise subjective comparison procedure for underwater images quality ranking inspired by the intuitive suppression and competence mechanisms in visual perception. In the proposed method, we construct a preselection based initial image quality dataset by full pairwise comparison, which also enables online adaptive new image updating. The proposed method is not constrained by the lack of reference images, and is reliable and sensitive to images with discriminable distortion level and various image contents. The proposed pairwise comparison further allows an uncertain choice, which does not require a reinforce human opinion. To the best of our knowledge, this is the first implementation for underwater image subjective quality ranking, and a new approach to the image quality ranking for different image contents with unknown distortion level. We demonstrate that the obtained subjective image ranking correlates well with the human perception of quality difference among the underwater images than that of the single stimuli image quality assessment with finite labor burden. Moreover, our proposed method accurately characterize the gradual degradation in the underwater image sequence taken in controlled conditions. The proposed progressive learning ranking is also an alternative way to realize adaptive extension of the existing image quality databases. •The first trial for subjective quality ranking of underwater image.•An objective image quality prescreening is incorporated in the ranking methods.•The pairwise sorting is formulated as a three-choice judgment.•The laboratory evaluation and online voting is combined.•The proposed method is a reliable way to rank all underwater images in the corpus.