Area-based computation of stereo disparity with model-based window size selection

In direct area-based stereo problems occur if there is a significant local deformation between the two images, and at borders of objects. We propose a correlation method with affine deformable windows in which an optimal window size is selected using model-based reasoning. Two criteria for the window size selection are studied and the resulting algorithms are applied to a random dot pair, an autostereogram and Hoff's fruit pair. The results are found to be both accurate and robust.