SYSTEMS AND METHODS FOR CONCURRENT DEPTH REPRESENTATION AND INPAINTING OF IMAGES

A method includes receiving an image from an image capture device, determining a mask for the image, and determining a depth representation including a pixelwise depth estimation for a scene represented by the image. A respective inpainting region in the mask includes pixels that represent two or more features of the scene. The two or more features have different depth estimates in the depth representation, and a respective feature of the two or more features overlaps with the non-inpainting region. The method includes refining the respective inpainting region based on (i) the two or more features having different depth estimates, and (ii) the respective feature of the two or more features overlapping with the non-inpainting region, and inpainting the image in accordance with refining the respective inpainting region such that the portion of the respective feature that overlaps with the non-inpainting region is not inpainted.