Processing a Texture Atlas Using Manifold Neighbors

Systems and methods for processing textures to be applied to surface of a three-dimensional model, such as a three-dimensional model of a geographic area, are provided. According to aspects of the present disclosure, a two-dimensional image processing operation can be performed in the two-dimensional texture atlas space defined by a texture atlas using manifold neighborhoods defined for pixels in the texture atlas. The manifold neighborhood for a pixel can be the set of texture atlas pixels whose corresponding position on the surface of the three-dimensional model lies within a threshold distance of the surface position corresponding to the pixel in the three-dimensional model. The two-dimensional image processing operations can be performed using the set of texture atlas pixels in the manifold neighborhood.