Incremental surface hole filling

Systems, methods, and computer storage mediums are provided for filling missing data in a spatially distributed, graphically represented data set. An example method includes dividing the data set into a first plurality of tiles along a first plurality of boundary lines. For each of the first plurality of tiles, a first set of fill data is generated to fill missing data in the data set. Then, for each of a determined number of dimensions of the tiles, the data set is divided into a new plurality of tiles along a new plurality of boundary lines offset from the last immediately determined plurality of boundary lines and a new set of fill data is generated to fill the missing data. A portion of the new set of fill data includes a portion of the last immediately generated set of fill data that fall along the boundary of the respective new tile.