Image-based rendering and editing method and apparatus

A method and apparatus removing redundant data of a simple texture model, using an extended depth image, and an image-based editing method and apparatus. The method involves calculating normal vectors of pixels projected into a three-dimensional (3D) space by using depth images among a plurality of simple texture images, the plurality of simple texture images rendering different aspects of a 3D model; calculating reliabilities of the pixels of each of the simple texture images by using the calculated normal vectors; and comparing the reliabilities of the pixels that originate from different simple texture images but render the same portion of the 3D model and removing the pixels having low reliabilities from the different simple texture images from which they respectively originate.