Image processing apparatus and image processing method for performing pixel alignment

An image processing apparatus is provided, which performs alignment of pixels on a reference frame and on a standard frame, executes an image reconfiguration based on an alignment result, and generates a high resolution image of a frame from low resolution images of the reference and the standard frames, the apparatus including a memory configured to store an input video and to output an image processed video; and a plurality of arithmetic processors configured to perform in parallel, at the time of the alignment, a first alignment processing in a first direction from the reference to the standard frame by a first arithmetic processor, and a second alignment processing in a second direction from the standard to the reference frame by a second arithmetic processor, the second direction being opposite to the first direction, processing results of the first and the second alignment processings being shared among the processors.