Macroblock grouping in a destination video frame to improve video reconstruction performance

A method of video reconstruction includes providing a hardware accelerator to a video processing component of a video processing system, and a driver for the video processing component. In addition, the method includes segmenting macroblocks of a destination video frame in a raster order into groups based on reference parameters thereof using the driver, where the reference parameters define compensation needs of macroblocks of the destination frame. The method also includes constructing an indexed array of linked-lists using the driver, with each linked-list representing macroblocks of a group having the same reference parameters. The hardware accelerator may be programmed to accelerate motion compensation by reconstructing macroblocks of the destination frame group-wise in the indexed order of the array of linked-lists.