System and method for evaluating predictive video decoders

Embodiments can include the steps of 1) predicting a test frame or region from a plain frame or region, such as a gray frame or region, using the compressions tools, or features under test, that are to be tested by a test bitstream, and 2) predicting from the test frame or region a plain (such as gray) frame or region. The method can include 3) using the previously produced plain frame to predict a test frame or region using the compressions tools, or features under test, that are to be tested by a test bitstream. This prediction scheme can be identical to the previously used prediction scheme. Thus, the same error will be repeatedly produced in the decoder and, thus, the total error magnitude will be amplified. In some embodiments steps 2 and 3 can be repeated to amplify the errors further.