An Investigation of Image Fusion Algorithms using a Visual Performance-based Image Evaluation Methodology

It is believed that the fusion of multiple different images into a single image should be of great benefit to warfighters engaged in a search task. As such, more research has focused on the improvement of algorithms designed for image fusion. Many different fusion algorithms have already been developed; however, the majority of these algorithms have not been assessed in terms of their visual performance-enhancing effects using militarily relevant scenarios. The goal of this research is to apply a visual performance-based assessment methodology to assess four algorithms that are specifically designed for fusion of multispectral digital images. The image fusion algorithms used included a Principle Component Analysis based algorithm, a Shift-invariant Wavelet transform algorithm, a Contrast-based algorithm, and pixel averaging. The methodology used has been developed to acquire objective human visual performance data as a means of evaluating the image fusion algorithms. Standard objective performance metrics (response time and error rate), were used to compare the fused images vs. two baseline conditions comprising each individual image used in the fused test images. Observers searched images for a military target hidden among foliage and then indicated in which quadrant of the screen the target was located using a spatial-forced-choice paradigm. Response time and percent correct were measured for each observer.