True color infrared photography and video

A method beginning at is provided for creating high-fidelity visible coloring from infrared images of a scene under surveillance. The infrared images captured at are analyzed at to determine if an object, such as a face, is identifiable within the image. If an object is identifiable at the object features are compared to a plurality of stored object features at. If there is a match at, the color characteristics of the object are obtained at and the object is colored at based on the stored database feature information. If there is no match at or identifiable object at and object color cannot be identified at, the image is analyzed at to determine if a pattern, such as clothing, is identifiable within the image. If a pattern is identifiable at, the color characteristics of the pattern are obtained at and the pattern is colored at according to infrared reflectance characterization in conjunction with the stored pattern information. If no pattern is identifiable at, the non-pattern and non-feature containing portions of the image are colored at according to infrared reflectance characterization.