Systems and methods for improving visual search using summarization feature

Systems that search databases of videos or images to identify similar products in a given video or image of a product are disclosed. The content of the given video is represented by a feature vector used to measure the given video's similarity to either a video or an image. When the system is deployed to recognize particular fashion items in videos, some such videos are taken in uncontrolled settings, and as a result, may have low resolution, poor contrast, minimal focus, motion blur, or low lighting. By recognizing and removing poor quality video frames from the image recognition pipeline, associating products across video frames to form tracklets of each product, and enriching the feature representation of each item for best retrieval result by fusing information from multiple video frames depicting the item, the system addresses the aforementioned shortcomings.