Video filtering system

A method, system, and computer program product is disclosed for selective filtering of video and audio content. Incoming content (e.g., video content and/or audio content) is broken into segments that are individually, on a segment-by-segment basis, analyzed using user-defined criteria, referred to as "cues". Based on the quantity and weight of the cues in the segment, the segment is rated, i.e., given a score. If the score of a particular segment is above a predetermined threshold, the segment is stored for later use. If the segment is at or below the predetermined threshold, the segment is considered irrelevant or "uninteresting" relative to the user criteria, and the segment is discarded. Incoming content is buffered and, in parallel, a cue analysis is performed to break the content into segments and perform the rating process. In this manner, the streaming incoming content can be constantly monitored and analyzed and only the relevant/interesting segments are saved.