Method and apparatus for controlling classification and classification switching in a vision system

A system for classifying image data includes a vision system (58) for continuously imaging an area (42) of interest and providing an image signals. A classifier (84) determines an image class corresponding to each image signal, determines a confidence level for each determined image class, determines a time period for the confidence level, and establishes an image classification in response thereto. Switching between image classifications is in response to the confidence level and time period of the confidence level. When used in a vehicle restraining system (20), other monitor vehicle parameters (54) can be used to adjust the confidence levels and time periods needed to switch between image classifications.