Behavior recognition

A computer implemented method of identifying a behavior of objects detected in a video stream, comprising using one or more processors adapted for receiving a video stream comprising a plurality of frames captured by imaging sensor(s), applying a first set of trained classification functions for visually analyzing each of at least a subset of the frames to create a semantic attribute set for each object detected in each frame comprising an object probability score indicative of the object class probability, attribute probability score(s) indicative of probability of attribute(s) associated with the object and estimated location of the object, applying a second set of trained classification functions for semantically analyzing the attribute sets created for each object tracked in the subset to calculate a behavior probability score indicative of action(s) estimated to be conducted by each object and outputting an indication when the calculated behavior probability score complies with predefined rule(s).