Feasibility study for the implementation of an automatic system for the detection of social interactions in the waiting area of automatic milking stations by using a video surveillance system

•Monitoring of social interactions by use of image segmentation and tracking methods.•Three cameras with top-down view were used for recordings and observations.•The social interactions were identified based on collision of geometrical shapes.•The overall performance of the detector in its early stage is 85.1%. A well-planned waiting area is crucial for automatic milking systems. In an enclosed waiting area, cows of different rank compete for entering the milking station and they are exposed for a variety of social interactions. Such interactions could increase standing time and delay milking, which may result in stress, lameness, impaired welfare and reduced performance. The aim was to monitor the waiting area in a free stall dairy by the use of three video cameras to detect occurrence of social interactions by using improved image segmentation and tracking methods. The surveillance system observed 252 cows having free access to any of four milking stations during 24h over a period of two weeks. A two-step pattern recognition approach was used. In the first step geometric features (distances) were extracted from every pair of cows in every frame. These features form the input of the second step. It consists of a classifier of the behaviour of the cows. A support vector machine was used to realise this classifier. The social interactions were identified based on collision of geometrical shapes segmented from the image and positively identified as cows by experienced observers. The results showed that the proposed system was capable of a fairly accurate detection of social interactions.