A Web-based semantic tagging and activity recognition system for species' accelerometry data

Increasingly, animal biologists are taking advantage of low cost micro-sensor technology, by deploying accelerometers to monitor the behavior and movement of a broad range of species. The result is an avalanche of complex tri-axial accelerometer data streams that capture observations and measurements of a wide range of animal body motion and posture parameters. Analysis of these parameters enables the identification of specific animal behaviors—however the analysis process is immature with much of the activity identification steps undertaken manually and subjectively. Consequently, there is an urgent need for the development of new tools to streamline the management, analysis, indexing, querying and visualization of such data. In this paper, we present a Semantic Annotation and Activity Recognition (SAAR) system which supports storing, visualizing, annotating and automatic recognition of tri-axial accelerometer data streams by integrating semantic annotation and visualization services with Support Vector Machine (SVM) techniques. The interactive Web interface enables biologists to visualize and correlate 3D accelerometer data streams with associated video streams. It also enables domain experts to accurately annotate or tag segments of tri-axial accelerometer data streams, with standardized terms from an activity ontology. These annotated data streams can then be used to dynamically train a hierarchical SVM activity classification model, which can be applied to new accelerometer data streams to automatically recognize specific activities. This paper describes the design, implementation and functional details of the SAAR system and the results of the evaluation experiments that assess the performance, usability and efficiency of the system. The evaluation results indicate that the SAAR system enables ecologists with little knowledge of machine learning techniques to collaboratively build classification models with high levels of accuracy, sensitivity, precision and specificity. ► A Web repository for storing, sharing and querying animal accelerometry data sets ► An interoperable data management, analysis and visualization platform ► Web services that enable ontology-based tagging of 3D accelerometry data sets. ► Support Vector Machine (SVM)-based activity recognition for accelerometry data ► Statistical analysis and graphical reporting tools for animal accelerometry data