A Syntactic Two-Component Encoding Model for the Trajectories of Human Actions

Human actions have been widely studied for their potential application in various areas such as sports, pervasive patient monitoring, and rehabilitation. However, challenges still persist pertaining to determining the most useful ways to describe human actions at the sensor, then limb and complete action levels of representation and deriving important relations between these levels each involving their own atomic components. In this paper, we report on a motion encoder developed for the sensor level based on the need to distinguish between the shape of the sensor's trajectory and its temporal characteristics during execution. This distinction is critical as it provides a different encoding scheme than the usual velocity and acceleration measures which confound these two attributes of any motion. At the same time, we eliminate noise from sensors by comparing temporal and spatial indexing schemes and a number of optimal filtering models for robust encoding. Results demonstrate the benefits of spatial indexing and separating the shape and dynamics of a motion, as well as its ability to decompose complex motions into several atomic ones. Finally, we discuss how this specific type of sensor encoder bears on the derivation of limb and complete action descriptions.