Performance evaluation of an occupant metabolic rate estimation algorithm using activity classification and object detection models

To create a comfortable indoor environment, the metabolic rate (MET), which affects the thermal sensation of occupants, needs to be reflected in real-time. Recently, methods employing computer vision techniques classify activities based on the pose of the body in images. However, these methods face challenges in determining the MET depending on the objects used, even with the same pose. Therefore, the objective of this study is to develop a MET estimation algorithm that can estimate various METs by integrating a pose-based activity classification model and an object detection model. To achieve this, an object detection model capable of detecting and classifying six regularly used objects indoors was developed, and a performance evaluation was conducted. The MET estimation algorithm was assessed through the implementation of a thermal control system, validating its applicability in experimental settings. As a result, the object detection model exhibited a real-time classification accuracy of 89%. Additionally, when evaluating the mode value over 15-s intervals, it demonstrated a classification accuracy of 100%. The algorithm exhibited a real-time estimation accuracy of 83% for the six METs and examining the mode value for 15-s intervals, it demonstrated a classification accuracy of 99%. This study thus confirmed the control capability of the proposed MET estimation algorithm and its potential for the estimation of various METs. The developed method can be used for the real-time estimation of occupant thermal comfort in indoor comfort-based control systems, contributing to the realization of a comfortable environment for occupants that protects their well-being. •An algorithm for estimating the real-time metabolic rate (MET) was developed.•The algorithm estimates MET using activity classification and object detection.•The usability of the algorithm for building control was experimentally evaluated.•The proposed algorithm can estimate more diverse METs than conventional methods.