Method and system for monitoring manufacturing operations with computer vision for tasks performed by person

The present disclosure provides methods and systems for monitoring manufacturing operations with computer vision on tasks performed by a person. A method of monitoring an operation includes: acquiring data from a sensor, the data including an image of a workspace in which the operation is to be performed; identifying human operators and controlled elements within the workspace using the acquired images; determining whether the operation has been initiated based on a known activation trigger; estimating a pose of the human operator using the image; monitoring a state of the controlled element based on the acquired data; and determining whether an anomaly has occurred based on the estimated pose, the state of the controlled element, the duration of the operation, or a combination thereof. 本公开提供了"对人执行的任务用计算机视觉监测制造操作的方法和系统"。监测操作的方法包括：从传感器获取数据，所述数据包括将在其中执行所述操作的工作空间的图像；使用所获取的图像识别所述工作空间内的人类操作员和受控元件；基于已知的激活触发来确定所述操作是否已经启动；使用所述图像估计所述人类操作员的姿态；基于所获取的数据来监测所述受控元件的状态；以及基于所估计的姿态、所述受控元件的所述状态、所述操作的持续时间或其组合来确定是否发生了异常。