Operation management system utilizing a wearable device

An operation management system is disclosed. The operation management system may receive a video stream from a wearable device of a user that is performing an operation in a physical environment. The operation management system may process, using an operation performance model, a set of frames of the video stream that indicates a state of a performance of the operation by the user. The operation management system may determine, based on the state of the performance by the user, a next task of the operation. The operation management system may configure display data that is associated with a physical object that is associated with the next task. The display data may be associated with an indicator that identifies the physical object and/or task information associated with performing the next task. The operation management system may provide the display data to the wearable device.