Framework for machine guidance

PATENT APPLICATION ATTORNEY DOCKET NO. 37202/949001; 2212467US A method includes receiving a data stream comprising content generated by an application executing on a user device. The data stream is received from a guidance service that is separate from the application. The data stream is processed using a set of machine learning models to identify a first set of artifacts within the content. A first state of the application is identified based on the first set of artifacts. First transition data is identified in a logic flow of the application. The first transition data corresponds to transitioning from the first state to a second state of the application. Based on the first transition data, first guidance data is generated that describes user input for transitioning the application from the first state to the second state. The first guidance data is sent to the user device, where it is separately presented from the application by the guidance service.