System, method and computer program product for recognizing a state of a remote application

A system, method, and computer program product are provided for recognizing a state based on a current output. Current output is retrieved from a remote application utilizing a network, the current output corresponding to a state of the remote application. An output structure description of the remote state is generated. The output structure definition is compared to a pre-defined state definition of a recorded state for determining whether the state of the remote application corresponds to the recorded state. A system, method, and computer program product are also provided for recognizing a remote state utilizing individual document recognition. First, a plurality of documents are received. An attempt to recognize each of the documents as being associated with a predetermined state is made. A state is identified based on the recognition of the documents.