METHOD FOR GENERATING USER INTERFACE FORM

PROBLEM TO BE SOLVED: To use an arbitrary document as the base of a user interface by comparing a first document picture with a second document picture and automatically extracting the set of pixels showing a mark from the first document picture. SOLUTION: The picture of a document instance 51 which is marked at first is obtained and stored in a computer. When a processor can be used, an index 51 is added by using the picture and it is sent to the collection 520 of the stored document. A corresponding stored reference document 521 is retrieved among them. Information on the active element 540 of the retrieved document picture 521 is obtained and it can be used in the processor. The processor extracts the mark of the reference base 520 and the mark 550 of the user is extracted from the marked document instance 510 so as to interpret 560 it. A processing which the user requests is decided in response to it. Then, the processor executes an operation 570 shown by interpretation 560.