Image processing apparatus, image processing method, program, and image processing system

There is provided an image processing apparatus including: an input image acquisition unit for obtaining an input image generated by taking an image of a real space; an image recognition unit for recognizing, when a first user-input representing a start of manipulation is detected, a manipulator used for manipulating a virtual object, wherein the manipulator appears in the input image; a calculation unit for calculating, according to a result of the recognition of the manipulator provided by the image recognition unit, a position on a screen of a display device at which the virtual object is to be displayed; a display control unit for displaying the virtual object at the position of the screen of the display device calculated by the calculation unit; and a communication unit for transmitting, when the first user-input is detected, a first notification signal for notifying the start of manipulation to another apparatus displaying the same virtual object.