Remote control device and remote control method

A remote control device remotely controls a digital mirror apparatus. The remote control device includes: a three-dimensional rendering unit that generates first and second user images from first and second three-dimensional models; a first operation determination unit that determines whether or not the menu image overlaps with the second user image; a second operation determination unit that determines coordinates of a position specified by a user on a display screen based on an amount of the movement of the second user image in a direction perpendicular to the display screen; and an operation information outputting unit that outputs operation information corresponding to the menu image, when it is determined that the menu image overlaps with the second user image and when the determined coordinates are included within a display area of the menu image. The amount of the movement is calculated with reference to data in the depth buffer.