Surface computer system and method for integrating display of user interface with physical objects

Systems and methods for assisting user interaction with physical objects. A system may include an interactive display surface configured to display visual output and receive a physical object, where the object possesses encoded data including data other than data directly identifying the object. The system may include a computer-readable storage medium storing program instructions executable by the surface computer to implement software applications. In response to the display surface receiving the object, the surface computer may be configured to read the encoded data passively with respect to the object, without using an active electronic interface between the surface computer and the object, and to display a user interface for software applications dependent upon the passively read encoded data, such that one or more elements of the user interface are visually associated on the interactive display surface with the physical object.