METHODS AND SYSTEMS TO CREATE A CONTROLLER IN AN AUGMENTED REALITY (AR) ENVIRONMENT USING ANY PHYSICAL OBJECT

A system detects one or more features of a physical object located in a real-world space based on images or video of the physical object captured by an image capture device, designates the physical object as a controller of the VR environment, and determines an orientation of the physical object in the real-world space based on the captured images or video without receiving control signals or communications from the physical object. The system generates, in the VR environment, a virtual object representative of the physical object based on the orientation and the one or more detected features of the physical object. The system detects a gesture associated with the physical object in the real-world space based on the captured images or video, and changes a position or orientation of the virtual object in the VR environment based on the detected gesture.