Tablet interface for direct vision teleoperation of an excavator for urban construction work

In recent years, worker shortages in the field of urban construction are looming as an important issue. To address this difficulty, direct-vision remote control of a construction machine can be an effective solution by which a worker can play not only the role of an operator but also play the role of a manual laborer.This study examines a new direct-vision remote control system for an excavator using a tablet device. To realize an intuitive interface, we propose the following graphical user interfaces (GUI) of two kinds: input bucket velocity using virtual joysticks, and input bucket position by dragging a bucket. We conducted a usability evaluation experiment simulating a horizontal digging operation. Operability of the GUIs were compared with that of a GUI resembling the conventional International Organization for Standardization (ISO) teleoperation interface. The experimental result concludes that proposed two GUIs superior to the conventional interface in task execution time, accuracy, and subjective usability evaluation. •Novel GUIs for direct vision teleoperation of an excavator were developed.•A user can control an excavator using a lightweight, small, and portable tablet PC.•Operability of the GUIs was evaluated using an actual remodeled mini-shovel.•Two newly developed GUIs enable unskilled operators to operate intuitively.