ROBOT PLAN ONLINE ADJUSTMENT

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for robot plan online adjustment. A method includes receiving an initial plan for performing a particular task with a robot having a sensor. The initial plan defines an initial path having a plurality of waypoints and a footprint space for performing the particular task. The method includes receiving a sensor input from the sensor, and determining from the sensor input that the initial plan requires modification to complete the particular task. The method includes evaluating a plurality of alternative paths, including rejecting one or more alternative paths having any alternative waypoints that are outside the footprint space defined by the initial plan. The method includes selecting an alternative path having alternative waypoints that are all within the footprint space defined by the initial plan. The method includes following, by the robot, the alternative path.