Motion Compensation and Refinement in Recurrent Neural Networks

Provided is a method and system for tracking a motion of information in a spatial environment of a vehicle. Sensor-based data regarding the spatial environment is acquired for a plurality of timesteps, the sensor-based data defining the information in spatially resolved cells. For each of the timesteps, the sensor-based data is input into a recurrent neural network, RNN, having one or more internal memory states. For each of the timesteps, the internal states of the RNN are transformed by using a motion map describing a speed and/or a direction of motion of the information of the spatially resolved cells individually. For each of the plurality of timesteps, the transformed internal states are used in a processing of the RNN to track the motion of the information in the environment of the moving vehicle.