A METHOD FOR MULTI-MODAL SENSOR FUSION USING OBJECT TRAJECTORIES FOR CROSS-DOMAIN CORRESPONDENCE

A system for computing correspondence between multiple sensor observations, comprising: an interface for receiving first spatiotemporal datasets and second spatiotemporal datasets of a plurality of moving objects, based on signals originating from a first sensor and a second sensor capturing different types of signal; processing circuitry, configured to: generating a plurality of first spatiotemporal object trajectories and a plurality of second spatiotemporal object trajectories based on the first spatiotemporal datasets and the second spatiotemporal datasets respectively; computing a distance metric between the first and second spatiotemporal object trajectories, by a respective mapping from a respective domain into a predetermined domain; executing a matching computation between the mappings of the plurality of first and second spatiotemporal object trajectories by employing a distance metric in order to calculate a similarity between each pair of mappings of first and second spatiotemporal object trajectories, and outputting an outcome of the matching computation.