Video registration system and method based on joint matching framework

According to the video registration system and method based on the joint matching framework, multi-scale multi-view multi-temporal video registration and real-time video and geographic scene accurate registration can be efficiently realized, the matching accuracy is practically ensured, and the robustness, the anti-rotation capability, the anti-scale capability and the processing efficiency are improved. A video registration system includes: a preprocessing unit; the matching model construction part is used for constructing a deep learning matching model and taking the remote sensing base map and the first video sequence frame as model input; comprising a feature extraction module, a coding module, a rough matching module and a fine matching module. The anti-scale and anti-rotation module construction part is used for providing anti-scale and anti-rotation processing for the deep learning matching model to obtain a correct matching point set; comprising an anti-scale and anti-rotation module; and the transfor