Multi-vision 2D-3D image non-rigid registration method and system based on mark points

The invention relates to the field of image processing, and particularly discloses a multi-vision 2D-3D image non-rigid registration method and system based on mark points, and the method comprises the steps: obtaining a two-dimensional DR image of a target pair play, and reconstructing a three-dimensional CT image of a target object to obtain N two-dimensional DRR images; respectively inputting each DR image and each DRR image into a neural network to obtain K two-dimensional mark point results of each image; and respectively inputting the DR image and the DRR image by adopting a neural network, and outputting K pairs of matching points. According to the method, a rigid registration transformation matrix is fitted by minimizing the sum of point distances of K pairs of matching points, then a non-rigid registration displacement field three-dimensional matrix is obtained by using the K pairs of matching points through an interpolation method based on control points, and finally the result is optimized in an it