Multi-view and multi-mode fused regional monitoring detection method and system

The invention provides a multi-view multi-modal fusion factory monitoring detection method and system. The method comprises the following steps: acquiring point cloud information at the same moment and picture information at different acquisition positions; performing feature extraction on the obtained point cloud information to obtain point cloud features; performing feature extraction on the picture information to obtain multiple groups of picture features; performing internal and external parameter matrix rotation on the point cloud feature and each picture feature, introducing an attention mechanism to enhance spatial relevance of each feature after rotation, performing rotation alignment on voxel features corresponding to the same feature point, and performing cascade connection; and performing target detection on the cascaded features by using the target detection network model to obtain a detection result. According to the invention, two kinds of sensors, namely the cameras with different visual angles