INTELLIGENT UNDERSTANDING SYSTEM FOR REAL-TIME RECONSTRUCTION OF LARGE-SCALE SCENE LIGHT FIELD

An intelligent understanding apparatus for real-time reconstruction of a large-scale scene light field includes the following. A data obtaining module obtains a 3D instance depth map, and obtain 3D voxels and voxel color information through simultaneous positioning and map generation. The model constructing module constructs and trains a real-time light field reconstruction network model using a ScanNet dataset. The real-time light field reconstruction network model extracts features of the 3D voxels and voxel color information, and obtain a semantic segmentation result and an instance segmentation result. The semantic segmentation module inputs the 3D voxel and voxel color information corresponding to the 3D instance depth map into the trained real-time light field reconstruction network model, and determine an output as a semantic segmentation result and an instance segmentation result corresponding to the 3D instance depth map.