System and method for generating three-dimensional image

The invention provides a system and a method for generating a three-dimensional image, comprising: capturing a group of color images of an object, the group of color images being related to color information of the object; generating a first point cloud according to at least one group of color images, wherein the first point cloud is related to a rigid surface and a non-rigid surface of the object; performing a screening operation on the first point cloud according to the group of color images to generate a second point cloud, wherein the correlation between the second point cloud and the rigid body surface is higher than the correlation between the second point cloud and the non-rigid body surface; selectively executing a matching operation by using the second point cloud and the target point cloud to obtain pose information; and combining the first point cloud to the target point cloud according to the pose information to update the target point cloud so as to generate a three-dimensional image of the objec