CAMERA CALIBRATION USING MEASURED MOTION

Intrinsic and extrinsic calibration parameters are determined in real time for a camera positioned to capture images of a surgical site in a body cavity. The camera is positioned on a manipulator arm and used to capture a plurality of frames of images of the surgical site using the at least one camera while moving the camera within the body cavity. 3D position information corresponding to positions of the camera is recorded during capture of said images. A plurality of features between two or more frames of the captured images are matched, and a 3D structure of the plurality of features is reconstructed using multi-frame triangulation. A penalty measure is estimated using a reprojection error. The distance in the image plane between the projected 3D feature and the measurement. Intrinsic calibration parameters are estimated for the at least one camera, and refined to minimize the penalty measure.