Method of processing and operating video surveillance system

A method to calculate a transform coordinate on a second video of an object having an target coordinate on a first video and related operation process and video surveillance system are disclosed. The method includes the steps of generating the first video with a first video surveillance device, generating the second video with a second video surveillance device, selecting a first predetermined number of first reference objects also existing on the second video from the first video, calculating a plurality of coordinate transform coefficients of a first coordinate transform function according to the first predetermined number of first coordinates where the first reference objects are on the first video and the first predetermined number of second coordinates where the first reference objects are on the second video, and substituting the target coordinate into the first coordinate transform function, which had the first coordinate transform coefficients, and calculating the transform coordinate.