Big data transmission method across public security boundaries based on database physical logs

The invention discloses a big data transmission method across public security boundaries based on database physical logs. The big data transmission method includes the following steps of oplog importtime confirmation, oplog file compression, oplog file scanning and uploading and oplog file downloading and storing. The big data transmission method has the beneficial effects that firstly, accordingto the big data transmission method, the MongoDB physical log is analyzed manually, and the newly added physical log of the MongoDB cluster is read every few minutes according to the time offset; multiple times of delivery of the same data is realized for the condition that the data are possibly lost; secondly, according to the big data transmission method disclosed by the invention, a buffer strip is designed, so that when the physical log reaches the limit, the physical log can be automatically exported to the specified buffer strip, and all data are efficiently imported into a public security intranet from the buff