Data processing method and device suitable for military action big data

The invention provides a data processing method and device suitable for military action big data, and the method comprises the steps: accessing multi-source heterogeneous data facing the military action big data in real time, the multi-source heterogeneous data comprising data of multiple sources and different structures; caching the multi-source heterogeneous data by adopting message middleware with an extensible framework, wherein the message middleware comprises Kafka; designing a data stream according to a processing mode corresponding to the multi-source heterogeneous data, and reading the data from the message-oriented middleware according to the data stream; and a distributed data processing engine is adopted to preprocess the read data so as to realize data integration. According to the method and the device, the cluster capacity of the Kafka can be transversely expanded by simply increasing the nodes, the data is persisted to the hard disk through the Kafka, the data is prevented from being lost, in