Processing framework, data processing method and device and computer storage medium

The invention discloses a multi-modal processing framework, a data processing method, a data processing device and a computer storage medium. The processing framework comprises a data source, an operator and a data sink, the data source is used for acquiring initial data based on different transmission protocols and sending the initial data to the operator, the initial data comprises multi-modal data and structured data, and the data source corresponds to the initial data of one data type; the operator is used for processing the initial data; and the data sink is used for receiving and outputting the data processed by the operator. By using the processing framework, the structured data and the multi-modal data can be acquired, analyzed, processed and the like at the same time, and a large amount of time and labor cost are not required to be input to process the data of different modals respectively, so that real-time processing and fusion analysis calculation of the multi-modal data are realized; the difficul