Semantic communication transmission method based on two modes of text and audio

The invention belongs to the technical field of semantic communication, and particularly relates to a semantic communication transmission method based on a text mode and an audio mode. According to the method, deep learning and semantic communication are combined, a deep learning network is constructed, and the deep learning network comprises a text semantic feature extraction module, an audio feature information extraction module and a speech synthesis module; the text description of the original voice signal is obtained through the text semantic feature extraction module; the audio feature information extraction module obtains audio information of the original voice signal, wherein the audio information comprises duration, pitch and power information; after the two kinds of data information are integrated, information source channel joint coding is carried out, and the information is sent to a receiver; the receiver obtains text description and voice information through decoding, and voice signals meeting r