Method and device for training text auditing model

The invention provides a method and device for training a text auditing model, and relates to the field of artificial intelligence, in particular to the field of natural language processing. According to the specific implementation scheme, the method comprises the steps of obtaining a pre-training language model, a pre-training language micro model, annotation data and non-annotation data; inputting the annotation data into a pre-training language model for supervised training to obtain a teacher model; inputting the annotation data into a pre-training language micro model for supervised training to obtain a student model; and respectively inputting the unlabeled data into the teacher model and the student model, and distilling the student model by using the teacher model to obtain a text auditing model. According to the embodiment, training can be carried out on small-scale manual annotation data and large-scale non-annotation data, and the text auditing model with a good effect and a high speed is obtained.