Multi-label inspection work order problem traceability identification method and device

The invention discloses a multi-label inspection work order problem traceability identification method and device, and aims to construct a pre-training language model more suitable for the power industry, identify and lock common causes of problems occurring in massive power inspection work orders from a professional dimension, and solve the problems that risks exist in inspection services and problems are difficult to deeply identify and analyze. In the construction process of the pre-training language model, not only is an unstructured text selected as a corpus, but also industry-specific vocabularies and specific phrases should be added to enhance the'specialty 'of the pre-training language model. Based on a word list file generated by large-scale electric power corpus training, an electric power inspection industry unstructured text, industry special vocabularies and special phrases are selected as corpora, a pre-training model with a 'professional' enhancement effect is obtained through training, and the