Automatic keyword extraction method and device based on rules and TF-IDF

The invention relates to an automatic keyword extraction method and device based on rules and TF-IDF, and the method comprises the following steps: carrying out the standardized conversion of a file format of a to-be-processed file, and obtaining a standardized file; reading the content of the stand...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: HUANG ZIYANG, SHEN HAILUN, FENG FAN, CAI XIAOBO, GU FENGBO, PENG QIAOJUAN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention relates to an automatic keyword extraction method and device based on rules and TF-IDF, and the method comprises the following steps: carrying out the standardized conversion of a file format of a to-be-processed file, and obtaining a standardized file; reading the content of the standardized file, and performing part-of-speech tagging on the read words based on a pre-constructed white list; filtering the read words based on a part-of-speech tagging result and a pre-constructed blacklist to obtain first candidate keywords; set candidate keywords of the file are extracted in a rule matching mode, the first candidate keywords are added, and second candidate keywords are formed; and calculating TF-IDF values of the second candidate keywords by using a TF-IDF algorithm, sorting the second candidate keywords from large to small according to the TF-IDF values, and outputting words ranked in the top n as final keywords. Compared with the prior art, the method has the advantages of good extraction effec