EXPLAINABLE PASSAGE CLASSIFICATION

An embodiment includes tokenizing an input passage into an n-gram sequence of tokens. The embodiment also includes evaluating the input passage using a trained classification model that generates an output indicative of a classification of the input passage. The embodiment also includes generating a...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Boxwell, Stephen Arthur, Thomas, John Jai, Summers, Kristen Maria
Format: Patent
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:An embodiment includes tokenizing an input passage into an n-gram sequence of tokens. The embodiment also includes evaluating the input passage using a trained classification model that generates an output indicative of a classification of the input passage. The embodiment also includes generating a first token vector for a first token of the sequence of tokens and projecting the first token vector to a higher dimensional space, resulting in a first projected token vector. The embodiment also includes generating a first similarity score for the first projected token vector based on comparisons of the first projected token vector to each of a plurality of class representations. The embodiment also includes generating a ranked list of the tokens, wherein the generating of the ranked list includes ranking the first token among others of the tokens based on the first similarity score.