UNSUPERVISED DYNAMIC CONFIDENCE THRESHOLDING FOR ANSWERING QUESTIONS

A method includes receiving, by a question answering system having a confidence threshold, plural questions from one or more user devices. The method includes processing each one of the questions by: generating an answer to the one of the questions; determining a confidence score of the answer; in r...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Stoyanovsky, Anastas, Murdock, IV, James William
Format: Patent
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:A method includes receiving, by a question answering system having a confidence threshold, plural questions from one or more user devices. The method includes processing each one of the questions by: generating an answer to the one of the questions; determining a confidence score of the answer; in response to determining the confidence score is greater than the confidence threshold, increasing the confidence threshold and returning the answer to the user device that generated the one of the questions; and in response to determining the confidence score is less than the confidence threshold, decreasing the confidence threshold and not returning the answer to the user device that generated the one of the questions. The increasing the confidence threshold and the decreasing the confidence threshold are performed such that the question answering system returns answers for the plural questions at a frequency that approximates a pre-defined target answering frequency.