ATTRIBUTION VERIFICATION FOR ANSWERS AND SUMMARIES GENERATED FROM LARGE LANGUAGE MODELS (LLMS)

ATTRIBUTION VERIFICATION FOR ANSWERS AND SUMMARIES GENERATED FROM LARGE LANGUAGE MODELS (LLMS)

Systems and methods for verifying attribution of quotations, generated by a large language model (LLM), to a source document are disclosed herein. Upon a request to summarize a source document or process a question that is answerable from a document, an LLM prompt is formed with the request or quest...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: JIANG, Jingtian, RUSSELL, James Simon, PASCH, Mary Sugino David
Format: Patent
Sprache:eng
Schlagworte:
CALCULATING
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
PHYSICS
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Systems and methods for verifying attribution of quotations, generated by a large language model (LLM), to a source document are disclosed herein. Upon a request to summarize a source document or process a question that is answerable from a document, an LLM prompt is formed with the request or question along with the content of the source document. The LLM prompt is configured to cause an LLM to generate quotes that are intended to be from the source document. The output of the LLM, including the quotes, is then verified against the source document.