Knowledge Prompts: Injecting World Knowledge into Language Models through Soft Prompts

Soft prompts have been recently proposed as a tool for adapting large frozen language models (LMs) to new tasks. In this work, we repurpose soft prompts to the task of injecting world knowledge into LMs. We introduce a method to train soft prompts via self-supervised learning on data from knowledge...

Ausführliche Beschreibung

Bibliographische Detailangaben

Hauptverfasser:	Santos, Cicero Nogueira dos, Dong, Zhe, Cer, Daniel, Nham, John, Shakeri, Siamak, Ni, Jianmo, Sung, Yun-hsuan
Format:	Artikel
Sprache:	eng
Schlagworte:	Computer Science - Artificial Intelligence Computer Science - Computation and Language Computer Science - Learning
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!