PROGRAMMATICALLY GENERATING EVALUATION DATA SETS FOR CODE GENERATION MODELS

PROGRAMMATICALLY GENERATING EVALUATION DATA SETS FOR CODE GENERATION MODELS

Evaluation data sets may be programmatically generated for code generation models. An evaluation data set is obtained that includes items that correspond to different evaluation tests for a code generation system. The individual items of the evaluation data set maybe converted, including the convers...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Xiang, Bing, Deo, Atul, Nallapati, Ramesh M, Lee, Matthew, Pokkunuri, Rama Krishna Sandeep, Athiwaratkun, Praphruetpong, Iragavarapu, Srinivas, Lin, Zixuan, Ding, Hantian, Wang, Zijian, Bhatia, Parminder, Tian, Yuchen, Arnold, Andrew Oliver, Donchev, Yanitsa, Sengupta, Sudipta, Bontala, Sri Ranga Akhilesh, Keerthi, Ramana, Desai, Ankur Deepak
Format: Patent
Sprache:eng
Schlagworte:
CALCULATING
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
PHYSICS
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Evaluation data sets may be programmatically generated for code generation models. An evaluation data set is obtained that includes items that correspond to different evaluation tests for a code generation system. The individual items of the evaluation data set maybe converted, including the conversion of a function signature for the items, the test statements for the items and using a code generation system to generate the body of the function.