CodeComplex: Dataset for Worst-Case Time Complexity Prediction

Reasoning ability of Large Language Models (LLMs) is a crucial ability, especially in complex decision-making tasks. One significant task to show LLMs' reasoning capability is code time complexity prediction, which involves various intricate factors such as the input range of variables and cond...

Ausführliche Beschreibung

Bibliographische Detailangaben

Veröffentlicht in:	arXiv.org 2024-12
Hauptverfasser:	Baik, Seung-Yeop, Hahn, Joonghyuk, Kim, Jungin, Jeon, Mingi, Aditi, Han, Yo-Sub, Sang-Ki Ko
Format:	Artikel
Sprache:	eng
Schlagworte:	Constraints Datasets Evaluation Labeling Labels Large language models Predictions Python Reasoning Task complexity Time measurement
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!