Assessment method and device of large language model and computer equipment
The invention relates to the field of artificial intelligence, and particularly discloses an evaluation method and device of a large language model, computer equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: acquiring preset acqui...
Gespeichert in:
Hauptverfasser: | , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention relates to the field of artificial intelligence, and particularly discloses an evaluation method and device of a large language model, computer equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: acquiring preset acquisition data of a plurality of functional dimensions and a to-be-evaluated large language model; wherein the plurality of function dimensions at least comprise language understanding, computing power and reasoning logic; respectively inputting the acquisition data of the plurality of function dimensions into a to-be-evaluated large language model to obtain prediction results respectively corresponding to the acquisition data; comparing the prediction result with a reference result of the collected data of the corresponding function dimension to obtain a dimension score corresponding to the prediction result; and obtaining a comprehensive score of the to-be-evaluated large language model according to the dimension sc |
---|