CONFIDENCE ENHANCEMENT FOR RESPONSES BY DOCUMENT-BASED LARGE LANGUAGE MODELS

Systems and methods are provided for implementing confidence enhancement for responses by document-based large language models ("LLMs") or other AI/ML systems. A first prompt is generated based on data items that are previously received or accessed. The first prompt is used by a first LLM or AI/ML system to extract requested information from the data items. One or more citations are generated and presented within a structured object together with a representation of the extracted information, in some cases, as output from a second LLM or AI/ML system. In some cases, the citations and/or the representation may be verified by a third LLM or AI/ML system, and reliability indicators may be generated for the citations and/or the representation based on determined accuracy of the citations and/or the representation. In this manner, the common issue of hallucinations may be mitigated.