OPTIMIZING DATA TO IMPROVE LATENCY
Systems and methods for using a generative artificial intelligence (AI) model to generate a suggested draft reply to a selected message. A message generation system and method are described that optimize input that is provided to the AI model so that it provides the most relevant information. In som...
Gespeichert in:
Hauptverfasser: | , , , , |
---|---|
Format: | Patent |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | Systems and methods for using a generative artificial intelligence (AI) model to generate a suggested draft reply to a selected message. A message generation system and method are described that optimize input that is provided to the AI model so that it provides the most relevant information. In some examples, input prompts to the AI model are limited in size and latency can be impacted based on the size of the input provided to the AI model. Thus, the method and system identify, include, and format relevant information in an input prompt. The prompt reduces latency by the generative AI model in processing the prompt and may also lead to more relevant results produced by the generative AI model. |
---|