Iterative training for multi-modal data in natural language processing

Systems and methods are disclosed for generating a Natural Language Processing (NLP) model through iterative training. A method involves processing a plurality of real-world documents, each containing text data, layout data, and image data, using at least one hardware processor. An initial predictio...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Gralinski, Filip, Borchmann, Lukasz Konrad, Dancewicz, Adam
Format: Patent
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Systems and methods are disclosed for generating a Natural Language Processing (NLP) model through iterative training. A method involves processing a plurality of real-world documents, each containing text data, layout data, and image data, using at least one hardware processor. An initial prediction for data points within the documents is generated using a neural network. The initial prediction is then validated by comparing extracted values with the information present in the documents and correcting any discrepancies. The quality of the NLP model is evaluated based on the validated predictions, and upon satisfying a quality constraint, the NLP model is configured to process new documents to extract data points without further validation. This method streamlines the extraction of information from diverse document formats, enhancing the efficiency and accuracy of data retrieval in automated systems.