TECHNIQUES FOR COMBINING HUMAN AND MACHINE LEARNING IN NATURAL LANGUAGE PROCESSING

Methods, apparatuses and computer readable medium are presented for generating a natural language model. A method for generating a natural language model comprises: receiving more than one annotation of a document; calculating a level of agreement among the received annotations; determining that a c...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Thompson, Jana N, Brenier, Jason, Walker, Christopher, Tepper, Paul A, Luger, Sarah K, Schnoebelen, Tyler J, King, Gary C, Munro, Robert J, Callahan, Brendan D, Long, Jessica D
Format: Patent
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Thompson, Jana N
Brenier, Jason
Walker, Christopher
Tepper, Paul A
Luger, Sarah K
Schnoebelen, Tyler J
King, Gary C
Munro, Robert J
Callahan, Brendan D
Long, Jessica D
description Methods, apparatuses and computer readable medium are presented for generating a natural language model. A method for generating a natural language model comprises: receiving more than one annotation of a document; calculating a level of agreement among the received annotations; determining that a criterion among a first criterion, a second criterion, and a third criterion is satisfied based at least in part on the level of agreement; determining an aggregated annotation representing an aggregation of information in the received annotations and training a natural language model using the aggregated annotation, when the first criterion is satisfied; generating at least one human readable prompt configured to receive additional annotations of the document, when the second criterion is satisfied; and discarding the received annotations from use in training the natural language model, when the third criterion is satisfied.
format Patent
fullrecord <record><control><sourceid>epo_EVB</sourceid><recordid>TN_cdi_epo_espacenet_US2020184146A1</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>US2020184146A1</sourcerecordid><originalsourceid>FETCH-epo_espacenet_US2020184146A13</originalsourceid><addsrcrecordid>eNqNyr0KwjAUQOEuDqK-wwVnoalFul7jbRJIbjQ_cykSJ9FCfX8U8QGczvCdZRUSSc3mkilC7wNI746GDSvQ2SED8gkcSm2YwBKGLxkGxpQDWrDIKqMiOAcvKcYPr6vFbbzPZfPrqtr2lKTelek5lHkar-VRXkOOTd3UomtFe0Cx_-96A3lwMFs</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>patent</recordtype></control><display><type>patent</type><title>TECHNIQUES FOR COMBINING HUMAN AND MACHINE LEARNING IN NATURAL LANGUAGE PROCESSING</title><source>esp@cenet</source><creator>Thompson, Jana N ; Brenier, Jason ; Walker, Christopher ; Tepper, Paul A ; Luger, Sarah K ; Schnoebelen, Tyler J ; King, Gary C ; Munro, Robert J ; Callahan, Brendan D ; Long, Jessica D</creator><creatorcontrib>Thompson, Jana N ; Brenier, Jason ; Walker, Christopher ; Tepper, Paul A ; Luger, Sarah K ; Schnoebelen, Tyler J ; King, Gary C ; Munro, Robert J ; Callahan, Brendan D ; Long, Jessica D</creatorcontrib><description>Methods, apparatuses and computer readable medium are presented for generating a natural language model. A method for generating a natural language model comprises: receiving more than one annotation of a document; calculating a level of agreement among the received annotations; determining that a criterion among a first criterion, a second criterion, and a third criterion is satisfied based at least in part on the level of agreement; determining an aggregated annotation representing an aggregation of information in the received annotations and training a natural language model using the aggregated annotation, when the first criterion is satisfied; generating at least one human readable prompt configured to receive additional annotations of the document, when the second criterion is satisfied; and discarding the received annotations from use in training the natural language model, when the third criterion is satisfied.</description><language>eng</language><subject>CALCULATING ; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS ; COMPUTING ; COUNTING ; DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FORADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORYOR FORECASTING PURPOSES ; ELECTRIC DIGITAL DATA PROCESSING ; PHYSICS ; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE,COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTINGPURPOSES, NOT OTHERWISE PROVIDED FOR</subject><creationdate>2020</creationdate><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20200611&amp;DB=EPODOC&amp;CC=US&amp;NR=2020184146A1$$EHTML$$P50$$Gepo$$Hfree_for_read</linktohtml><link.rule.ids>230,308,780,885,25564,76547</link.rule.ids><linktorsrc>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20200611&amp;DB=EPODOC&amp;CC=US&amp;NR=2020184146A1$$EView_record_in_European_Patent_Office$$FView_record_in_$$GEuropean_Patent_Office$$Hfree_for_read</linktorsrc></links><search><creatorcontrib>Thompson, Jana N</creatorcontrib><creatorcontrib>Brenier, Jason</creatorcontrib><creatorcontrib>Walker, Christopher</creatorcontrib><creatorcontrib>Tepper, Paul A</creatorcontrib><creatorcontrib>Luger, Sarah K</creatorcontrib><creatorcontrib>Schnoebelen, Tyler J</creatorcontrib><creatorcontrib>King, Gary C</creatorcontrib><creatorcontrib>Munro, Robert J</creatorcontrib><creatorcontrib>Callahan, Brendan D</creatorcontrib><creatorcontrib>Long, Jessica D</creatorcontrib><title>TECHNIQUES FOR COMBINING HUMAN AND MACHINE LEARNING IN NATURAL LANGUAGE PROCESSING</title><description>Methods, apparatuses and computer readable medium are presented for generating a natural language model. A method for generating a natural language model comprises: receiving more than one annotation of a document; calculating a level of agreement among the received annotations; determining that a criterion among a first criterion, a second criterion, and a third criterion is satisfied based at least in part on the level of agreement; determining an aggregated annotation representing an aggregation of information in the received annotations and training a natural language model using the aggregated annotation, when the first criterion is satisfied; generating at least one human readable prompt configured to receive additional annotations of the document, when the second criterion is satisfied; and discarding the received annotations from use in training the natural language model, when the third criterion is satisfied.</description><subject>CALCULATING</subject><subject>COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS</subject><subject>COMPUTING</subject><subject>COUNTING</subject><subject>DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FORADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORYOR FORECASTING PURPOSES</subject><subject>ELECTRIC DIGITAL DATA PROCESSING</subject><subject>PHYSICS</subject><subject>SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE,COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTINGPURPOSES, NOT OTHERWISE PROVIDED FOR</subject><fulltext>true</fulltext><rsrctype>patent</rsrctype><creationdate>2020</creationdate><recordtype>patent</recordtype><sourceid>EVB</sourceid><recordid>eNqNyr0KwjAUQOEuDqK-wwVnoalFul7jbRJIbjQ_cykSJ9FCfX8U8QGczvCdZRUSSc3mkilC7wNI746GDSvQ2SED8gkcSm2YwBKGLxkGxpQDWrDIKqMiOAcvKcYPr6vFbbzPZfPrqtr2lKTelek5lHkar-VRXkOOTd3UomtFe0Cx_-96A3lwMFs</recordid><startdate>20200611</startdate><enddate>20200611</enddate><creator>Thompson, Jana N</creator><creator>Brenier, Jason</creator><creator>Walker, Christopher</creator><creator>Tepper, Paul A</creator><creator>Luger, Sarah K</creator><creator>Schnoebelen, Tyler J</creator><creator>King, Gary C</creator><creator>Munro, Robert J</creator><creator>Callahan, Brendan D</creator><creator>Long, Jessica D</creator><scope>EVB</scope></search><sort><creationdate>20200611</creationdate><title>TECHNIQUES FOR COMBINING HUMAN AND MACHINE LEARNING IN NATURAL LANGUAGE PROCESSING</title><author>Thompson, Jana N ; Brenier, Jason ; Walker, Christopher ; Tepper, Paul A ; Luger, Sarah K ; Schnoebelen, Tyler J ; King, Gary C ; Munro, Robert J ; Callahan, Brendan D ; Long, Jessica D</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-epo_espacenet_US2020184146A13</frbrgroupid><rsrctype>patents</rsrctype><prefilter>patents</prefilter><language>eng</language><creationdate>2020</creationdate><topic>CALCULATING</topic><topic>COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS</topic><topic>COMPUTING</topic><topic>COUNTING</topic><topic>DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FORADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORYOR FORECASTING PURPOSES</topic><topic>ELECTRIC DIGITAL DATA PROCESSING</topic><topic>PHYSICS</topic><topic>SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE,COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTINGPURPOSES, NOT OTHERWISE PROVIDED FOR</topic><toplevel>online_resources</toplevel><creatorcontrib>Thompson, Jana N</creatorcontrib><creatorcontrib>Brenier, Jason</creatorcontrib><creatorcontrib>Walker, Christopher</creatorcontrib><creatorcontrib>Tepper, Paul A</creatorcontrib><creatorcontrib>Luger, Sarah K</creatorcontrib><creatorcontrib>Schnoebelen, Tyler J</creatorcontrib><creatorcontrib>King, Gary C</creatorcontrib><creatorcontrib>Munro, Robert J</creatorcontrib><creatorcontrib>Callahan, Brendan D</creatorcontrib><creatorcontrib>Long, Jessica D</creatorcontrib><collection>esp@cenet</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Thompson, Jana N</au><au>Brenier, Jason</au><au>Walker, Christopher</au><au>Tepper, Paul A</au><au>Luger, Sarah K</au><au>Schnoebelen, Tyler J</au><au>King, Gary C</au><au>Munro, Robert J</au><au>Callahan, Brendan D</au><au>Long, Jessica D</au><format>patent</format><genre>patent</genre><ristype>GEN</ristype><title>TECHNIQUES FOR COMBINING HUMAN AND MACHINE LEARNING IN NATURAL LANGUAGE PROCESSING</title><date>2020-06-11</date><risdate>2020</risdate><abstract>Methods, apparatuses and computer readable medium are presented for generating a natural language model. A method for generating a natural language model comprises: receiving more than one annotation of a document; calculating a level of agreement among the received annotations; determining that a criterion among a first criterion, a second criterion, and a third criterion is satisfied based at least in part on the level of agreement; determining an aggregated annotation representing an aggregation of information in the received annotations and training a natural language model using the aggregated annotation, when the first criterion is satisfied; generating at least one human readable prompt configured to receive additional annotations of the document, when the second criterion is satisfied; and discarding the received annotations from use in training the natural language model, when the third criterion is satisfied.</abstract><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier
ispartof
issn
language eng
recordid cdi_epo_espacenet_US2020184146A1
source esp@cenet
subjects CALCULATING
COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
COMPUTING
COUNTING
DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FORADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORYOR FORECASTING PURPOSES
ELECTRIC DIGITAL DATA PROCESSING
PHYSICS
SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE,COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTINGPURPOSES, NOT OTHERWISE PROVIDED FOR
title TECHNIQUES FOR COMBINING HUMAN AND MACHINE LEARNING IN NATURAL LANGUAGE PROCESSING
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-25T05%3A05%3A57IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-epo_EVB&rft_val_fmt=info:ofi/fmt:kev:mtx:patent&rft.genre=patent&rft.au=Thompson,%20Jana%20N&rft.date=2020-06-11&rft_id=info:doi/&rft_dat=%3Cepo_EVB%3EUS2020184146A1%3C/epo_EVB%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true