Method and System for Identifying and Maintaining Gold Units for Use in Crowdsourcing Applications

Method and System for Identifying and Maintaining Gold Units for Use in Crowdsourcing Applications

Methods and systems for identifying and maintaining gold units in a crowdsourcing application are provided. Units of work are selected for inclusion in a gold set based on worker responses to the units of work and an accuracy associated with the workers responding to the unit of work. The gold set i...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: DAI PENG, BRYDON OWEN
Format: Patent
Sprache:eng
Schlagworte:
CALCULATING
COMPUTING
COUNTING
DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FORADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORYOR FORECASTING PURPOSES
PHYSICS
SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE,COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTINGPURPOSES, NOT OTHERWISE PROVIDED FOR
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Methods and systems for identifying and maintaining gold units in a crowdsourcing application are provided. Units of work are selected for inclusion in a gold set based on worker responses to the units of work and an accuracy associated with the workers responding to the unit of work. The gold set is dynamically updated to remove older gold units from the gold set and to remove gold units that are too subjective from the gold set. The optimum gold unit percentage for a given task can also be identified.