NLP Sandbox: Overcoming data access barriers to reliably assess the performance of NLP tools

The NLP Sandbox adopts a model-to-data approach to enable NLP developers to assess the performance of their tools on public and private datasets. When a developer submits a tool, partner organizations (e.g., hospitals, universities) automatically provision the tool and evaluate its performance against their private data in a secure environment. Upon successful completion, the performance of the tool is returned by the partner organization and automatically published in the leaderboards.