Scalable curation system

A system and method is disclosed for improving automated question-answering using real-world knowledge from a knowledge base. The system can be used to answer questions from various users. The system can generate answers to these questions using data stored in a knowledge base. In some embodiments, the system is provided with a list of questions separate from any user questions. The system can be trained using these questions in advance of a user question. The system can process the presented questions to determine that it can generate high-quality correct answers. The system can take various steps to determine a high-quality answer to a question. The system can utilize human intelligence providers to improve this process, such as through a human interactive task system. Human intelligence can be used to determine that a question is understood, that a question is answered, and that the answer is of high quality.