Retrieval and management of spoken language understanding personalization data

Features are disclosed for maintaining data that can be used to personalize spoken language processing, such as automatic speech recognition ("ASR"), natural language understanding ("NLU"), natural language processing ("NLP"), etc. The data may be obtained from various data sources, such as applications or services used by the user. User-specific data maintained by the data sources can be retrieved and stored for use in generating personal models. Updates to data at the data sources may be reflected by separate data sets in the personalization data, such that other processes can obtain the update data sets separate from other data.