System and method for efficiently generating responses to queries

A system and method for efficiently responding to a query. The method comprises generating a lowest level data layer, wherein the lowest level data layer is a common dataset that can be served by a plurality of higher level data layers; generating, based on the lowest level data layer, at least one dataset, wherein each generated dataset is one of the plurality of higher level data layers, wherein each higher level data layer is accessed more rapidly than all lower level data layers; searching, in at least one of the generated data layers, for data needed to generate a response to the query; determining, based on the search, at least one data layer from which the response can be generated, wherein the determined at least one data layer includes the highest level data layer from which the response can be generated; and generating, based on data of the determined at least one data layer, a response to the query.