Variable Cardinality Index and Data Retrieval

Systems and methods for a variable cardinality index and data retrieval. A multi-level hash table increases cardinality from a top index and comprises multiple levels respectively pointing to at least one other level of hash tables. Each hash table comprises a unique file identification for a record in the index. A search engine module receives a token and cardinality limit, and performs a search through the multi-level hash table index for records associated with the token. The search is limited by the cardinality limit, and comprises a hash table lookup and a B-Tree progression. In response to a hit in the token search, the search engine performs a subsequent B-Tree progression from the hash table in which the hit occurred. The search engine returns the record, if encountered in the subsequent B-Tree progression. The unique file identification is returned if missing data is encountered, or the cardinality limit is reached.