OPTIMAL DISPATCHING OF FUNCTION-AS-A-SERVICE IN HETEROGENEOUS ACCELERATOR ENVIRONMENTS

Systems and methods are provided for incorporating an optimized dispatcher with an FaaS infrastructure to permit and restrict access to resources. For example, the dispatcher may assign requests to "warm" resources and initiate a fault process if the resource is overloaded or a cache-miss is identified (e.g., by restarting or rebooting the resource). The warm instances or accelerators associated with the allocation size that are identified may be commensurate to the demand and help dynamically route requests to faster accelerators.