TOPOLOGY-AWARE PROVISIONING OF HARDWARE ACCELERATOR RESOURCES IN A DISTRIBUTED ENVIRONMENT

Techniques are provided for topology-aware provisioning of computing resources in a distributed heterogeneous environment. For example, a method includes: receiving a service request from a client system to perform a data processing job in a server cluster; determining candidate accelerator devices that reside in server nodes of the server cluster, which can be utilized to perform the data processing job; determining a connection topology of each candidate accelerator device within the server nodes, and a performance ranking of each connection topology; utilizing the determined performance ranking of each connection topology to select a group of accelerator devices among the candidate accelerator devices, which can be provisioned to perform the data processing job, wherein the selected group of accelerator devices include candidate accelerator devices with connection topologies that have matching performance rankings; and scheduling and provisioning the selected group of accelerator devices to execute the data processing job.