AuRORA: A Full-Stack Solution for Scalable and Virtualized Accelerator Integration

To meet the increasingly demanding compute requirements of modern workloads, systems on chip (SoCs) must provide an accelerator-rich hardware architecture and software programming interface. However, scalability remains a first-order concern, as introducing additional unmanageable complexity to eith...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE MICRO 2024-07, Vol.44 (4), p.97-105
Hauptverfasser: Kim, Seah, Zhao, Jerry, Asanovic, Krste, Nikolic, Borivoje, Shao, Yakun Sophia
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:To meet the increasingly demanding compute requirements of modern workloads, systems on chip (SoCs) must provide an accelerator-rich hardware architecture and software programming interface. However, scalability remains a first-order concern, as introducing additional unmanageable complexity to either physical design or software integration may prohibit the deployment of new accelerators. To address these challenges, this work presents AuRORA, an accelerator integration methodology that provides a scalable physical accelerator interface while preserving software semantics with minimal overhead for accelerator access. AuRORA provides a new accelerator integration methodology that preserves the software and hardware interface of a tightly CPU-coupled accelerator while physically disaggregating the accelerators away from a host CPU. To address software scalability, AuRORA also includes a lightweight software runtime for an SoC with heterogeneous accelerators, providing low-overhead access to these accelerators for multitenant applications.
ISSN:0272-1732
1937-4143
DOI:10.1109/MM.2024.3409546