Project Aria: A New Tool for Egocentric Multi-Modal AI Research

Egocentric, multi-modal data as available on future augmented reality (AR) devices provides unique challenges and opportunities for machine perception. These future devices will need to be all-day wearable in a socially acceptable form-factor to support always available, context-aware and personaliz...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Engel, Jakob, Somasundaram, Kiran, Goesele, Michael, Sun, Albert, Gamino, Alexander, Turner, Andrew, Talattof, Arjang, Yuan, Arnie, Souti, Bilal, Meredith, Brighid, Peng, Cheng, Sweeney, Chris, Wilson, Cole, Barnes, Dan, DeTone, Daniel, Caruso, David, Valleroy, Derek, Ginjupalli, Dinesh, Frost, Duncan, Miller, Edward, Mueggler, Elias, Oleinik, Evgeniy, Zhang, Fan, Somasundaram, Guruprasad, Solaira, Gustavo, Lanaras, Harry, Howard-Jenkins, Henry, Tang, Huixuan, Kim, Hyo Jin, Rivera, Jaime, Luo, Ji, Dong, Jing, Straub, Julian, Bailey, Kevin, Eckenhoff, Kevin, Ma, Lingni, Pesqueira, Luis, Schwesinger, Mark, Monge, Maurizio, Yang, Nan, Charron, Nick, Raina, Nikhil, Parkhi, Omkar, Borschowa, Peter, Moulon, Pierre, Gupta, Prince, Mur-Artal, Raul, Pennington, Robbie, Kulkarni, Sachin, Miglani, Sagar, Gondi, Santosh, Solanki, Saransh, Diener, Sean, Cheng, Shangyi, Green, Simon, Saarinen, Steve, Patra, Suvam, Mourikis, Tassos, Whelan, Thomas, Singh, Tripti, Balntas, Vasileios, Baiyya, Vijay, Dreewes, Wilson, Pan, Xiaqing, Lou, Yang, Zhao, Yipu, Mansour, Yusuf, Zou, Yuyang, Lv, Zhaoyang, Wang, Zijian, Yan, Mingfei, Ren, Carl, De Nardi, Renzo, Newcombe, Richard
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Egocentric, multi-modal data as available on future augmented reality (AR) devices provides unique challenges and opportunities for machine perception. These future devices will need to be all-day wearable in a socially acceptable form-factor to support always available, context-aware and personalized AI applications. Our team at Meta Reality Labs Research built the Aria device, an egocentric, multi-modal data recording and streaming device with the goal to foster and accelerate research in this area. In this paper, we describe the Aria device hardware including its sensor configuration and the corresponding software tools that enable recording and processing of such data.
DOI:10.48550/arxiv.2308.13561