Aria Gen 2 glasses take research with Project Aria to the next level.
The Second Research Summit for Egocentric Perception with Project Aria
August 25th and 26th @ Meta's Redmond Campus, Building X
Meta Reality Labs Research is hosting it’s second academic research summit focused on egocentric and AI research, leveraging Meta’s research tool Project Aria. This summit is an opportunity to further engage with leaders in the egocentric perception and AI research space, foster cross-pollination of ideas across disciplines, and provide researchers support as they embark on using new datasets and technologies to advance AR and AI research.
Please RSVP at your earliest convenience. If you have any questions please reach out to Maddy Bowen - Maddybowen@meta.com.
Our Schedule
Schedule Overview
Meta will provide shuttle service to and from the Archer hotel - allowing attendees to move from the Hotel to Building X.
When you arrive, a Meta summit representative will check you in at the front desk and guide you to the summit space - located on the 5th floor.
Day 1 - Monday, 08/25
Time
Event
Speaker(s)
07:45 - 09:00
Check-in at Building X, First floor lobby
08:00 - 09:00
Welcome Breakfast outside of Born this Way
09:10 - 09:15
Event Overview
James Fort - Meta
09:15 - 09:45
Keynote
Richard Newcombe - Meta
09:45 - 10:15
Project Aria Update
James Fort - Meta
10:15 - 10:45
BREAK
Lightning Talks: Robotics
10:45 - 11:00
Predictive Models of Humans as General Reward Functions
Antonio Loquercio - UPenn
11:00 - 11:15
Robot Learning from Human Vision and Touch
Lerrel Pinto - NYU
11:15 - 11:30
Human Data as a Foundation of Robot Learning
Danfei Xu - Georgia Tech
11:30 - 11:45
Egocentric 3D: From Photoreal to Sparse‑View Reconstruction
Zhao Dong - Meta
11:45 - 12:45
Lunch Outside of Born this Way
Lightning Talks: Robotics
12:45 - 01:00
Teaching Robots to Read Minds—One Glance at a Time
Yuchen Cui - UCLA
01:00 - 01:15
Towards Long-term 3D Mapping with Radiance Fields
Ethan Yifu Tao - University of Oxford
01:15 - 01:30
Advancing Human-Robot Teaming through Mixed Reality
Frank Regal & Fabien Parra - UT Austin
01:30 - 01:45
Visual Embodied Planning
Roozbeh Mottaghi - Meta
01:45 - 02:15
BREAK
Lightning Talks: Robotics
02:15 - 02:30
Seeing from the Robot’s Perspective:
Learning Visuomotor Policies from Egocentric Data
Zeyi Liu - Stanford University
02:30 - 02:45
Thinking Inside the Scene: Toward Common Sense in Robotic Perception
Zuria Bauer - ETH Zurich
02:45 - 03:00
Watching Human Videos for Humanoids
Xiaolong Wang - UC San Diego
03:00 - 03:15
Improving user experience of wearable devices through Edge AI acceleration
Hung-Wei Tseng - UC Riverside
03:15 - 03:30
Physics-Aware Skill Learning for Human Motion Reconstruction and Control
Lingjie Liu - UPenn
03:30 - 03:45
Egocentric Body Motion Understanding
Lingni Ma - Meta
03:45 - 03:55
Day 1 Wrap-up/Day 2 Preview
James Fort - Meta
Day 2 - Tuesday, 08/26
Time
Event
Speaker(s)
07:45 - 09:00
Check-in at Building X, First floor lobby
08:00 - 08:45
Welcome Breakfast outside of BTW
09:00 - 10:00
Panel on Egocentric data for Robotics
Richard Newcombe, Danfei Xu,
Sangbae Kim, Lerrel Pinto,
Mingfei Yan (Moderator)
10:00 - 10:30
Keynote
Michael Abrash - RL-R
10:30 - 11:00
BREAK
Lightning Talks: Spatial AI
11:00 - 11:15
Understanding Human Control of Urban Cycling Using Aria Glasses
Sang-Hoon Yeo - University of Birmingham
11:15 - 11:30
Benchmarking Egocentric Visual-Inertial SLAM at City Scale
Shaohui Liu - ETH Zurich
11:30 - 11:45
Self-Supervised Learning of Reliable Point Representations
Julian Straub - Meta
11:45 - 12:00
Egocentric Hand-Arm Reconstruction
Christen Millerdurai - German Center for Artificial Intelligence
12:00 - 12:15
Attention and Intention while Driving on Indian Roads
CV Jawahar - IIIT-Hyderabad
12:15 - 12:30
SmartGuide: User-Centered Indoor Navigation App for the Visually Impaired
Ye Cao & Luis Borunda - Virginia Tech
12:30 - 12:45
Egocentric Computing for Adaptive Cognitive Augmentation
Dinithi Dissanayake - National University of Singapore
12:45 - 01:00
Using Aria Gen2 with NVIDIA Foundation Stereo for Depth
Chris Sweeney - Meta
01:00 - 02:00
Lunch Outside of Born this Way
Lightning Talks: Contextual AI
02:00 - 02:15
Skill Learning from Instructional Videos
Sagnik Majumder - UT Austin
02:15 - 02:30
HD-EPIC A Highly Detailed Egocentric Dataset
using Aria Glasses with a Digital Twin
Dima Damen & Prawal gatti - University of Bristol
02:30 - 02:45
Reading Recognition in the Wild
Mi Zhang & Hyo Jin Kim - Ohio State University/Meta
02:45 - 03:00
Seeing Inside: Estimating Heart Rate, Emotion, and Personality
on Egocentric Vision Systems
Christian Holz - ETH Zurich
03:00 - 03:15
Egocentric Understanding in Operating Rooms - A first step?
Felix Tristram - Technical University of Munich
03:15 - 03:30
Foveated Tokenization for Efficient Point-Prompted Segmentation
Tanner Schmidt - Meta
03:30 - 03:45
BREAK
Lightning Talks: Contextual AI & HCI
03:45 - 04:00
Analysing Social Signals Across Realities
Julie Williamson - University of Glasgow
04:00 - 04:15
OpenNavMap: MultiSession Structure-Free Mapping for Visual Navigation
Jianhao Jiao - University College London
04:15 - 04:30
Conversation Understanding using Aria
Calvin Murdock - Meta
04:30 - 04:40
Wrap Up and Closing Remarks
Richard Newcombe - Meta
⭐ Throughout the summit there will be numerous opportunities to network and connect with attendees and Meta researchers alike. ⭐
OUR GOAL
Explore the frontiers of egocentric perception research and solve core research challenges together.
The Organizing Committee
The organizing committee includes Project Aria Meta Reality Labs Researchers and product management; Richard Newcombe, Mingfei Yan, and Jakob Julian Engel, and James Fort.
VP, Surreal Research Science
Meta Reality Labs Research
Director, Research Product Mgmt
Meta Reality Labs Research
Director, Research Scientist
Meta Reality Labs Research
Research Product Manager
Meta Reality Labs Research
Venue and Accommodation
Join us on Meta's Reality Labs Research campus for two-days of inspired talks, presentations, and opportunities to collaborate.
Our Summit lodging is Set in Redmond, Seattle’s high-tech Eastside suburb, this boutique hotel is steps to the walkable dining and a short drive to Meta's campus.
More information on shuttles between Archer Hotel and Building X to come.
