Ego4D
3,670 hours of first-person human video with a benchmark suite on memory, hand-object interaction, social cues and forecasting.1
Comparisons with real robots
Not checked Inferred4
Details
No evidence that Ego4D benchmark scores predict robot performance. Used as pre-training data for robot representations (R3M).
Details
About
- What it is
- Dataset Inferred1
More
Classified by the Atlas from how the authors describe and distribute it.
- Built by
- Site: led by 13 universities in partnership with Facebook AI; 85 authors on arXiv (first author Kristen Grauman)4
More
Checked 2026-10-10.
- Released
- 2021-10 (arXiv v1 2021-10-13); site gives data release date 2022-02-171
More
Checked 2026-10-10.
- Version
- v2.15
More
Checked 2026-10-10.
- Last update
- v2.1: Goal-Step annotations and grouped videos (210 videos affected). v2.0 (Feb 2023): FHO annotations 243 h vs 120 h, NLQ 27k vs 17.3k queries. 2026 challenges: NLQ, Goal Step, Short-Term object interaction anticipation, at CVPR 2026 EgoVis, using v2.0.5
More
Challenge page: https://ego4d-data.org/docs/challenge/ Checked 2026-10-10.
Setup
- Runs in
- Recorded data1
More
Checked 2026-10-10.
- Robot
- No body1
More
Human camera wearers; no robot. Checked 2026-10-10.
- Setting
- Mixed Inferred1
More
Daily-life activity across 74 locations; no scene breakdown extracted. Checked 2026-10-10.
- Size
- 3,670 hours; 931 unique camera wearers (arXiv abstract) vs 923 unique participants (site); 74 locations, 9 countries1
More
Conflict between paper and site participant counts; both recorded. Checked 2026-10-10.
Scoring and access
- Scored by
- Unknown
More
Checked 2026-10-10.
- Leaderboard
- Official leaderboard6
More
Checked 2026-10-10.
- Code licence
- MIT3
More
GitHub API licence detection (facebookresearch/Ego4d). Checked 2026-10-10.
- Data licence
- custom: EGO4D License Agreement; must be reviewed and executed before credentials are issued (~48 h); credentials expire after 14 days7
More
Draft licence PDF: https://ego4d-data.org/pdfs/Ego4D-Licenses-Draft.pdf Checked 2026-10-10.
- Access
- By application7
More
Checked 2026-10-10.
- Commercial use
- unclear: draft licence text mentions permitted use for academic research and commercial or noncommercial product development, with restrictions Inferred8
More
Read the draft licence PDF; not legal advice. Checked 2026-10-10.
- Published at
- CVPR 2022 (arXiv comment)1
More
Checked 2026-10-10.
Sources 8
- 1Ego4D: Around the World in 3,000 Hours of Egocentric VideoPaper · Oct 2021 · checked 10 Oct 2026
- 2Semantic Scholar API recordIndex · checked 10 Oct 2026
- 3facebookresearch/Ego4d on GitHub (repository)Repository · checked 10 Oct 2026
- 4Egocentric 4D Perception (EGO4D)Official site · checked 10 Oct 2026
- 5Updates | Ego4DOfficial site · checked 10 Oct 2026
- 6Ego4D and EgoExo4D Challenge 2026 | Ego4DOfficial site · checked 10 Oct 2026
- 7Start Here | Ego4DOfficial site · checked 10 Oct 2026
- 8https://ego4d-data.org/pdfs/Ego4D-Licenses-Draft.pdfOfficial site · checked 10 Oct 2026
Change history
- Created as a basic entry: identity facts checked at primary sources (phase 1 re-verification).