Ego4D

How to read this picture

3,670 hours of first-person human video with a benchmark suite on memory, hand-object interaction, social cues and forecasting.1

Sources
Last checked 10 Oct 2026Basic entry14 of 22 facts checked at the sourceNext check 8 Apr 2027
Runs in
Recorded data1
Checked against real robots
Not checked
Skill
Reasoning
Robot
No body1
Used by
2,1292
citations
Licence
MIT3

Comparisons with real robots

Not checked Inferred4

Details

No evidence that Ego4D benchmark scores predict robot performance. Used as pre-training data for robot representations (R3M).

Details

About

What it is
Dataset Inferred1
More

Classified by the Atlas from how the authors describe and distribute it.

Built by
Site: led by 13 universities in partnership with Facebook AI; 85 authors on arXiv (first author Kristen Grauman)4
More

Checked 2026-10-10.

Released
2021-10 (arXiv v1 2021-10-13); site gives data release date 2022-02-171
More

Checked 2026-10-10.

Version
v2.15
More

Checked 2026-10-10.

Last update
v2.1: Goal-Step annotations and grouped videos (210 videos affected). v2.0 (Feb 2023): FHO annotations 243 h vs 120 h, NLQ 27k vs 17.3k queries. 2026 challenges: NLQ, Goal Step, Short-Term object interaction anticipation, at CVPR 2026 EgoVis, using v2.0.5
More

Challenge page: https://ego4d-data.org/docs/challenge/ Checked 2026-10-10.

Setup

Runs in
Recorded data1
More

Checked 2026-10-10.

Robot
No body1
More

Human camera wearers; no robot. Checked 2026-10-10.

Setting
Mixed Inferred1
More

Daily-life activity across 74 locations; no scene breakdown extracted. Checked 2026-10-10.

Size
3,670 hours; 931 unique camera wearers (arXiv abstract) vs 923 unique participants (site); 74 locations, 9 countries1
More

Conflict between paper and site participant counts; both recorded. Checked 2026-10-10.

Scoring and access

Scored by
Unknown
More

Checked 2026-10-10.

Leaderboard
Official leaderboard6
More

Checked 2026-10-10.

Code licence
MIT3
More

GitHub API licence detection (facebookresearch/Ego4d). Checked 2026-10-10.

Data licence
custom: EGO4D License Agreement; must be reviewed and executed before credentials are issued (~48 h); credentials expire after 14 days7
More

Draft licence PDF: https://ego4d-data.org/pdfs/Ego4D-Licenses-Draft.pdf Checked 2026-10-10.

Access
By application7
More

Checked 2026-10-10.

Commercial use
unclear: draft licence text mentions permitted use for academic research and commercial or noncommercial product development, with restrictions Inferred8
More

Read the draft licence PDF; not legal advice. Checked 2026-10-10.

Published at
CVPR 2022 (arXiv comment)1
More

Checked 2026-10-10.

Sources 8

  1. 1Ego4D: Around the World in 3,000 Hours of Egocentric VideoPaper · Oct 2021 · checked 10 Oct 2026
  2. 2Semantic Scholar API recordIndex · checked 10 Oct 2026
  3. 3facebookresearch/Ego4d on GitHub (repository)Repository · checked 10 Oct 2026
  4. 4Egocentric 4D Perception (EGO4D)Official site · checked 10 Oct 2026
  5. 5Updates | Ego4DOfficial site · checked 10 Oct 2026
  6. 6Ego4D and EgoExo4D Challenge 2026 | Ego4DOfficial site · checked 10 Oct 2026
  7. 7Start Here | Ego4DOfficial site · checked 10 Oct 2026
  8. 8https://ego4d-data.org/pdfs/Ego4D-Licenses-Draft.pdfOfficial site · checked 10 Oct 2026

Change history

  1. Created as a basic entry: identity facts checked at primary sources (phase 1 re-verification).