Ego-Exo4D Proficiency

Ego-Exo4D proficiency estimation benchmark

How to read this picture

Video benchmark: estimate a person's skill level, and spot good or weak moments, from first- and third-person video.1

Sources
Last checked 10 Oct 2026Basic entry13 of 20 facts checked at the sourceNext check 8 Apr 2027
Runs in
Recorded data1
Checked against real robots
Not checked
Skill
Reasoning
Robot
No body1

Comparisons with real robots

No comparison found Unknown

Details

Not applicable in practice: human video only, no robot.

Details

About

What it is
Benchmark Inferred2
More

Classified by the Atlas from how the authors describe and distribute it.

Built by
FAIR (Meta) and a university consortium: CMU, CMU Africa, KAUST, U Minnesota, IIIT Hyderabad, Indiana U, UNC Chapel Hill, UT Austin, U Catania, U Tokyo, U Bristol, NUS, Georgia Tech, U Pennsylvania, UIUC, Universidad de los Andes, Simon Fraser U3
More

Crossref lists 101 authors, first author Kristen Grauman (https://api.crossref.org/works/10.1007/s11263-025-02557-6).

Released
2023-11 (arXiv v1 2023-11-30; proficiency estimation named in the v1 abstract); dataset release announced 2023-12-154
More

Release date from https://docs.ego-exo4d-data.org/changelog/.

Version
Ego-Exo4D data V2 (2024-03-25); demonstrator_proficiency_test_v2.json5
Last update
2025-05: proficiency repo updated the v2 demonstrator test set (commits 2025-05-18 to 2025-05-25); journal version in IJCV published online 2025-11-246
More

Commit messages: 'test split video_ids', 'updated v2 test set videos'. IJCV date from https://api.crossref.org/works/10.1007/s11263-025-02557-6.

Setup

Runs in
Recorded data1
More

Classification and temporal localisation on recorded video.

Robot
No body1
Setting
Mixed1
More

Basketball, bike repair, cooking, dance, health (COVID testing), music, rock climbing, soccer.

Size
Unknown1
More

Demonstrator proficiency: 1,983 train / 561 val / 768 test takes, 6 scenarios (bike repair and health excluded), 4 classes (novice, early, intermediate, late expert). Demonstration proficiency: 556 train / 177 val / 179 test takes, 8 scenarios.1

Parent dataset: 740 participants, 13 cities, 123 scene contexts, 1,286 hours, 5,035 takes (arXiv v4 and V2 data). arXiv v1 said >800 participants, 131 scene contexts, 1,422 hours.1

Scoring and access

Scored by
Accuracy1
More

Docs list mAP at k = 0.25, 0.5, 1.0 s (https://docs.ego-exo4d-data.org/benchmarks/proficiency_estimation/). Challenge numbers are each team's own report (https://arxiv.org/abs/2505.24411, https://arxiv.org/abs/2507.08022); official leaderboard page not found.

Leaderboard
None. Scores are only in papers. Inferred7
More

A Proficiency Estimation Challenge ran at the CVPR 2025 EgoVis workshop (participant reports), but no leaderboard page was found. The 2026 challenge page lists only EgoPose Body and Procedure Understanding (CodaBench) and says organisers are moving from EvalAI to CodaBench.

Code licence
Unknown
More

EGO4D/ego-exo4d-proficiency has no LICENSE file (GitHub API license null). The dataset download tool repo facebookresearch/Ego4d is MIT (https://github.com/facebookresearch/Ego4d).

Data licence
custom: Ego-Exo4D licence agreement8
More

Signed per individual or institution at ego4d.dev (request page returned HTTP 403 to us). Docs say it covers 'research purposes and commercial use' with restrictions on redistribution; full terms not read.

Access
By application8
More

Approval typically ~48 hours; AWS credentials expire after 14 days.

Published at
CVPR 2024; IJCV vol. 133, issue 12, pp. 8356-8435 (online 2025-11-24)9
More

Crossref metadata (DOI 10.1007/s11263-025-02557-6), article licence CC BY-NC-ND 4.0. CVPR 2024 stated in arXiv comments (https://arxiv.org/abs/2311.18259). Springer and CVF pages blocked automated access.

Sources 9

  1. 1Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectives (full text)Paper · Nov 2023 · checked 10 Oct 2026
  2. 2https://arxiv.org/abs/2311.18259Paper · checked 10 Oct 2026
  3. 3Ego-Exo4DOfficial site · checked 10 Oct 2026
  4. 4Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person PerspectivesPaper · Nov 2023 · checked 10 Oct 2026
  5. 5Change Log | Ego-Exo4D DocumentationOfficial site · checked 10 Oct 2026
  6. 6EGO4D/ego-exo4d-proficiency on GitHub (repository)Index · checked 10 Oct 2026
  7. 7EgoExo4D Challenge 2026 | Ego-Exo4D DocumentationOfficial site · checked 10 Oct 2026
  8. 8Getting Started | Ego-Exo4D DocumentationOfficial site · checked 10 Oct 2026
  9. 9https://api.crossref.org/works/10.1007/s11263-025-02557-6Index · checked 10 Oct 2026

Change history

  1. Created as a basic entry: identity facts checked at primary sources (phase 1 re-verification).