Ego-Exo4D Proficiency
Ego-Exo4D proficiency estimation benchmark
Video benchmark: estimate a person's skill level, and spot good or weak moments, from first- and third-person video.1
Comparisons with real robots
No comparison found Unknown
Details
Not applicable in practice: human video only, no robot.
Details
About
- What it is
- Benchmark Inferred2
More
Classified by the Atlas from how the authors describe and distribute it.
- Built by
- FAIR (Meta) and a university consortium: CMU, CMU Africa, KAUST, U Minnesota, IIIT Hyderabad, Indiana U, UNC Chapel Hill, UT Austin, U Catania, U Tokyo, U Bristol, NUS, Georgia Tech, U Pennsylvania, UIUC, Universidad de los Andes, Simon Fraser U3
More
Crossref lists 101 authors, first author Kristen Grauman (https://api.crossref.org/works/10.1007/s11263-025-02557-6).
- Released
- 2023-11 (arXiv v1 2023-11-30; proficiency estimation named in the v1 abstract); dataset release announced 2023-12-154
More
Release date from https://docs.ego-exo4d-data.org/changelog/.
- Version
- Ego-Exo4D data V2 (2024-03-25); demonstrator_proficiency_test_v2.json5
- Last update
- 2025-05: proficiency repo updated the v2 demonstrator test set (commits 2025-05-18 to 2025-05-25); journal version in IJCV published online 2025-11-246
More
Commit messages: 'test split video_ids', 'updated v2 test set videos'. IJCV date from https://api.crossref.org/works/10.1007/s11263-025-02557-6.
Setup
- Runs in
- Recorded data1
More
Classification and temporal localisation on recorded video.
- Robot
- No body1
- Setting
- Mixed1
More
Basketball, bike repair, cooking, dance, health (COVID testing), music, rock climbing, soccer.
- Size
- Unknown1
More
Demonstrator proficiency: 1,983 train / 561 val / 768 test takes, 6 scenarios (bike repair and health excluded), 4 classes (novice, early, intermediate, late expert). Demonstration proficiency: 556 train / 177 val / 179 test takes, 8 scenarios.1
Parent dataset: 740 participants, 13 cities, 123 scene contexts, 1,286 hours, 5,035 takes (arXiv v4 and V2 data). arXiv v1 said >800 participants, 131 scene contexts, 1,422 hours.1
Scoring and access
- Scored by
- Accuracy1
More
Docs list mAP at k = 0.25, 0.5, 1.0 s (https://docs.ego-exo4d-data.org/benchmarks/proficiency_estimation/). Challenge numbers are each team's own report (https://arxiv.org/abs/2505.24411, https://arxiv.org/abs/2507.08022); official leaderboard page not found.
- Leaderboard
- None. Scores are only in papers. Inferred7
More
A Proficiency Estimation Challenge ran at the CVPR 2025 EgoVis workshop (participant reports), but no leaderboard page was found. The 2026 challenge page lists only EgoPose Body and Procedure Understanding (CodaBench) and says organisers are moving from EvalAI to CodaBench.
- Code licence
- Unknown
More
EGO4D/ego-exo4d-proficiency has no LICENSE file (GitHub API license null). The dataset download tool repo facebookresearch/Ego4d is MIT (https://github.com/facebookresearch/Ego4d).
- Data licence
- custom: Ego-Exo4D licence agreement8
More
Signed per individual or institution at ego4d.dev (request page returned HTTP 403 to us). Docs say it covers 'research purposes and commercial use' with restrictions on redistribution; full terms not read.
- Access
- By application8
More
Approval typically ~48 hours; AWS credentials expire after 14 days.
- Published at
- CVPR 2024; IJCV vol. 133, issue 12, pp. 8356-8435 (online 2025-11-24)9
More
Crossref metadata (DOI 10.1007/s11263-025-02557-6), article licence CC BY-NC-ND 4.0. CVPR 2024 stated in arXiv comments (https://arxiv.org/abs/2311.18259). Springer and CVF pages blocked automated access.
Sources 9
- 1Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectives (full text)Paper · Nov 2023 · checked 10 Oct 2026
- 2https://arxiv.org/abs/2311.18259Paper · checked 10 Oct 2026
- 3Ego-Exo4DOfficial site · checked 10 Oct 2026
- 4Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person PerspectivesPaper · Nov 2023 · checked 10 Oct 2026
- 5Change Log | Ego-Exo4D DocumentationOfficial site · checked 10 Oct 2026
- 6EGO4D/ego-exo4d-proficiency on GitHub (repository)Index · checked 10 Oct 2026
- 7EgoExo4D Challenge 2026 | Ego-Exo4D DocumentationOfficial site · checked 10 Oct 2026
- 8Getting Started | Ego-Exo4D DocumentationOfficial site · checked 10 Oct 2026
- 9https://api.crossref.org/works/10.1007/s11263-025-02557-6Index · checked 10 Oct 2026
Change history
- Created as a basic entry: identity facts checked at primary sources (phase 1 re-verification).