← all datasets  ·  video plans (procedure) →  ·  persona portraits →  ·  persona-key filtering →

Initial Video Set — Diverse Cross-Benchmark Sample

46 videos · 23+ distinct activity families · sampled from all 4 target benchmarks. Not cooking-only, not manipulation-only. Compressed 360p previews (HTTP-Range friendly for seeking).

How these videos were filtered / selected

A stratified sample (not random): I defined a set of diversity dimensions, then picked videos to spread coverage across them. Primary dimensions drive the quota; secondary dimensions are recorded and used as balance checks. Sources with clean labels (Wearable-AI) were stratified directly from their metadata; sources with no on-disk labels (HowTo100M, EgoSchema) were tagged by a 1-frame Gemini-flash activity classification, then diversified. CaptainCook4D is 100% cooking, so it is capped (6 distinct recipes).

A · Source benchmark
Mix all 4 targets; no dataset dominates.
B · Event / scenario type
The anti-"only cooking / only manipulation" axis: procedural-task · instructional-demo · excursion-travel · sport-performance · social-event · shopping-errand · daily-routine. Every bucket has a floor of coverage.
C · Task / interaction form
proactive-assist / conversational-QA / long-MCQ / procedural-manipulation / instructional-tutorial / unconstrained-egocentric.
D · Temporal scale
short <100s · medium 100–250s · long >250s (16s→820s).
E · Viewpoint (secondary)
egocentric vs exocentric.
F · Environment (secondary)
indoor-stationary vs outdoor-locomotion (heuristic).
G · Interaction intensity (secondary)
high hand-object manipulation vs low/observational (heuristic).

Source videos: where each one comes from

Source#Paper / originWhat the source video is
Wearable-AI (Meta)30Wearable AI Workshop @ ECCV 2026 — dataset facebook/wearable-aiEgocentric head-mounted wearable-camera recordings of everyday activities (Meta-collected; 1080p, audio-stripped, face-blurred). Val-only benchmark, 700 videos/task.
CaptainCook4D6CaptainCook4D (NeurIPS 2024 D&B) — errors in procedural cookingEgocentric (GoPro) cooking sessions of full recipes with fine-grained step + error annotations. We reuse the 10 videos already captioned in our v6 pipeline.
HowTo100M5HowTo100M (ICCV 2019) — narrated instructional web videosExocentric third-person instructional YouTube videos (how-to tutorials). No activity labels on disk — tagged here by a 1-frame Gemini-flash classification.
EgoSchema5EgoSchema (NeurIPS 2023) — long-form egocentric video QA (sourced from Ego4D)Egocentric ~3-min clips of unconstrained daily activity (from Ego4D). No activity labels on disk — tagged here by a 1-frame Gemini-flash classification.

Browse the set (46 videos)

A · Source benchmark
B · Event / scenario type
C · Task / interaction form
D · Temporal scale
E · Viewpoint
F · Environment
G · Interaction intensity
#00 Chef
procedural-taskwearable-aiproactive-assistshortegocentricindoor/stationaryhigh-manipulation
Source: Wearable-AI (Meta) — EgoProactive — proactive-assistant, decide when/what to say over streaming video
Original id: f9ab736efee50387 · 80s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egoproactive/val/f9ab736efee50387.mp4
#01 Chef
procedural-taskwearable-aiproactive-assistmediumegocentricindoor/stationaryhigh-manipulation
Source: Wearable-AI (Meta) — EgoProactive — proactive-assistant, decide when/what to say over streaming video
Original id: 9bee20d4cc3565da · 100s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egoproactive/val/9bee20d4cc3565da.mp4
#02 Chef
procedural-taskwearable-aiproactive-assistlongegocentricindoor/stationaryhigh-manipulation
Source: Wearable-AI (Meta) — EgoProactive — proactive-assistant, decide when/what to say over streaming video
Original id: 440660c9d220f05f · 251s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egoproactive/val/440660c9d220f05f.mp4
#03 Arts and Crafts
procedural-taskwearable-aiproactive-assistshortegocentricindoor/stationaryhigh-manipulation
Source: Wearable-AI (Meta) — EgoProactive — proactive-assistant, decide when/what to say over streaming video
Original id: a5281e906025a240 · 16s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egoproactive/val/a5281e906025a240.mp4
#04 Arts and Crafts
procedural-taskwearable-aiproactive-assistmediumegocentricindoor/stationaryhigh-manipulation
Source: Wearable-AI (Meta) — EgoProactive — proactive-assistant, decide when/what to say over streaming video
Original id: 94e4220d406c1cca · 103s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egoproactive/val/94e4220d406c1cca.mp4
#05 Handyman
procedural-taskwearable-aiproactive-assistlongegocentricindoor/stationaryhigh-manipulation
Source: Wearable-AI (Meta) — EgoProactive — proactive-assistant, decide when/what to say over streaming video
Original id: e154915e636fc23f · 266s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egoproactive/val/e154915e636fc23f.mp4
#06 Handyman
procedural-taskwearable-aiproactive-assistshortegocentricindoor/stationaryhigh-manipulation
Source: Wearable-AI (Meta) — EgoProactive — proactive-assistant, decide when/what to say over streaming video
Original id: b00c7a882446587f · 46s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egoproactive/val/b00c7a882446587f.mp4
#07 Tutorial
instructional-demowearable-aiproactive-assistmediumegocentricindoor/stationarylow/observational
Source: Wearable-AI (Meta) — EgoProactive — proactive-assistant, decide when/what to say over streaming video
Original id: 49b376b461bb8876 · 100s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egoproactive/val/49b376b461bb8876.mp4
#08 Tutorial
instructional-demowearable-aiproactive-assistlongegocentricindoor/stationarylow/observational
Source: Wearable-AI (Meta) — EgoProactive — proactive-assistant, decide when/what to say over streaming video
Original id: 6ce4e634e6294692 · 256s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egoproactive/val/6ce4e634e6294692.mp4
#09 Tutorial
instructional-demowearable-aiproactive-assistshortegocentricindoor/stationarylow/observational
Source: Wearable-AI (Meta) — EgoProactive — proactive-assistant, decide when/what to say over streaming video
Original id: cc4ac34272e4c3e4 · 29s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egoproactive/val/cc4ac34272e4c3e4.mp4
#10 Cooking
procedural-taskwearable-aiconversational-QAshortegocentricindoor/stationaryhigh-manipulation
Source: Wearable-AI (Meta) — EgoConv — multi-turn conversational QA grounded in the video
Original id: 4cdb8d625619386f · 81s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egoconv/val/4cdb8d625619386f.mp4
#11 Sightseeing
excursion-travelwearable-aiconversational-QAmediumegocentricoutdoor/locomotionlow/observational
Source: Wearable-AI (Meta) — EgoConv — multi-turn conversational QA grounded in the video
Original id: 89da98922957d8ff · 103s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egoconv/val/89da98922957d8ff.mp4
#12 Tourism
excursion-travelwearable-aiconversational-QAlongegocentricoutdoor/locomotionlow/observational
Source: Wearable-AI (Meta) — EgoConv — multi-turn conversational QA grounded in the video
Original id: 0bdbf1f4696f054f · 254s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egoconv/val/0bdbf1f4696f054f.mp4
#13 Shopping
shopping-errandwearable-aiconversational-QAshortegocentricindoor/stationarylow/observational
Source: Wearable-AI (Meta) — EgoConv — multi-turn conversational QA grounded in the video
Original id: 6de3fc66543533fa · 42s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egoconv/val/6de3fc66543533fa.mp4
#14 DailyActivities
daily-routinewearable-aiconversational-QAmediumegocentricindoor/stationarylow/observational
Source: Wearable-AI (Meta) — EgoConv — multi-turn conversational QA grounded in the video
Original id: 13b5a5f93d33d93a · 101s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egoconv/val/13b5a5f93d33d93a.mp4
#15 Sports
sport-performancewearable-aiconversational-QAlongegocentricoutdoor/locomotionlow/observational
Source: Wearable-AI (Meta) — EgoConv — multi-turn conversational QA grounded in the video
Original id: 84bdfd2003c046f1 · 279s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egoconv/val/84bdfd2003c046f1.mp4
#16 DanceExercise
sport-performancewearable-aiconversational-QAmediumegocentricoutdoor/locomotionlow/observational
Source: Wearable-AI (Meta) — EgoConv — multi-turn conversational QA grounded in the video
Original id: 1b6e3fb5b4f5bf9a · 108s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egoconv/val/1b6e3fb5b4f5bf9a.mp4
#17 Gardening
procedural-taskwearable-aiconversational-QAshortegocentricoutdoor/locomotionhigh-manipulation
Source: Wearable-AI (Meta) — EgoConv — multi-turn conversational QA grounded in the video
Original id: dcea581593204193 · 71s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egoconv/val/dcea581593204193.mp4
#18 Events
social-eventwearable-aiconversational-QAlongegocentricindoor/stationarylow/observational
Source: Wearable-AI (Meta) — EgoConv — multi-turn conversational QA grounded in the video
Original id: f23251d3b9037aec · 259s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egoconv/val/f23251d3b9037aec.mp4
#19 Hobbies
procedural-taskwearable-aiconversational-QAshortegocentricindoor/stationaryhigh-manipulation
Source: Wearable-AI (Meta) — EgoConv — multi-turn conversational QA grounded in the video
Original id: 1e719746365c0af7 · 82s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egoconv/val/1e719746365c0af7.mp4
#20 Daily Activities
daily-routinewearable-ailong-MCQmediumegocentricindoor/stationarylow/observational
Source: Wearable-AI (Meta) — EgoLongQA — long-form 4-way multiple-choice QA over a single long clip
Original id: 1f2fa2af1378221e · 131s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egolongqa/val/1f2fa2af1378221e.mp4
#21 Sightseeing
excursion-travelwearable-ailong-MCQlongegocentricoutdoor/locomotionlow/observational
Source: Wearable-AI (Meta) — EgoLongQA — long-form 4-way multiple-choice QA over a single long clip
Original id: b76d10dcd8243a01 · 558s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egolongqa/val/b76d10dcd8243a01.mp4
#22 Travel-Tourism
excursion-travelwearable-ailong-MCQlongegocentricoutdoor/locomotionlow/observational
Source: Wearable-AI (Meta) — EgoLongQA — long-form 4-way multiple-choice QA over a single long clip
Original id: a74d09fd1a2a1ab6 · 581s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egolongqa/val/a74d09fd1a2a1ab6.mp4
#23 Shopping
shopping-errandwearable-ailong-MCQlongegocentricindoor/stationarylow/observational
Source: Wearable-AI (Meta) — EgoLongQA — long-form 4-way multiple-choice QA over a single long clip
Original id: 777459a083922176 · 589s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egolongqa/val/777459a083922176.mp4
#24 Hiking-Outdoors
excursion-travelwearable-ailong-MCQlongegocentricoutdoor/locomotionlow/observational
Source: Wearable-AI (Meta) — EgoLongQA — long-form 4-way multiple-choice QA over a single long clip
Original id: aba90d4060290a87 · 598s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egolongqa/val/aba90d4060290a87.mp4
#25 Gardening
procedural-taskwearable-ailong-MCQlongegocentricoutdoor/locomotionhigh-manipulation
Source: Wearable-AI (Meta) — EgoLongQA — long-form 4-way multiple-choice QA over a single long clip
Original id: ef75ac3d92198596 · 600s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egolongqa/val/ef75ac3d92198596.mp4
#26 Pets, social gatherings with friends and family
social-eventwearable-ailong-MCQlongegocentricoutdoor/locomotionlow/observational
Source: Wearable-AI (Meta) — EgoLongQA — long-form 4-way multiple-choice QA over a single long clip
Original id: ef51015464812b8c · 555s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egolongqa/val/ef51015464812b8c.mp4
#27 Outdoor Activities and Sports
sport-performancewearable-ailong-MCQlongegocentricoutdoor/locomotionlow/observational
Source: Wearable-AI (Meta) — EgoLongQA — long-form 4-way multiple-choice QA over a single long clip
Original id: 7c8b228dd61b135f · 600s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egolongqa/val/7c8b228dd61b135f.mp4
#28 Fashion Advice
daily-routinewearable-ailong-MCQlongegocentricindoor/stationarylow/observational
Source: Wearable-AI (Meta) — EgoLongQA — long-form 4-way multiple-choice QA over a single long clip
Original id: 5e1ba77a7f73c84d · 600s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egolongqa/val/5e1ba77a7f73c84d.mp4
#29 Events
social-eventwearable-ailong-MCQlongegocentricindoor/stationarylow/observational
Source: Wearable-AI (Meta) — EgoLongQA — long-form 4-way multiple-choice QA over a single long clip
Original id: 8812f05ea4220629 · 589s
Path: /gpfs/scrubbed/jxb1st/wearable-ai/egolongqa/val/8812f05ea4220629.mp4
#30 Cooking (Cooking)
procedural-taskcaptaincook4dprocedural-manipulationlongegocentricindoor/stationaryhigh-manipulation
Source: CaptainCook4D — One full recipe execution per video (distinct recipe IDs)
Original id: 10_6 · 328s
Path: /gpfs/scrubbed/jxb1st/captaincook4d_videos/360p/10_6.mp4
#31 Cooking (Cooking)
procedural-taskcaptaincook4dprocedural-manipulationlongegocentricindoor/stationaryhigh-manipulation
Source: CaptainCook4D — One full recipe execution per video (distinct recipe IDs)
Original id: 12_2 · 429s
Path: /gpfs/scrubbed/jxb1st/captaincook4d_videos/360p/12_2.mp4
#32 Cooking (Cooking)
procedural-taskcaptaincook4dprocedural-manipulationlongegocentricindoor/stationaryhigh-manipulation
Source: CaptainCook4D — One full recipe execution per video (distinct recipe IDs)
Original id: 7_1 · 541s
Path: /gpfs/scrubbed/jxb1st/captaincook4d_videos/360p/7_1.mp4
#33 Cooking (Cleaning & Chores)
procedural-taskcaptaincook4dprocedural-manipulationlongegocentricindoor/stationaryhigh-manipulation
Source: CaptainCook4D — One full recipe execution per video (distinct recipe IDs)
Original id: 3_2 · 658s
Path: /gpfs/scrubbed/jxb1st/captaincook4d_videos/360p/3_2.mp4
#34 Cooking (Cooking)
procedural-taskcaptaincook4dprocedural-manipulationlongegocentricindoor/stationaryhigh-manipulation
Source: CaptainCook4D — One full recipe execution per video (distinct recipe IDs)
Original id: 4_2 · 775s
Path: /gpfs/scrubbed/jxb1st/captaincook4d_videos/360p/4_2.mp4
#35 Cooking (Cleaning & Chores)
procedural-taskcaptaincook4dprocedural-manipulationlongegocentricindoor/stationaryhigh-manipulation
Source: CaptainCook4D — One full recipe execution per video (distinct recipe IDs)
Original id: 5_2 · 820s
Path: /gpfs/scrubbed/jxb1st/captaincook4d_videos/360p/5_2.mp4
#36 Arts & Crafts
procedural-taskhowto100minstructional-tutoriallongexocentricindoor/stationaryhigh-manipulation
Source: HowTo100M — Instructional tutorial clip
Original id: Z-37OnNZpS4 · 261s
Path: /gpfs/scrubbed/jxb1st/howto100m_egoschema_temp_data/howto100m/Z-37OnNZpS4.mp4
#37 Cooking
procedural-taskhowto100minstructional-tutoriallongexocentricindoor/stationaryhigh-manipulation
Source: HowTo100M — Instructional tutorial clip
Original id: ap8KnA30ttU · 286s
Path: /gpfs/scrubbed/jxb1st/howto100m_egoschema_temp_data/howto100m/ap8KnA30ttU.mp4
#38 DIY & Home Repair
procedural-taskhowto100minstructional-tutorialmediumexocentricindoor/stationaryhigh-manipulation
Source: HowTo100M — Instructional tutorial clip
Original id: iluOswaVEd4 · 234s
Path: /gpfs/scrubbed/jxb1st/howto100m_egoschema_temp_data/howto100m/iluOswaVEd4.mp4
#39 Education & Hobbies
instructional-demohowto100minstructional-tutorialmediumexocentricindoor/stationaryhigh-manipulation
Source: HowTo100M — Instructional tutorial clip
Original id: hn5BXeTVqYI · 182s
Path: /gpfs/scrubbed/jxb1st/howto100m_egoschema_temp_data/howto100m/hn5BXeTVqYI.mp4
#40 Food & Drink (non-cooking)
instructional-demohowto100minstructional-tutorialmediumexocentricindoor/stationarylow/observational
Source: HowTo100M — Instructional tutorial clip
Original id: S77te5xuja0 · 188s
Path: /gpfs/scrubbed/jxb1st/howto100m_egoschema_temp_data/howto100m/S77te5xuja0.mp4
#41 Arts & Crafts
procedural-taskegoschemaunconstrained-egocentricmediumegocentricindoor/stationaryhigh-manipulation
Source: EgoSchema — Unconstrained egocentric 3-min clip
Original id: 0293f655-83c1-40a2-886d-7ff2aa555ee2 · 180s
Path: /gpfs/scrubbed/jxb1st/howto100m_egoschema_temp_data/egoschema/0293f655-83c1-40a2-886d-7ff2aa555ee2.mp4
#42 Cleaning & Chores
daily-routineegoschemaunconstrained-egocentricmediumegocentricindoor/stationaryhigh-manipulation
Source: EgoSchema — Unconstrained egocentric 3-min clip
Original id: 04d0e8d5-de94-4f28-b9c7-f58e3f83aea2 · 180s
Path: /gpfs/scrubbed/jxb1st/howto100m_egoschema_temp_data/egoschema/04d0e8d5-de94-4f28-b9c7-f58e3f83aea2.mp4
#43 Cooking
procedural-taskegoschemaunconstrained-egocentricmediumegocentricindoor/stationaryhigh-manipulation
Source: EgoSchema — Unconstrained egocentric 3-min clip
Original id: 00594c2d-1c89-47ec-aa3f-1c560cab3d26 · 180s
Path: /gpfs/scrubbed/jxb1st/howto100m_egoschema_temp_data/egoschema/00594c2d-1c89-47ec-aa3f-1c560cab3d26.mp4
#44 DIY & Home Repair
procedural-taskegoschemaunconstrained-egocentricmediumegocentricindoor/stationaryhigh-manipulation
Source: EgoSchema — Unconstrained egocentric 3-min clip
Original id: 0461a8c2-dd83-4083-acc5-7c797f696d27 · 180s
Path: /gpfs/scrubbed/jxb1st/howto100m_egoschema_temp_data/egoschema/0461a8c2-dd83-4083-acc5-7c797f696d27.mp4
#45 Education & Hobbies
instructional-demoegoschemaunconstrained-egocentricmediumegocentricindoor/stationaryhigh-manipulation
Source: EgoSchema — Unconstrained egocentric 3-min clip
Original id: 059f271d-c302-462d-bfad-2d7fee1c0c02 · 180s
Path: /gpfs/scrubbed/jxb1st/howto100m_egoschema_temp_data/egoschema/059f271d-c302-462d-bfad-2d7fee1c0c02.mp4