The largest disclosed training set behind any robot foundation model — Physical Intelligence's π0 — holds just over 10,000 hours of robot data, and Goldman Sachs estimates leading humanoid programs have accumulated roughly 500,000 hours. Set that against the 15 trillion tokens of text behind Llama 3, and the defining constraint of embodied AI in 2026 is obvious: robot demonstrations are the scarcest input in AI. Figure trained a full humanoid upper-body controller on ~500 hours; NVIDIA pretrained GR00T N1 on 88 real hours stretched tenfold with synthetic data. We aggregated data from arXiv papers (Open X-Embodiment, DROID, π0, GR00T N1), official reports from NVIDIA, Figure, Google DeepMind and Physical Intelligence, market research from Mordor Intelligence and Grand View Research, and dozens of other primary sources — 56 verified statistics in total.
Key Takeaways
- 10,000+ hours — π0's robot training corpus (903M timesteps, 7 robot configurations, 68 tasks), the largest disclosed behind any robot foundation model (Physical Intelligence, π0 paper 2024)
- 15T tokens vs ~2,000 hours — Llama 3's text corpus dwarfs Open X-Embodiment, the largest open robot dataset at 1M+ trajectories from 22 robot types (Meta AI 2024; Open X-Embodiment 2023)
- ~500 hours — teleoperation data behind Figure's Helix, under 5% of earlier VLA dataset sizes, controlling 35 DoF at 200 Hz (Figure, Helix 2025)
- 2,976.4 hours — AgiBot World Beta: 1M+ trajectories from a dedicated fleet of 100 robots across 217 tasks and 3,000+ objects (AgiBot 2025)
- 50 collectors, 12 months — what it took to gather DROID's 350 hours of robot interaction data across three continents (DROID, arXiv 2024)
- 88 → 827 hours — GR00T N1's real teleoperation data, expanded ~10x with model-generated neural trajectories (NVIDIA, GR00T N1 2025)
- 6,500 hours in 11 hours — DexMimicGen generated 780,000 simulation trajectories, nine months of human-demonstration equivalent (NVIDIA, GR00T N1 2025)
- Power law — robot policy generalization scales with environment and object diversity; 4 collectors working one afternoon reached ~90% success in novel environments (Data Scaling Laws, arXiv 2024)
- ≤100 demonstrations — 15 minutes to 1 hour of data now adapts Gemini Robotics to a new task at over 70% success (Google DeepMind 2025)
- 20M hours / 9,000T tokens — the real-world video corpus behind NVIDIA's Cosmos world foundation models (NVIDIA 2025)
- $2.67B → $10.92B — the data collection and labeling market from 2026 to 2031, a 32.59% CAGR (Mordor Intelligence 2026)
- 100,000+ residential units — the Brookfield footprint feeding Figure's Project Go-Big, the largest humanoid pretraining dataset built from human video (Figure 2025)
01The Data Bottleneck: Robot Demonstrations vs Internet-Scale Text
Language models read the internet; robots cannot. Every robot demonstration has to be produced physically — by a teleoperator, a suited human, or a simulator — so the biggest robot datasets are measured in thousands of hours while text corpora are measured in trillions of tokens. As Figure puts it, you cannot scrape the internet for robot data.
| Metric | Value | Source |
|---|---|---|
| Text tokens used to pretrain Llama 3 | 15T+ | Meta AI, Llama 3 launch 2024 |
| Llama 3 dataset vs Llama 2 | 7x larger | Meta AI, Llama 3 launch 2024 |
| Video behind NVIDIA Cosmos world models | 20M hours | NVIDIA, Cosmos launch 2025 |
| Largest open robot dataset (Open X-Embodiment) | 1M+ traj (~2,000 hrs) | Open X-Embodiment 2023; AgiBot comparison 2025 |
| Training data held by leading humanoid companies | ~500,000 hrs | Goldman Sachs via Bloomberg, July 2026 |
| Data companies say they need for capable humanoid models | Tens of millions of hrs | Bloomberg, July 2026 |
Note: Open X-Embodiment is published in trajectories, not hours; the ~2,000-hour estimate comes from AgiBot World's published comparison.
02Training Data Behind Major Robot Foundation Models
Disclosed training corpora span two orders of magnitude — from GR00T N1's 88 real hours to π0's 10,000+. The spread shows there is no settled recipe yet: Helix bets on data efficiency, π0 on volume, Gemini Robotics on a year of fleet-scale ALOHA 2 collection. For model capability numbers behind these datasets, see our vision-language-action model statistics.
| Model or dataset | Real-robot training hours |
|---|---|
| GR00T N1 in-house teleoperation (NVIDIA) | 88 hours |
| DROID open dataset | 350 hours |
| π0.5 mobile manipulation data (Physical Intelligence) | About 400 hours |
| Helix (Figure) | About 500 hours |
| Open X-Embodiment (estimated) | About 2,000 hours |
| AgiBot World Beta | 2,976 hours |
| π0 (Physical Intelligence) | More than 10,000 hours |
| Metric | Value | Source |
|---|---|---|
| π0 total robot training data | 10,000+ hrs / 903M steps | Physical Intelligence, π0 paper 2024 |
| π0 robot configurations / tasks | 7 configs / 68 tasks | Physical Intelligence, π0 paper 2024 |
| Helix teleoperation dataset | ~500 hrs (<5% of prior) | Figure, Helix 2025 |
| GR00T N1 in-house real teleoperation data | 88 hrs | NVIDIA, GR00T N1 paper 2025 |
| Gemini Robotics action dataset | 1,000s of hrs / 12 months | Google DeepMind, Gemini Robotics 2025 |
| π0.5 mobile-manipulation data | ~400 hrs / ~100 homes | Physical Intelligence, π0.5 paper 2025 |
| RT-1 dataset (historical baseline) | 130k eps / 13 robots / 17 mo | Google Research, RT-1 2022 |
| OpenVLA training set / compute | 970k demos / 21,500 A100-hrs | OpenVLA, arXiv 2024 |
| π0 pre-training mixture from open-source datasets | 9.1% | Physical Intelligence, π0 paper 2024 |
Note: RT-1 figures (2022) are included as the historical baseline that Open X-Embodiment and later VLA models built on.
03The Open Dataset Landscape
The public corpus changed in composition, not just size: 2024–2026 additions skew toward humanoid, bimanual, and egocentric-video data rather than more single-arm pick-and-place. Failure data now ships deliberately — RoboMIND includes 5,000 labeled failure demonstrations. Open sets remain research-licensed in several cases, which is why commercial teams pair them with in-house collection or purpose-built real-world data production.
| Dataset | Scale | Source |
|---|---|---|
| Open X-Embodiment | 1M+ traj / 22 robots / 527 skills | OXE Collaboration, arXiv 2023 |
| Open X-Embodiment contributors | 60 datasets / 34 labs | OXE project site 2023 |
| DROID | 76k traj / 350 hrs / 564 scenes | DROID, arXiv 2024 |
| BridgeData V2 | 60,096 traj / 24 environments | UC Berkeley et al., arXiv 2023 |
| AgiBot World Beta | 1M+ traj / 2,976.4 hrs / 217 tasks | AgiBot World dataset card 2025 |
| RoboMIND | 107k traj / 479 tasks / 4 robots | RoboMIND, arXiv 2024 |
| RoboMIND 2.0 | 310k+ traj / 739 tasks / 6 robots | RoboMIND 2.0, arXiv 2026 |
| Ego4D (human egocentric video) | 3,670 hrs / 931 wearers / 9 countries | Meta AI et al., arXiv 2022 |
04What Demonstration Data Costs to Collect
The honest unit economics of teleoperation: skilled human time, robot fleet time, and calendar months. DROID's 350 hours consumed 50 collectors for a year; Tesla pays up to $48/hour for suited data operators. The counterweight is fine-tuning efficiency — 15 minutes to an hour of demonstrations now adapts a pretrained generalist to a new task. We break the collection side down further in our teleoperation and demonstration data statistics, and the same spec → pilot → scale logic drives how production data engagements are typically structured.
| Metric | Value | Source |
|---|---|---|
| Tesla Optimus data-operator pay (2024 listing) | Up to $48/hr | Tesla listing, reported 2024 |
| Effort behind DROID's 350 hours | 50 collectors / 12 months | DROID, arXiv 2024 |
| π0 fine-tuning data per downstream task | 5 hrs → 100+ hrs | Physical Intelligence, π0 paper 2024 |
| Gemini Robotics adaptation to a new task | ≤100 demos → >70% success | Google DeepMind, Gemini Robotics 2025 |
| Curated demos per specialized long-horizon task | 2,000–5,000 episodes | Google DeepMind, Gemini Robotics 2025 |
| Mobile ALOHA co-training effect | 50 demos, success +90% max | Stanford, Mobile ALOHA 2024 |
| Data for ~90% success in novel environments | 4 collectors, one afternoon | Data Scaling Laws, arXiv 2024 |
| Robot-data collection centers in China | 64 open + 20 building | Interact Analysis via Bloomberg 2026 |
Note: per-hour data prices published on SEO blogs could not be traced to any primary source and were excluded from this article.
05Real, Synthetic, and Human-Video Data Mix
2025–2026 pipelines treat real teleoperation as the scarce top of a pyramid and multiply it: GR00T N1 stretched 88 real hours to 827 with generated neural trajectories, and DexMimicGen minted nine months of demonstration-equivalents in 11 hours. The other frontier is human video — Apple's EgoDex and Figure's Brookfield partnership turn people, not robots, into the sensor, using head-mounted and stereo egocentric capture hardware instead of robot fleets.
| Metric | Value | Source |
|---|---|---|
| GR00T N1 real-data expansion (neural trajectories) | 88 → 827 hrs (~10x) | NVIDIA, GR00T N1 paper 2025 |
| DexMimicGen synthetic generation | 780k traj = 6,500 hrs in 11 hrs | NVIDIA, GR00T N1 paper 2025 |
| Compute for 827 hrs of neural trajectories | ~105k L40 GPU-hrs | NVIDIA, GR00T N1 paper 2025 |
| GR00T N1.5 built with GR00T-Dreams synthetic data | 36 hrs vs ~3 months | NVIDIA newsroom 2025 |
| NVIDIA Cosmos training corpus | 9,000T tokens / 20M hrs video | NVIDIA, Cosmos 2025 |
| Video curation speedup (NeMo Curator on Blackwell) | 20M hrs in 14 days vs 3+ yrs CPU | NVIDIA newsroom 2025 |
| EgoDex egocentric dataset (Apple Vision Pro) | 829 hrs / 194 tasks | Apple, EgoDex 2025 |
| Figure Project Go-Big footprint (Brookfield) | 100,000+ homes, 500M sq ft offices | Figure, Project Go-Big 2025 |
Note: Figure reports its humanoid learned end-to-end navigation from egocentric human video alone — no robot-specific training data.
06Data Scaling Laws for Robot Policies
The field's most useful 2024–2025 finding: generalization scales as a power law with the diversity of environments and objects, not raw demonstration count. Past a per-environment threshold, more demos of the same thing buy almost nothing — which redirects data budgets from volume to variety.
| Metric | Value | Source |
|---|---|---|
| Generalization vs environment/object diversity | Power law | Data Scaling Laws, arXiv 2024 |
| Extra demos per environment beyond threshold | Minimal effect | Data Scaling Laws, arXiv 2024 |
| Evidence base of the scaling-law study | 40k+ demos / 15k+ rollouts | Data Scaling Laws, arXiv 2024 |
| AgiBot GO-1 scaling fit (9.2k → 1M traj) | Power law, r = 0.97 | AgiBot World Colosseo 2025 |
| GO-1 gain from AgiBot World vs OXE pretraining | +30% average | AgiBot World Colosseo 2025 |
| RT-1-X vs single-dataset baselines (small data) | +50% | OXE project site 2023 |
| RT-2-X emergent-skill performance vs RT-2 | 3x | OXE project site 2023 |
| RT-2 generalization to unseen scenarios vs RT-1 | 32% → 62% | Google DeepMind, RT-2 2023 |
Note: GR00T N1 also beat a Diffusion Policy baseline by 32.4% in the 10%-data setting — pretraining compounds the value of every collected hour (NVIDIA, GR00T N1 2025).
07The Robot Data Market
Two research firms scope the money differently but agree on direction: roughly 3x–5x growth in data collection and labeling spend by the early 2030s, with synthetic generation and sensor-fusion streams growing fastest. Humanoid demand is the pull — Goldman Sachs models $38B in humanoid revenue by 2035, Morgan Stanley $5T by 2050.
| Metric | Value | Source |
|---|---|---|
| Data collection & labeling market (2025 → 2031) | $2.01B → $10.92B | Mordor Intelligence 2026 |
| AI training dataset market (2025 → 2033) | $3.2B → $16.3B (22.6% CAGR) | Grand View Research 2026 |
| Fastest-growing data type: sensor-fusion streams | 35.42% CAGR | Mordor Intelligence 2026 |
| Synthetic data generation (sourcing) growth | 36.2% CAGR | Mordor Intelligence 2026 |
| Outsourced providers' share of data sourcing | 44.78% | Mordor Intelligence 2026 |
| Humanoid robot market by 2035 | $38B / 1.4M units | Goldman Sachs Research 2024 |
| Humanoid robot market by 2050 | $5T / ~1B units | Morgan Stanley, The Humanoid 100 |
| Industrial robot installations 2024 (China vs US) | ~300,000 vs 38,000 | IFR via Bloomberg 2026 |
Note: Mordor and Grand View scope the market differently (labeling services vs training datasets), so the figures bracket the spend rather than conflict.
Summary: Robotics Training Data by the Numbers
| Metric | Value | Source |
|---|---|---|
| π0 training data | 10,000+ hrs / 903M steps | Physical Intelligence 2024 |
| Helix (Figure) training data | ~500 hrs (<5% of prior) | Figure 2025 |
| GR00T N1 real teleoperation data | 88 hrs | NVIDIA 2025 |
| Gemini Robotics action data | 1,000s of hrs / 12 months | Google DeepMind 2025 |
| Open X-Embodiment | 1M+ traj / 22 robots | OXE Collaboration 2023 |
| AgiBot World Beta | 1M+ traj / 2,976.4 hrs | AgiBot 2025 |
| DROID | 76k traj / 350 hrs | DROID 2024 |
| Ego4D human video | 3,670 hrs | Meta AI et al. 2022 |
| EgoDex (Apple Vision Pro) | 829 hrs / 194 tasks | Apple 2025 |
| Llama 3 text corpus (comparison) | 15T+ tokens | Meta AI 2024 |
| NVIDIA Cosmos video corpus | 20M hrs / 9,000T tokens | NVIDIA 2025 |
| DexMimicGen synthetic output | 780k traj (6,500 hrs) in 11 hrs | NVIDIA 2025 |
| GR00T N1.5 dev time with synthetic data | 36 hrs vs ~3 months | NVIDIA 2025 |
| Tesla data-operator pay | Up to $48/hr | Tesla listing, reported 2024 |
| Gemini Robotics fine-tuning | ≤100 demos → >70% success | Google DeepMind 2025 |
| Scaling law: novel-environment success | ~90% with 4 collectors, 1 afternoon | arXiv 2410.18647, 2024 |
| Leading humanoid programs' data holdings | ~500,000 hrs | Goldman Sachs via Bloomberg 2026 |
| China robot-data collection centers | 64 open + 20 building | Interact Analysis via Bloomberg 2026 |
| Data collection & labeling market 2031 | $10.92B (32.59% CAGR) | Mordor Intelligence 2026 |
| Humanoid robot market 2035 | $38B / 1.4M units | Goldman Sachs 2024 |
Frequently Asked Questions
How much data do robots need to train in 2026?
It depends on the layer. Pretraining a generalist robot foundation model uses thousands of hours — π0 used 10,000+ hours across 7 robot configurations (Physical Intelligence, 2024). Adapting a pretrained model to one new task now takes as little as 100 demonstrations, roughly 15 minutes to 1 hour of data, for over 70% success (Google DeepMind, Gemini Robotics 2025). Fully general humanoids are a different story: companies tell Bloomberg they need tens of millions of hours.
How big are robot training datasets compared to LLM training data?
Orders of magnitude smaller. Llama 3 pretrained on more than 15 trillion tokens of text from public sources (Meta AI, 2024), while the largest open robot dataset, Open X-Embodiment, holds about 1 million trajectories — roughly 2,000 hours of manipulation data. Robot demonstrations must be physically produced one episode at a time, which is why the gap persists.
What is the largest robot training dataset?
Among open datasets, Open X-Embodiment (1M+ trajectories from 22 robot embodiments, 2023) and AgiBot World Beta (1M+ trajectories, 2,976.4 hours from 100 robots, 2025) are the largest real-robot corpora. For video pretraining, NVIDIA Cosmos was trained on 20 million hours of real-world footage (NVIDIA, 2025). Proprietary fleets are larger still — Goldman Sachs estimates leading humanoid companies hold around 500,000 hours.
How much does robot demonstration data cost to collect?
Labor is the visible line item: Tesla advertised up to $48/hour for Optimus data-collection operators in motion-capture suits (2024 listing, widely reported). Calendar time is the hidden one — DROID's 350 hours of data took 50 collectors 12 months across three continents (DROID, 2024). That is why specialist collection fleets and dedicated data factories now exist in both the US and China, where 64 collection centers operate with 20 more under construction (Interact Analysis, 2026).
Can simulation replace real robot data?
It multiplies real data rather than replacing it. NVIDIA's DexMimicGen turned a small set of human demonstrations into 780,000 simulation trajectories — 6,500 hours of demonstration-equivalent — in 11 hours, and GR00T N1.5 was developed with synthetic data in 36 hours versus roughly three months of human collection (NVIDIA, 2025). But every published pipeline still anchors on real teleoperation data at the top of the pyramid; GR00T N1 used 88 real hours as the seed.
What are data scaling laws for robot policies?
Policy generalization improves as a power law with the number of distinct environments and objects in the training data — not with raw demonstration count (arXiv 2410.18647, 2024). Once demonstrations per environment pass a threshold, extra ones add little. AgiBot observed the same pattern at fleet scale: performance tracked trajectory count from 9.2k to 1M with a 0.97 correlation (AgiBot World, 2025). The practical rule: buy diversity, not repetition.
Methodology and Sources
This article aggregates 56 statistics from 26 primary sources: peer-reviewed and preprint research on arXiv, official company publications from NVIDIA, Figure, Physical Intelligence, Google DeepMind, Meta and Apple, market research from Mordor Intelligence and Grand View Research, and financial-press reporting of named analyst estimates. We cite the original study in every case, never a blog quoting it. Statistics that could not be traced to a primary source — including per-hour data prices circulating on AI-generated SEO sites — were excluded. The Tesla pay figure comes from a 2024 job listing that is no longer live; it is corroborated by multiple independent reports and flagged accordingly. Where two research firms size the data market differently, both figures are shown with their scope.
- Meta AI — Introducing Meta Llama 3 (2024)
- Open X-Embodiment: Robotic Learning Datasets and RT-X Models (arXiv 2310.08864, 2023)
- Open X-Embodiment project site (2023)
- DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset (arXiv 2403.12945, 2024)
- BridgeData V2 (arXiv 2308.12952, 2023)
- π0: A Vision-Language-Action Flow Model (arXiv 2410.24164, 2024)
- π0.5: A VLA with Open-World Generalization (arXiv 2504.16054, 2025)
- Figure — Helix announcement (2025)
- Figure — Project Go-Big (2025)
- NVIDIA — GR00T N1 paper (arXiv 2503.14734, 2025)
- NVIDIA Newsroom — GR00T N1.5 / GR00T-Dreams (2025)
- NVIDIA — Cosmos world foundation models (2025)
- NVIDIA Newsroom — Cosmos platform launch (2025)
- Google DeepMind — Gemini Robotics (arXiv 2503.20020, 2025)
- Google Research — RT-1 (2022)
- Google DeepMind — RT-2 announcement (2023)
- OpenVLA (arXiv 2406.09246, 2024)
- Data Scaling Laws in Imitation Learning for Robotic Manipulation (arXiv 2410.18647, 2024)
- Mobile ALOHA (arXiv 2401.02117, 2024)
- AgiBot World dataset cards (2025)
- AgiBot World Colosseo project page (2025)
- RoboMIND (arXiv 2412.13877, 2024)
- RoboMIND 2.0 (arXiv 2512.24653, 2026)
- Ego4D (arXiv 2110.07058, 2022)
- Apple — EgoDex (arXiv 2505.11709, 2025)
- Mordor Intelligence — Data Collection & Labelling Market (2026)
- Grand View Research — AI Training Dataset Market (2026)
- Goldman Sachs Research — humanoid robot forecast (2024)
- Morgan Stanley Research — The Humanoid 100 (2025)
- Bloomberg — China robot-data reporting (July 2026)
- IoT World Today — Tesla data-operator listing (2024)
Last updated July 2026. We update this page quarterly as new data becomes available.