Unseen tasks in Skild’s internal evaluation
Selected evidence from the State of AI Report 2026, with the period, source, and definitions needed to interpret it.
Evidence you can use
Unseen tasks in Skild’s internal evaluation
S1 release, 2026
| How the task is specified | Cumulative per-step success |
|---|---|
| Language-prompted baselineSource | 9% |
| Video demonstration in contextSource | 66% |
Company-reported results at 100,000 hours of pre-training, using the same data and compute. The metric is cumulative per-step success across tasks. Human intervention was used to recover from failures during rollouts. These percentages are not end-to-end autonomous task completion rates.
Sources: Skild AI: Introducing S1.
Sources and dates
2026 report snapshot. Preview revised 2026-10-07. Individual data periods and source checks are listed below. This is not a claim that every source was updated on that date.
- Skild AI: Introducing S12026 release. Primary source checked 2026-10-07.
- Wayve: GAIA-42026. Retained from the launch essay.
- Odyssey: Introducing Odyssey-32026. Retained from the launch essay.
- State of AI Report 2026, slide 56: Teaching robots requires data about how to act2026 report snapshot. Read against the report PDF on 2026-10-07. Study-specific limits retained.
- State of AI Report 2026, slide 57: For π0.7, context makes imperfect robot data useful2026 report snapshot. Read against the report PDF on 2026-10-07. Study-specific limits retained.
- State of AI Report 2026, slide 58: A robot turns five minutes of play into reusable skills2026 report snapshot. Read against the report PDF on 2026-10-07. Study-specific limits retained.
- State of AI Report 2026, slide 60: With a longer memory, a robot can improve long-horizon task completion2026 report snapshot. Read against the report PDF on 2026-10-07. Study-specific limits retained.
- State of AI Report 2026, slide 61: Simulation is a bedrock of robotic reality2026 report snapshot. Read against the report PDF on 2026-10-07. Study-specific limits retained.
- State of AI Report 2026, slide 62: A humanoid learns stair climbing in four hours of simulation2026 report snapshot. Read against the report PDF on 2026-10-07. Study-specific limits retained.
- State of AI Report 2026, slide 145: One year on: Waymo tripled to 220M rider-only miles and serves 500k rides a week2026 report snapshot. Read against the report PDF on 2026-10-07. Study-specific limits retained.
Cite this page
Benaich, Nathan. “Unseen tasks in Skild’s internal evaluation.” State of AI Report 2026. Published 2026-10-08.