ProGen3 model and training scale
Evidence you can use
ProGen3 model and training scale
2025 report snapshot
| Measure | Reported value | Definition and source |
|---|---|---|
| Largest model | 46B parameters | Mixture-of-experts protein language model2025 report, slide 63 (PDF page 64) |
| Training tokens | 1.5 trillion | Total tokens used in training2025 report, slide 63 (PDF page 64) |
| PPA-1 dataset | 3.4 billion full-length proteins | Reported dataset composition2025 report, slide 63 (PDF page 64) |
Model size, training tokens, and dataset size are distinct quantities. These values describe the reported research system; they do not establish clinical efficacy or imply that every generated protein works in an experiment.
Sources and dates
Historical snapshot published October 9, 2025. This web edition was prepared on October 10, 2026 from the online deck and original launch posts. Findings and forecasts retain their original time frame.
- 2025 report, slide 33 (PDF page 34)Original 2025 report. Slide numbers printed in the deck are one lower than PDF page numbers because the cover is unnumbered.
- 2025 report, slide 54 (PDF page 55)Original 2025 report. Slide numbers printed in the deck are one lower than PDF page numbers because the cover is unnumbered.
- 2025 report, slide 55 (PDF page 56)Original 2025 report. Slide numbers printed in the deck are one lower than PDF page numbers because the cover is unnumbered.
- 2025 report, slide 63 (PDF page 64)Original 2025 report. Slide numbers printed in the deck are one lower than PDF page numbers because the cover is unnumbered.
- 2025 report, slide 64 (PDF page 65)Original 2025 report. Slide numbers printed in the deck are one lower than PDF page numbers because the cover is unnumbered.
- State of AI Report 2025: online slides
- Nathan Benaich: The State of AI Report 2025Air Street Press, October 9, 2025.
- Welcome to State of AI Report 2025Original website launch post, October 9, 2025.
Cite this page
Benaich, Nathan. “ProGen3 model and training scale.” State of AI Report 2025. Historical report snapshot; web edition prepared 2026-10-10.