All topicsSTATE OF AI REPORT.

What did Llama 2 change in 2023?

It gave a broad group of developers access to capable models with commercial-use permissions subject to license conditions. Its 70B model competed with ChatGPT on many tasks, while coding remained a weakness for the general model.

What did Llama 2 change in 2023? - 2023 report, slide 19
What did Llama 2 change in 2023?. 2023 report, slide 19 (PDF page 19)

How to read this finding

Model size and corpus size are specifications, not quality scores. Comparisons in the report used different tasks and evaluators. Llama’s availability was subject to its license; small-model findings were limited to the evaluated settings.

Read the full AI progress section

Evidence you can use

AI progress in the 2023 report

Historical snapshot: October 2023. Dates and populations are specified per row.

AI progress in the 2023 report
MeasureReported valueDefinition and source
Llama 2 pretraining corpus2T tokensCorpus size reported for Llama 2, a 40% increase over its predecessor.2023 report, slide 19 (PDF page 19)
Llama 2 largest model discussed70B parametersModel compared with ChatGPT across tasks in the report.2023 report, slide 19 (PDF page 19)
phi-1 model size1.3B parametersSmall code model trained on curated code and synthetic educational material.2023 report, slide 26 (PDF page 26)

Model size and corpus size are specifications, not quality scores. Comparisons in the report used different tasks and evaluators. Llama’s availability was subject to its license; small-model findings were limited to the evaluated settings.

Sources and dates

Historical snapshot published October 12, 2023. This web edition was prepared on October 10, 2026 from the online deck and original launch posts. Findings and forecasts retain their original time frame.

  1. 2023 report, slide 12 (PDF page 12)Original 2023 report. Printed slide numbers match PDF page numbers in this edition.
  2. 2023 report, slide 19 (PDF page 19)Original 2023 report. Printed slide numbers match PDF page numbers in this edition.
  3. 2023 report, slide 26 (PDF page 26)Original 2023 report. Printed slide numbers match PDF page numbers in this edition.
  4. State of AI Report 2023: online slides
  5. Nathan Benaich: The State of AI Report 2023Air Street Press, October 12, 2023.
  6. Welcome to State of AI Report 2023Original website launch post, October 12, 2023.

Cite this page

Benaich, Nathan. “What did Llama 2 change in 2023?.” State of AI Report 2023. Historical report snapshot; web edition prepared 2026-10-10.