← All models

GPT-2 (355M)

OpenAI · 2019-05-03 · 355M parameters

GPT-2 (355M) is the second GPT-2 variant, released in May 2019 as the next step of OpenAI's staged release (announced in the "GPT-2 Interim Update, May 2019" section of the original GPT-2 post). It is a 24-layer decoder-only transformer trained on WebText; the GPT-2 paper lists it as 345M, a count OpenAI later corrected to 355M.

Benchmark scores