← All models

GPT-2 (774M)

OpenAI · 2019-08-20 · 774M parameters

GPT-2 (774M) is the third GPT-2 variant, released in August 2019 with OpenAI's six-month follow-up on the GPT-2 staged release. It is a 36-layer decoder-only transformer trained on WebText; the GPT-2 paper lists it as 762M, a count OpenAI later corrected to 774M.

Benchmark scores