← All models

GPT-3 13B

OpenAI · 2020-05-28

GPT-3 13B is OpenAI's approximately 13-billion-parameter GPT-3 base language model from the 2020 "Language Models are Few-Shot Learners" paper and the second-largest model in the published GPT-3 scaling series. The paper's Table 2.1 lists d_model 5140 with 40 heads of dimension 128.

Benchmark scores