Flan-T5 Large
Google · 2022-10-20 · 783M parameters
Flan-T5 Large is the instruction-finetuned T5 v1.1 Large checkpoint from Google's 2022 FLAN scaling work, a 24-layer-per-stack encoder-decoder released as open weights. It applies the same broad instruction tuning, including chain-of-thought data, as the other Flan-T5 checkpoints; the paper rounds its size to 780M parameters, while the released checkpoint holds 783,150,080.
Benchmark scores
| Benchmark | Score |
|---|---|
| BBH (BIG-Bench Hard) | 31.5 |
| MGSM | 0.7 |
| MMLU | 45.1 |