Flan-T5 Small
Google · 2022-10-20 · 77M parameters
Flan-T5 Small is the smallest instruction-finetuned T5 v1.1 checkpoint from Google's 2022 FLAN scaling work, an 8-layer-per-stack encoder-decoder released as open weights. It applies the same broad instruction tuning, including chain-of-thought data, as the larger Flan-T5 checkpoints; the paper rounds its size to 80M parameters, while the released checkpoint holds 76,961,152.
Benchmark scores
| Benchmark | Score |
|---|---|
| BBH (BIG-Bench Hard) | 19.2 |
| MGSM | 0.2 |
| MMLU | 28.7 |