Atlas

Models

← All models

Flan-T5 Small

Google · 2022-10-20 · 77M parameters

Flan-T5 Small is the smallest instruction-finetuned T5 v1.1 checkpoint from Google's 2022 FLAN scaling work, an 8-layer-per-stack encoder-decoder released as open weights. It applies the same broad instruction tuning, including chain-of-thought data, as the larger Flan-T5 checkpoints; the paper rounds its size to 80M parameters, while the released checkpoint holds 76,961,152.

Benchmark scores

BenchmarkScore
BBH (BIG-Bench Hard)19.2
MGSM0.2
MMLU28.7
Loading Atlas data…