← All models

ERNIE 4.5 21B A3B

Baidu · 2025-06-30 · 21.9B parameters

ERNIE 4.5 21B A3B is Baidu's PaddlePaddle-format checkpoint for the post-trained, non-thinking text MoE in the ERNIE 4.5 family. Baidu describes the model as having about 21B total parameters and 3B activated per token; its MoE layers route each token to six of 64 text experts alongside two shared experts and it supports a 131,072-token context under Apache 2.0.

Benchmark scores