K2 Horizon MoVA 36B A4B
LLM360 · 37.4B parameters
The Institute of Foundation Models' K2 Horizon MoVA sparse language model, with native 524,288-token context and request-level reasoning effort controls, published through the K2/LLM360 program. Its complete BF16 checkpoint contains 37,444,792,020 parameters; the card reports approximately 4B active parameters per token.