Phi-3 Medium 4K Instruct
Microsoft · 2024-05-21 · 14B parameters
Phi-3 Medium 4K Instruct is Microsoft's dense 14B-class instruction-tuned language model with a 4,096-token context window and configured 2,047-token sliding-window grouped-query attention. The released checkpoint was post-trained with supervised fine-tuning and direct preference optimization for instruction following and safety; Microsoft reports an October 2023 cutoff for its offline training data. It is the short-context counterpart to Phi-3 Medium 128K Instruct.