Qwen1.5 14B Chat

Name: Qwen1.5 14B Chat
Author: Alibaba

Alibaba · 2024-02-04 · 14.2B parameters

Qwen1.5-14B-Chat is Alibaba's chat-tuned 14B model from the Qwen1.5 family, aligned for conversational and instruction-following tasks while retaining the 32K-context Qwen1.5 architecture.

Benchmark scores

Benchmark	Score
AlpacaEval 2.0 (length-controlled win rate)	23.9
AlpacaEval 2.0 (raw win rate)	18.6
Arena Text — Business, Management & Financial Ops (No Style Control)	1083
Arena Text — Chinese (No Style Control)	1147
Arena Text — Creative Writing (No Style Control)	1090
Arena Text — English (No Style Control)	1148
Arena Text — Entertainment, Sports & Media (No Style Control)	1068
Arena Text — Exclude Ties (No Style Control)	976
Arena Text — Exclude Ties (Style Controlled)	1066
Arena Text — Expert (No Style Control)	1094
Arena Text — French (No Style Control)	1116
Arena Text — French (Style Controlled)	1192
Arena Text — German (No Style Control)	1043
Arena Text — Hard Prompts (No Style Control)	1113
Arena Text — Hard Prompts English (No Style Control)	1123
Arena Text — Instruction Following (No Style Control)	1102
Arena Text — Japanese (No Style Control)	1019
Arena Text — Legal & Government (No Style Control)	1119
Arena Text — Life, Physical & Social Science (No Style Control)	1102
Arena Text — Longer Query (No Style Control)	1112
Arena Text — Medicine & Healthcare (No Style Control)	1105
Arena Text — Multi-turn (No Style Control)	1110
Arena Text — Non-English (No Style Control)	1095
Arena Text — Non-English (Style Controlled)	1161
Arena Text — Occupational Mathematical (No Style Control)	1136
Arena Text — Russian (No Style Control)	1046
Arena Text — Software & IT Services (No Style Control)	1140
Arena Text — Spanish (No Style Control)	1085
Arena Text — Writing, Literature & Language (No Style Control)	1112
BBH (Open LLM Leaderboard v2)	52.3