Qwen1.5 72B Chat

Name: Qwen1.5 72B Chat
Author: Alibaba

Alibaba · 2024-02-04 · 72.3B parameters

Qwen1.5-72B-Chat is Alibaba's chat-tuned 72B model from the Qwen1.5 family, aligned for direct conversational use on top of the Qwen1.5-72B base checkpoint.

Benchmark scores

Benchmark	Score
AlpacaEval 2.0 (length-controlled win rate)	36.6
AlpacaEval 2.0 (raw win rate)	26.5
Arena Text — Business, Management & Financial Ops (No Style Control)	1117
Arena Text — Chinese (No Style Control)	1186
Arena Text — Creative Writing (No Style Control)	1137
Arena Text — English (No Style Control)	1186
Arena Text — Entertainment, Sports & Media (No Style Control)	1125
Arena Text — Exclude Ties (No Style Control)	1032
Arena Text — Exclude Ties (Style Controlled)	1128
Arena Text — Expert (No Style Control)	1136
Arena Text — French (No Style Control)	1159
Arena Text — French (Style Controlled)	1237
Arena Text — German (No Style Control)	1084
Arena Text — Hard Prompts (No Style Control)	1148
Arena Text — Hard Prompts English (No Style Control)	1162
Arena Text — Instruction Following (No Style Control)	1141
Arena Text — Japanese (No Style Control)	1061
Arena Text — Korean (No Style Control)	1049
Arena Text — Legal & Government (No Style Control)	1173
Arena Text — Life, Physical & Social Science (No Style Control)	1158
Arena Text — Longer Query (No Style Control)	1157
Arena Text — Medicine & Healthcare (No Style Control)	1136
Arena Text — Multi-turn (No Style Control)	1160
Arena Text — Non-English (No Style Control)	1135
Arena Text — Non-English (Style Controlled)	1205
Arena Text — Occupational Mathematical (No Style Control)	1172
Arena Text — Russian (No Style Control)	1104
Arena Text — Software & IT Services (No Style Control)	1161
Arena Text — Spanish (No Style Control)	1110
Arena Text — Writing, Literature & Language (No Style Control)	1159