GPT-4 0613

Name: GPT-4 0613
Author: OpenAI

OpenAI · 2023-06-13

GPT-4 0613 is OpenAI's pinned June 13, 2023 GPT-4 API snapshot, released as an updated and improved version with function calling. The hosted snapshot is text-only with an 8,192-token context window; OpenAI has not disclosed the GPT-4 family's model size or detailed architecture.

Benchmark scores

Benchmark	Score
AlpacaEval 2.0 (length-controlled win rate)	30.2
AlpacaEval 2.0 (raw win rate)	15.8
Arena Text — Business, Management & Financial Ops (No Style Control)	1122
Arena Text — Chinese (No Style Control)	1136
Arena Text — Creative Writing (No Style Control)	1191
Arena Text — English (No Style Control)	1205
Arena Text — Entertainment, Sports & Media (No Style Control)	1180
Arena Text — Exclude Ties (No Style Control)	1058
Arena Text — Exclude Ties (Style Controlled)	1187
Arena Text — Expert (No Style Control)	1128
Arena Text — French (No Style Control)	1170
Arena Text — French (Style Controlled)	1271
Arena Text — German (No Style Control)	1162
Arena Text — Hard Prompts (No Style Control)	1174
Arena Text — Hard Prompts English (No Style Control)	1188
Arena Text — Instruction Following (No Style Control)	1188
Arena Text — Japanese (No Style Control)	1114
Arena Text — Korean (No Style Control)	1060
Arena Text — Legal & Government (No Style Control)	1155
Arena Text — Life, Physical & Social Science (No Style Control)	1153
Arena Text — Longer Query (No Style Control)	1188
Arena Text — Medicine & Healthcare (No Style Control)	1123
Arena Text — Multi-turn (No Style Control)	1185
Arena Text — Non-English (No Style Control)	1160
Arena Text — Non-English (Style Controlled)	1252
Arena Text — Occupational Mathematical (No Style Control)	1201
Arena Text — Polish (No Style Control)	1219
Arena Text — Polish (Style Controlled)	1317
Arena Text — Russian (No Style Control)	1173
Arena Text — Software & IT Services (No Style Control)	1169