Video-MME - Long Videos with Subtitles
Multimodal · 2024-05-31
The long-duration subset of Video-MME (videos of roughly 30-60 minutes, 900 multiple-choice questions) answered with subtitles provided, as OpenAI reports it under "VideoMME (long, with subtitle category)". Scores are answer accuracy; not comparable with the overall no-subtitles Video-MME score. Higher is better.
Top models (higher is better)
| Model | Score |
|---|---|
| GPT-5 | 86.7 |
| o3 | 84.9 |
| O4 Mini | 79.5 |
| GPT-4.1 | 78.7 |
| GPT-5 Mini | 78.5 |
| GPT-4.1 Mini | 68.4 |
| GPT-5 Nano | 65.7 |
| GPT-4.1 Nano | 55.2 |