MedMCQA
Health & Medicine · 2022-03-27
MedMCQA is a four-option multiple-choice medical question-answering dataset built from Indian postgraduate medical entrance examinations (AIIMS and NEET PG) across 21 subjects. Results are reported on the 4,183-question development split, because test labels are withheld, as answer accuracy; the Open Medical-LLM leaderboard's harness-specific results are kept separately. Higher is better.
Top models (higher is better)
| Model | Score |
|---|---|
| o3 | 83.3 |
| Gemini 2.5 Pro | 81.1 |
| Gemini 2.5 Flash | 79.7 |
| GPT-4o (source unspecified) | 76.1 |
| MedGemma 27B Text IT | 74.2 |
| MedGemma 27B IT | 70.2 |
| Gemma 3 27B IT | 62.6 |
| MedGemma 1.5 4B IT | 59.8 |
| MedGemma 4B IT | 55.7 |
| Gemma 3 4B IT | 45.4 |