MBPP+
Code · 2023-05-02
MBPP+ is an extended-test version of the MBPP code-generation benchmark. It measures pass@1 with stricter test suites than the original MBPP.
Top models (higher is better)
| Model | Score |
|---|---|
| Ternary Bonsai 2 27B (GGUF) | 83.1 |
Benchmarks
252 sources · 1,069 models × 2,256 benchmarks · 113,799 scoresCode · 2023-05-02
MBPP+ is an extended-test version of the MBPP code-generation benchmark. It measures pass@1 with stricter test suites than the original MBPP.
| Model | Score |
|---|---|
| Ternary Bonsai 2 27B (GGUF) | 83.1 |