OpenBookQA
AI benchmark results and model performance
Type: percentageGeneral
Recorded results
5
Average score
77.56%
Score range
60.60% - 89.60%
Leading model
89.60% - Phi 3.5 MoE instruct
Scores over time
Individual benchmark scores plotted by date.
Model results
| Organisation | Models | Reported | Top score | Info | Self reported | Source |
|---|---|---|---|---|---|---|
| Phi 3.5 MoE instruct | 23 Aug 2024 | 89.60% | - | Yes | Source | |
| Phi 3 Mini 128K Instruct | - | 79.20% | inferred family alias from phi-3.5-mini-instruct (score=0.3533; benches=31) | Yes | Source | |
| Phi 3.5 mini instruct | 23 Aug 2024 | 79.20% | - | Yes | Source | |
| Phi 4 Mini | 01 Feb 2025 | 79.20% | - | Yes | Source | |
| Mistral Nemo 12B | 18 Jul 2024 | 60.60% | inferred family alias from mistral-nemo-instruct-2407 (score=0.3250; benches=8) | Yes | Source |