WMT23
AI benchmark results and model performance
Type: percentageHealthcare
Recorded results
13
Average score
73.58%
Score range
71.70% - 75.10%
Leading model
75.10% - Gemini 1.5 Pro 001
Scores over time
Individual benchmark scores plotted by date.
Model results
| Organisation | Models | Reported | Top score | Info | Self reported | Source |
|---|---|---|---|---|---|---|
| Gemini 1.5 Pro 001 | 23 May 2024 | 75.10% | inferred alias from gemini-1.5-pro | Yes | Source | |
| Gemini 1.5 Pro Exp (2024-08-01) | 01 Aug 2024 | 75.10% | inferred alias from gemini-1.5-pro | Yes | Source | |
| Gemini 1.5 Pro Exp (2024-08-27) | 27 Aug 2024 | 75.10% | inferred alias from gemini-1.5-pro | Yes | Source | |
| Gemini Robotics ER 1.5 Preview | 25 Sept 2025 | 75.10% | inferred family alias from gemini-1.5-pro (score=0.3717; benches=23) | Yes | Source | |
| LearnLM 1.5 Pro Experimental | 19 Nov 2024 | 75.10% | inferred family alias from gemini-1.5-pro (score=0.3700; benches=23) | Yes | Source | |
| Gemini 1.5 Flash 001 | 23 May 2024 | 74.10% | inferred alias from gemini-1.5-flash | Yes | Source | |
| Gemini 1.5 Flash Preview | 14 May 2024 | 74.10% | inferred alias from gemini-1.5-flash | Yes | Source | |
| Gemini 1.5 Flash 8B | 15 Mar 2024 | 72.60% | - | Yes | Source | |
| Gemini 1.5 Flash 8B Exp (2024-08-27) | 27 Aug 2024 | 72.60% | inferred alias from gemini-1.5-flash-8b | Yes | Source | |
| Gemini 1.5 Flash 8B Exp (2024-09-24) | 24 Sept 2024 | 72.60% | inferred alias from gemini-1.5-flash-8b | Yes | Source | |
| Gemini 1.0 Nano | 06 Dec 2023 | 71.70% | inferred modality/version alias from gemini-1.0-pro | No | Source | |
| Gemini 1.0 Pro | 06 Dec 2023 | 71.70% | - | No | Source | |
| Gemini 1.0 Pro Vision 001 | 15 Feb 2024 | 71.70% | inferred modality/version alias from gemini-1.0-pro | No | Source |
