BIG-Bench Hard
Ergebnisse von KI-Benchmarks und Modellleistung
Typ: percentageLanguage
Erfasste Ergebnisse
28
Durchschnittspunktzahl
70.89%
Punktzahlbereich
44.30% - 89.20%
Führendes Modell
89.20% - Gemini 1.5 Pro 001
Punktzahlen im Zeitverlauf
Einzelne Benchmark-Punktzahlen nach Datum.
Modellergebnisse
| Organisation | Modelle | Gemeldet am | Höchste Punktzahl | Info | Selbst gemeldet | Quelle |
|---|---|---|---|---|---|---|
| Gemini 1.5 Pro 001 | 23. Mai 2024 | 89,20 % | inferred alias from gemini-1.5-pro | Ja | Quelle | |
| Gemini 1.5 Pro Exp (2024-08-01) | 01. Aug. 2024 | 89,20 % | inferred alias from gemini-1.5-pro | Ja | Quelle | |
| Gemini 1.5 Pro Exp (2024-08-27) | 27. Aug. 2024 | 89,20 % | inferred alias from gemini-1.5-pro | Ja | Quelle | |
| Gemini Robotics ER 1.5 Preview | 25. Sept. 2025 | 89,20 % | inferred family alias from gemini-1.5-pro (score=0.3717; benches=23) | Ja | Quelle | |
| LearnLM 1.5 Pro Experimental | 19. Nov. 2024 | 89,20 % | inferred family alias from gemini-1.5-pro (score=0.3700; benches=23) | Ja | Quelle | |
| Gemini 1.5 Flash 001 | 23. Mai 2024 | 85,50 % | inferred alias from gemini-1.5-flash | Ja | Quelle | |
| Gemini 1.5 Flash Preview | 14. Mai 2024 | 85,50 % | inferred alias from gemini-1.5-flash | Ja | Quelle | |
| Phi 3.5 MoE instruct | 23. Aug. 2024 | 79,10 % | - | Ja | Quelle | |
| Phi 4 Mini | 01. Feb. 2025 | 70,40 % | - | Ja | Quelle | |
| Granite 3.0 8B Instruct | - | 69,13 % | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.4911; benches=14) | Ja | Quelle | |
| Granite 3.1 8B Instruct | - | 69,13 % | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.4911; benches=14) | Ja | Quelle | |
| Granite 3.2 8B Instruct | - | 69,13 % | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.4911; benches=14) | Ja | Quelle | |
| Granite 3.2 8B Instruct Preview | - | 69,13 % | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.4687; benches=14) | Ja | Quelle | |
| Granite 3.3 2B Instruct | 16. Apr. 2025 | 69,13 % | inferred family alias from granite-3.3-8b-instruct (score=0.3627; benches=14) | Ja | Quelle | |
| Granite 3.3 8B Instruct | 16. Apr. 2025 | 69,13 % | - | Ja | Quelle | |
| Granite Guardian 3.0 8B | - | 69,13 % | inferred family alias from granite-3.3-8b-instruct (score=0.4062; benches=14) | Ja | Quelle | |
| Granite Guardian 3.1 8B | - | 69,13 % | inferred family alias from granite-3.3-8b-instruct (score=0.4062; benches=14) | Ja | Quelle | |
| Granite Guardian 3.3 8B | - | 69,13 % | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.5071; benches=14) | Ja | Quelle | |
| Granite Speech 3.2 8B | - | 69,13 % | inferred family alias from granite-3.3-8b-instruct (score=0.4062; benches=14) | Ja | Quelle | |
| Granite Speech 3.3 8B | - | 69,13 % | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.5071; benches=14) | Ja | Quelle | |
| Phi 3 Mini 128K Instruct | - | 69 % | inferred family alias from phi-3.5-mini-instruct (score=0.3533; benches=31) | Ja | Quelle | |
| Phi 3.5 mini instruct | 23. Aug. 2024 | 69 % | - | Ja | Quelle | |
| Granite 4.0 Micro | 02. Okt. 2025 | 55,70 % | inferred high-confidence family alias from granite-4.0-tiny-preview (score=0.4700; benches=12) | Ja | Quelle | |
| Granite 4.0 Small | 02. Okt. 2025 | 55,70 % | inferred high-confidence family alias from granite-4.0-tiny-preview (score=0.4700; benches=12) | Ja | Quelle | |
| Granite 4.0 Tiny | 02. Okt. 2025 | 55,70 % | inferred alias from granite-4.0-tiny-preview | Ja | Quelle |
