HumanEval+
AI 基准测试结果和模型表现
类型: percentageReasoning
已记录的结果
30
平均分数
71.24%
分数范围
25% - 92.90%
领先模型
92.90% - Phi 4 Reasoning
分数变化趋势
按日期绘制的单项基准测试分数。
模型结果
| 组织 | 模型 | 报告时间 | 最高分数 | 信息 | 自行报告 | 来源 |
|---|---|---|---|---|---|---|
| Phi 4 Reasoning | 2025年4月30日 | 92.90% | - | 是 | 来源 | |
| Phi 4 Reasoning Plus | 2025年4月30日 | 92.30% | - | 是 | 来源 | |
| Granite 3.0 8B Instruct | - | 86.09% | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.4911; benches=14) | 是 | 来源 | |
| Granite 3.1 8B Instruct | - | 86.09% | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.4911; benches=14) | 是 | 来源 | |
| Granite 3.2 8B Instruct | - | 86.09% | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.4911; benches=14) | 是 | 来源 | |
| Granite 3.2 8B Instruct Preview | - | 86.09% | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.4687; benches=14) | 是 | 来源 | |
| Granite 3.3 2B Instruct | 2025年4月16日 | 86.09% | inferred family alias from granite-3.3-8b-instruct (score=0.3627; benches=14) | 是 | 来源 | |
| Granite 3.3 8B Instruct | 2025年4月16日 | 86.09% | - | 是 | 来源 | |
| Granite Guardian 3.0 8B | - | 86.09% | inferred family alias from granite-3.3-8b-instruct (score=0.4062; benches=14) | 是 | 来源 | |
| Granite Guardian 3.1 8B | - | 86.09% | inferred family alias from granite-3.3-8b-instruct (score=0.4062; benches=14) | 是 | 来源 | |
| Granite Guardian 3.3 8B | - | 86.09% | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.5071; benches=14) | 是 | 来源 | |
| Granite Speech 3.2 8B | - | 86.09% | inferred family alias from granite-3.3-8b-instruct (score=0.4062; benches=14) | 是 | 来源 | |
| Granite Speech 3.3 8B | - | 86.09% | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.5071; benches=14) | 是 | 来源 | |
| Granite 4.1 30B | 2026年4月29日 | 85.37% | pass@1 | 是 | 来源 | |
| Phi 1 | - | 82.80% | inferred family alias from phi-4 (score=0.3100; benches=13) | 是 | 来源 | |
| Phi 2 | - | 82.80% | inferred family alias from phi-4 (score=0.3100; benches=13) | 是 | 来源 | |
| Phi 4 | 2024年12月12日 | 82.80% | - | 是 | 来源 | |
| Granite 4.1 8B | 2026年4月29日 | 79.88% | pass@1 | 是 | 来源 | |
| Granite 4.0 Micro | 2025年10月02日 | 78.30% | inferred high-confidence family alias from granite-4.0-tiny-preview (score=0.4700; benches=12) | 是 | 来源 | |
| Granite 4.0 Small | 2025年10月02日 | 78.30% | inferred high-confidence family alias from granite-4.0-tiny-preview (score=0.4700; benches=12) | 是 | 来源 | |
| Granite 4.0 Tiny | 2025年10月02日 | 78.30% | inferred alias from granite-4.0-tiny-preview | 是 | 来源 | |
| Granite 4.0 Tiny Preview | 2025年5月02日 | 78.30% | - | 是 | 来源 | |
| Granite 4.1 3B | 2026年4月29日 | 76.83% | pass@1 | 是 | 来源 | |
| Qwen 14B | - | 51.20% | inferred family alias from qwen-2.5-14b-instruct (score=0.3060; benches=16) | 是 | 来源 | |
| Ernie 4.5 21B A3B | - | 25% | inferred version-family alias from ernie-4.5 | 是 | 来源 |
