PhaseoPhaseo
ModelsChatCompareAppsRankings

Help keep public data accurate

See something missing, incorrect, or out of date? Tell us about this page.

PhaseoPhaseo
Checking statusChecking statusVisit status page
Component-level status is unavailable.

Explore

  • Models
  • Chat
  • Providers
  • Apps
  • Rankings
  • Tools

Resources

  • Compare
  • Migration Guides
  • Methodology
  • Blog

Community

  • Discord
  • GitHub
  • LinkedIn
  • Reddit
  • X

Build

  • Documentation
  • API Reference
  • Quickstart
  • SDKs

Company

  • About
  • Trust Centre
  • Mission
  • Pricing
  • Works With
  • Acknowledgements
  • Support
  • Privacy
  • Terms

Explore

  • Models
  • Chat
  • Providers
  • Apps
  • Rankings
  • Tools

Build

  • Documentation
  • API Reference
  • Quickstart
  • SDKs

Resources

  • Compare
  • Migration Guides
  • Methodology
  • Blog

Company

  • About
  • Trust Centre
  • Mission
  • Pricing
  • Works With
  • Acknowledgements
  • Support
  • Privacy
  • Terms

Community

  • Discord
  • GitHub
  • LinkedIn
  • Reddit
  • X

© 2025 • Phaseo

Change language: English (UK)
  • English (UK)
  • 简体中文
  • हिन्दी
  • Español (España)
  • Français (France)
  • Deutsch (Deutschland)
  • Português (Brasil)
  • 日本語
  • العربية

Help:Issue·Support

Need help with Phaseo?Open an issueorcontact support

COLLIE

COLLIE

AI benchmark results and model performance

Type: percentage

Recorded results

23

Average score

74.41%

Score range

61% - 99%

Leading model

99% - GPT 5
Scores over time

Individual benchmark scores plotted by date.

Model results

OrganisationModelsReportedTop scoreInfoSelf reportedSource
OpenAIOpenAI
OpenAI
GPT 507 Aug 202599%With Thinking, Pass @ 1YesSource
OpenAIOpenAI
OpenAI
o3 mini30 Jan 202598.70%-YesSource
OpenAIOpenAI
OpenAI
GPT 5 Mini07 Aug 202598.50%High Reasoning EffortYesSource
OpenAIOpenAI
OpenAI
GPT 5 Nano07 Aug 202596.90%High Reasoning EffortYesSource
Mistral
Mistral
Mistral Medium 3.529 Apr 202695.80%-YesSource
ByteDance
ByteDance
Seed 2.0 Lite14 Feb 202694%Seed2 official benchmark table | COLLIEYesSource
ByteDance
ByteDance
Seed 2.0 Pro14 Feb 202693.90%Seed2 official benchmark table | COLLIEYesSource
ByteDance
ByteDance
Seed 2.0 Mini14 Feb 202691.20%Seed2 official benchmark table | COLLIEYesSource
OpenAIOpenAI
OpenAI
GPT 4.5 Preview27 Feb 202572.30%-YesSource
Mistral
Mistral
Mistral Small 1.026 Feb 202462.90%inferred family alias from mistral-small-latest (score=0.3650; benches=9)YesSource
Mistral
Mistral
Mistral Small 2.017 Sept 202462.90%inferred family alias from mistral-small-latest (score=0.3650; benches=9)YesSource
Mistral
Mistral
Mistral Small 416 Mar 202662.90%-YesSource
Mistral
Mistral
Mistral Small Creative16 Dec 202562.90%inferred family alias from mistral-small-latest (score=0.4273; benches=9)YesSource
OpenAIOpenAI
OpenAI
GPT 4o (2024-08-06)06 Aug 202461%-YesSource
OpenAIOpenAI
OpenAI
GPT 4o Audio Preview (2025-06-03)03 Jun 202561%inferred modality/version alias from gpt-4o-2024-08-06YesSource
OpenAIOpenAI
OpenAI
GPT 4o Audio Preview (2024-10-01)01 Oct 202461%inferred modality/version alias from gpt-4o-2024-08-06YesSource
OpenAIOpenAI
OpenAI
GPT 4o Audio Preview (2024-12-17)17 Dec 202461%inferred modality/version alias from gpt-4o-2024-08-06YesSource
OpenAIOpenAI
OpenAI
GPT 4o Realtime Preview (2025-06-03)03 Jun 202561%inferred modality/version alias from gpt-4o-2024-08-06YesSource
OpenAIOpenAI
OpenAI
GPT 4o Realtime Preview (2024-10-01)01 Oct 202461%inferred modality/version alias from gpt-4o-2024-08-06YesSource
OpenAIOpenAI
OpenAI
GPT 4o Search Preview11 Mar 202561%inferred modality/version alias from gpt-4o-2024-08-06YesSource
OpenAIOpenAI
OpenAI
GPT 4o Transcribe20 Mar 202561%inferred modality/version alias from gpt-4o-2024-08-06YesSource
OpenAIOpenAI
OpenAI
GPT 4o Transcribe Diarize15 Oct 202561%inferred modality/version alias from gpt-4o-2024-08-06YesSource
Report an issue
Sign Up