PhaseoPhaseo
ModelsChatCompareAppsRankings

Help keep public data accurate

See something missing, incorrect, or out of date? Tell us about this page.

PhaseoPhaseo
Checking statusChecking statusVisit status page
Component-level status is unavailable.

Explore

  • Models
  • Chat
  • Providers
  • Apps
  • Rankings
  • Tools

Resources

  • Compare
  • Migration Guides
  • Methodology
  • Blog

Community

  • Discord
  • GitHub
  • LinkedIn
  • Reddit
  • X

Build

  • Documentation
  • API Reference
  • Quickstart
  • SDKs

Company

  • About
  • Trust Centre
  • Mission
  • Pricing
  • Works With
  • Acknowledgements
  • Support
  • Privacy
  • Terms

Explore

  • Models
  • Chat
  • Providers
  • Apps
  • Rankings
  • Tools

Build

  • Documentation
  • API Reference
  • Quickstart
  • SDKs

Resources

  • Compare
  • Migration Guides
  • Methodology
  • Blog

Company

  • About
  • Trust Centre
  • Mission
  • Pricing
  • Works With
  • Acknowledgements
  • Support
  • Privacy
  • Terms

Community

  • Discord
  • GitHub
  • LinkedIn
  • Reddit
  • X

© 2025 • Phaseo

Change language: English (UK)
  • English (UK)
  • 简体中文
  • हिन्दी
  • Español (España)
  • Français (France)
  • Deutsch (Deutschland)
  • Português (Brasil)
  • 日本語
  • العربية

Help:Issue·Support

Need help with Phaseo?Open an issueorcontact support

SWE-Lancer

SWE-Lancer

AI benchmark results and model performance

Type: percentageCode
View benchmark source

Recorded results

31

Average score

33.75%

Score range

7.40% - 81.40%

Leading model

81.40% - GPT 5.3 Codex
Scores over time

Individual benchmark scores plotted by date.

Model results

OrganisationModelsReportedTop scoreInfoSelf reportedSource
OpenAIOpenAI
OpenAI
GPT 5.3 Codex05 Feb 202681.40%SWE-Lancer IC Diamond; xhigh reasoningYesSource
OpenAIOpenAI
OpenAI
GPT 5.211 Dec 202574.60%IC DiamondYesSource
OpenAIOpenAI
OpenAI
GPT 5.2 Chat11 Dec 202574.60%inferred alias from gpt-5.2-2025-12-11YesSource
OpenAIOpenAI
OpenAI
GPT 5.1 Codex13 Nov 202566.30%-YesSource
OpenAIOpenAI
OpenAI
GPT Audio 1.523 Feb 202666.30%manual fallback alias from gpt-5.1-codexYesSource
OpenAIOpenAI
OpenAI
GPT Realtime 1.523 Feb 202666.30%manual fallback alias from gpt-5.1-codexYesSource
ByteDance
ByteDance
Seed 2.0 Pro14 Feb 202649.40%Seed2 official benchmark table | SWE-LancerYesSource
ByteDance
ByteDance
Seed 2.0 Lite14 Feb 202647.10%Seed2 official benchmark table | SWE-LancerYesSource
OpenAIOpenAI
OpenAI
GPT 4.5 Preview27 Feb 202537.30%-YesSource
OpenAIOpenAI
OpenAI
GPT 4.114 Apr 202535.10%IC-DiamondYesSource
OpenAIOpenAI
OpenAI
GPT 4o (2024-08-06)06 Aug 202432.60%-YesSource
OpenAIOpenAI
OpenAI
GPT 4o Audio Preview (2025-06-03)03 Jun 202532.60%inferred modality/version alias from gpt-4o-2024-08-06YesSource
OpenAIOpenAI
OpenAI
GPT 4o Audio Preview (2024-10-01)01 Oct 202432.60%inferred modality/version alias from gpt-4o-2024-08-06YesSource
OpenAIOpenAI
OpenAI
GPT 4o Audio Preview (2024-12-17)17 Dec 202432.60%inferred modality/version alias from gpt-4o-2024-08-06YesSource
OpenAIOpenAI
OpenAI
GPT 4o Realtime Preview (2025-06-03)03 Jun 202532.60%inferred modality/version alias from gpt-4o-2024-08-06YesSource
OpenAIOpenAI
OpenAI
GPT 4o Realtime Preview (2024-10-01)01 Oct 202432.60%inferred modality/version alias from gpt-4o-2024-08-06YesSource
OpenAIOpenAI
OpenAI
GPT 4o Search Preview11 Mar 202532.60%inferred modality/version alias from gpt-4o-2024-08-06YesSource
OpenAIOpenAI
OpenAI
GPT 4o Transcribe20 Mar 202532.60%inferred modality/version alias from gpt-4o-2024-08-06YesSource
OpenAIOpenAI
OpenAI
GPT 4o Transcribe Diarize15 Oct 202532.60%inferred modality/version alias from gpt-4o-2024-08-06YesSource
OpenAIOpenAI
OpenAI
o3 mini30 Jan 202518%-YesSource
Report an issue
Sign Up