GPT-5编程测评大反转！表面不及格，实际63.1%的任务没交卷，全算上成绩比Claude高一倍

The SWE-BENCH PRO benchmark reveals a surprising performance drop for leading AI models, with GPT-5, Claude Opus 4.1, and Gemini 2.5 all failing to exceed a 25% task completion rate. However, when considering unsubmitted tasks, GPT-5's effective performance is actually 63.1%, significantly outperforming Claude.

Key Points

• GPT-5, Claude Opus 4.1, and Gemini 2.5 all scored below 25% in task completion.
• GPT-5's effective performance, considering unsubmitted tasks, is 63.1%.
• Claude's performance is significantly lower than GPT-5 when accounting for unsubmitted tasks.
• The benchmark highlights a major challenge for leading AI models in software engineering tasks.
• SWE-BENCH PRO reveals critical insights into AI model performance in programming.