OpenAI · launched 22 Sept 2026
GPT-6 Sol
The mid-tier GPT-6 model, sitting between GPT-6 Luna and the flagship GPT-6 Astra.
Read the official announcementEarlier release. View its successor, GPT-6.1 Sol, for the latest launch results. This model's details and pricing remain available below.
- Vendor
- OpenAI
- Launch date
- 22 Sept 2026
- Input price
- $2.00 / 1M tokens
- Output price
- $10 / 1M tokens
- Cached input
- $0.20 / 1M tokens
- Batch discount
- 50%
- Context window
- 1.05M tokens
- Max output
- 128K tokens
- Input types
- Text, Image, File
- API model ID
- gpt-6-sol
- OpenRouter ID
- openai/gpt-6-sol
Listed rates apply up to 272K input tokens. Above 272K, input costs $4, cached input $0.40 and output $15 per million tokens for the full request.
Input price
$2.00
was $4.00 · 50% cheaper
Output price
$10
was $20 · 50% cheaper
Blended price
$4.00
was $8.00 · 50% cheaper
Listed rates apply up to 272K input tokens. Above 272K, input costs $4, cached input $0.40 and output $15 per million tokens for the full request.
- AutomationBench 1.0.6xhigh effort · $0.27 per task · reported by OpenAI33.2%
- Agents' Last Exam V1max effort · $2.93 per task · reported by OpenAI56.4%
- Factual error rate(lower is better)xhigh effort · $0.13 per task · reported by OpenAI4.5%
- FrontierCode 1.1max effort · $2.14 per task · reported by OpenAI49.3%
- DeepSWE 1.1max effort · $2.74 per task · reported by OpenAI68.8%
- OSWorld 2.0max effort · $3.25 per task · reported by OpenAI64.4%
- DeepSWE v1.1max effort · $2.74 per task · reported by OpenAI68.81%
- GDP.pdfhigh effort · $0.35 per task · reported by OpenAI28%
- AutomationBench 1.0.6xhigh effort · $0.27 per task · reported by OpenAI33.18%
- OSWorld 2.0 (offline set)max effort · $3.37 per task · reported by OpenAI64.43%
- Terminal-Bench Science 0.1max effort · $12.2 per task · reported by OpenAI27.59%
- Factual error rate on difficult prompts(lower is better)xhigh effort · $0.13 per task · reported by OpenAI4.52%
- FrontierCode v1.1max effort · $2.07 per task · reported by Anthropic49.3%
- AA-Briefcase v1.1max effort · $2.67 per task · reported by Anthropic1483 Elo
Price compared with other models
| Model | Launched | Input / 1M | Output / 1M | Cached / 1M | Blended / 1M | vs GPT-6 Sol |
|---|---|---|---|---|---|---|
| Claude Haiku 5.5AnthropicListed prices and comparisons apply to prompts up to 100K tokens. Above 100K, input costs $0.50, output $2.50 and cache reads $0.05 per million tokens. | 7 Oct 2026 | $0.10 | $0.50 | $0.01 | $0.20 | 95% cheaper |
| GPT-6 LunaOpenAI | 22 Sept 2026 | $0.10 | $0.50 | $0.01 | $0.20 | 95% cheaper |
| GPT-5.6 LunaOpenAI | 9 Jul 2026 | $0.20 | $1.20 | $0.02 | $0.45 | 89% cheaper |
| Gemini 3.5 Flash-LiteGoogle DeepMindText, image, video and audio inputs share the listed rate. Cache storage and grounding are billed separately. | 21 Jul 2026 | $0.30 | $2.50 | $0.03 | $0.85 | 79% cheaper |
| Gemini 3.8 FlashGoogle DeepMindIntroductory rates through 31 December 2026. From 1 January 2027, input is $1.50, output $7.50 and cached input $0.15 per million tokens. Cache storage and grounding are billed separately. | 2 Sept 2026 | $0.75 | $3.75 | $0.075 | $1.50 | 63% cheaper |
| Claude Haiku 4.5Anthropic | 15 Oct 2025 | $1.00 | $5.00 | $0.10 | $2.00 | 50% cheaper |
| GPT-6.1 TerraOpenAIListed rates apply up to 272K input tokens. Above 272K, input costs $2, cached input $0.10 and output $7.50 per million tokens for the full request. | 26 Oct 2026 | $1.00 | $5.00 | $0.05 | $2.00 | 50% cheaper |
| Grok 4.7SpaceXAIBase rates apply up to 200K context tokens; higher-context requests use different rates. Batch API is not supported. The separate fast variant costs twice as much. | 21 Sept 2026 | $2.00 | $6.00 | $0.50 | $3.00 | 25% cheaper |
| Claude Sonnet 5Anthropic | 30 Jun 2026 | $2.00 | $10 | $0.20 | $4.00 | Same price |
| Claude Sonnet 5.5AnthropicCache reads were reduced from $0.20 to $0.10 per million tokens on 7 October 2026. | 28 Sept 2026 | $2.00 | $10 | $0.10 | $4.00 | Same price |
| Gemini 4 ArgonGoogle DeepMindIntroductory rates through 30 November 2026. From 1 December 2026, input is $4, output $20 and cached input $0.20 per million tokens. Caching is implicit only. Long decode raises the output limit to 1,048,576 tokens. | 30 Sept 2026 | $2.00 | $10 | $0.10 | $4.00 | Same price |
| GPT-6 SolOpenAIListed rates apply up to 272K input tokens. Above 272K, input costs $4, cached input $0.40 and output $15 per million tokens for the full request. | 22 Sept 2026 | $2.00 | $10 | $0.20 | $4.00 | Baseline |
| GPT-6.1 SolOpenAIListed rates apply up to 272K input tokens. Above 272K, input costs $4, cached input $0.20 and output $15 per million tokens for the full request. | 29 Sept 2026 | $2.00 | $10 | $0.10 | $4.00 | Same price |
| Gemini 3.1 ProGoogle DeepMind · PreviewRates apply to prompts up to 200K tokens. Above 200K, input is $4, output $18 and cached input $0.40 per million tokens. Cache storage and grounding are billed separately. | 19 Feb 2026 | $2.00 | $12 | $0.20 | $4.50 | 13% more |
| GPT-5.6 TerraOpenAIOpenAI's model documentation supports the Batch API but does not list a batch price. | 9 Jul 2026 | $2.00 | $12 | $0.20 | $4.50 | 13% more |
| Claude Opus 5.5Anthropic | 22 Sept 2026 | $4.00 | $20 | $0.20 | $8.00 | 2× the price |
| GPT-5.6 SolOpenAI · previous generationPrice before the GPT-6 launch, from OpenAI's announcement. OpenRouter now lists $2 / $10. | 9 Jul 2026 | $4.00 | $20 | – | $8.00 | 2× the price |
| Claude Opus 5Anthropic | 24 Jul 2026 | $5.00 | $25 | $0.50 | $10 | 2.5× the price |
| Claude Fable 5.2Anthropic | 9 Nov 2026 | $8.00 | $40 | $0.20 | $16 | 4× the price |
| Claude Fable 5Anthropic | 9 Jun 2026 | $10 | $50 | $1.00 | $20 | 5× the price |
| Claude Fable 5.1Anthropic | 1 Sept 2026 | $10 | $50 | $0.25 | $20 | 5× the price |
| GPT-6 AstraOpenAI | 4 Sept 2026 | $10 | $50 | $1.00 | $20 | 5× the price |
GPT-6.1 Sol and GPT-6 Sol rates were checked on 8 October 2026 against OpenAI model documentation. USD per million tokens, checked 2 Oct 2026 via OpenRouter. Comparison uses the blended price (3 input tokens for every output token). Haiku 5.5 and Sonnet 5.5 prices were updated from Anthropic's 7 October 2026 announcement. Gemini and Grok prices were rechecked against official Google and xAI documentation on 27 October 2026. GPT-6.1 Terra prices were checked against OpenAI documentation on 27 October 2026. Claude Fable 5.2 prices are from Anthropic's 9 November 2026 announcement.
Official benchmark results
Reported by OpenAI on 22 Sept 2026 · exact values
| Benchmark | GPT-6 Astra | GPT-6 Sol | GPT-6 Luna | GPT-5.6 Sol | GPT-5.6 Luna |
|---|---|---|---|---|---|
| Coding deception rateAlignment · max effort · lower is better | 0.5% | 1.3% | 2.8% | 10.4% | 9.5% |
- Bold marks the best reported score in each row.
- OpenAI's internal evaluation uses tasks deliberately chosen to provoke dishonesty, so deception is much rarer in typical use.
- The announcement also covers broken search, reviewer bypass, warning circumvention and unauthorized interaction. See OpenAI's system card for those results.
Reported by OpenAI on 29 Sept 2026 · exact values
| Benchmark | GPT-6.1 Sol | GPT-6 Sol | GPT-6 Astra | GPT-6 Luna |
|---|---|---|---|---|
| Failure to disclose a broken search toolSafety evaluation · Max effort | 2.1% | 4.92% | 1.5% | 28.67% |
| Reviewer bypass attemptsSafety evaluation · Max effort | 0% | 0% | 0% | 0.26% |
| Warning circumventionSafety evaluation · Max effort | 23.48% | 64.39% | 17.42% | 42.37% |
| Computer-use safety stress testSafety evaluation · Xhigh effort | 4.32% | 17.39% | 2.4% | 13.7% |
- Bold marks the best reported score in each row.
- All rates are lower-is-better. These targeted evaluations stress challenging scenarios and do not represent typical usage.
- Exact values from the embedded announcement chart data. No cost values were published for these evaluations.
Reported by Anthropic on 28 Sept 2026 · exact values
| Benchmark | Claude Sonnet 5.5 | Claude Sonnet 5 | Claude Opus 5.5 | GPT-6 Sol |
|---|---|---|---|---|
| Terminal-Bench 4.0Agentic coding | 70.6% | 10.3% | 66.4% | – |
| FrontierCode 1.1 (main)Agentic coding · Sonnet 5.5 at max effort, 52.1% at xhigh | 46.2% | 42.4% | 54.4% | 49.3% |
| CursorBench 4.0Agentic coding | 55.5% | 34.1% | 57.8% | – |
| GDPval-AA v2.1Knowledge work | 1844 Elo | 1449 Elo | 1846 Elo | 1487 Elo |
| AA-Briefcase v1.1Knowledge work | 1811 Elo | 1359 Elo | 1822 Elo | 1483 Elo |
| Humanity's Last ExamMultidisciplinary reasoning · with tools | 64.5% | 54.9% | 67.7% | – |
| OSWorld 2.1Computer use · partial | 80.1% | 57% | 81.8% | – |
| ChartographyVisual chart recognition · no tools | 61.6% | 15.6% | 64.4% | 53.6% |
- Bold marks the best reported score in each row.
- Claude Opus 5.5's Terminal-Bench 4.0 score is at xhigh effort, its highest.
- OpenAI recently fixed a bug affecting GPT-6 Sol's image understanding; its GDPval-AA, AA-Briefcase and Chartography scores may predate the fix.
- A dash means the lab did not report a result for that model.
Score against cost · reported by OpenAI on 22 Sept 2026 · exact values
AI agents are tested on end-to-end workflows using 47 tools across sales, marketing, operations, support, finance and HR.
- GPT-6 Luna
- GPT-5.6 Luna
- GPT-6 Sol
- GPT-5.6 Sol
- GPT-6 Astra
- Claude Opus 5
- Claude Fable 5.1
Show data table
| Model | Effort | Score | Cost per task |
|---|---|---|---|
| GPT-6 Luna | low | 1.2% | $0.006 |
| GPT-6 Luna | medium | 9.4% | $0.016 |
| GPT-6 Luna | high | 14.5% | $0.021 |
| GPT-6 Luna | xhigh | 12.6% | $0.025 |
| GPT-6 Luna | max | 20.7% | $0.037 |
| GPT-5.6 Luna | low | 1.8% | $0.01 |
| GPT-5.6 Luna | medium | 4.3% | $0.02 |
| GPT-5.6 Luna | high | 9.1% | $0.05 |
| GPT-5.6 Luna | xhigh | 12.9% | $0.06 |
| GPT-5.6 Luna | max | 17% | $0.07 |
| GPT-6 Sol | low | 21.2% | $0.19 |
| GPT-6 Sol | medium | 26.9% | $0.21 |
| GPT-6 Sol | high | 31.2% | $0.24 |
| GPT-6 Sol | xhigh | 33.2% | $0.27 |
| GPT-6 Sol | max | 32% | $0.34 |
| GPT-5.6 Sol | low | 11.7% | $0.31 |
| GPT-5.6 Sol | medium | 19.6% | $0.42 |
| GPT-5.6 Sol | high | 24.8% | $0.47 |
| GPT-5.6 Sol | xhigh | 26.3% | $0.54 |
| GPT-5.6 Sol | max | 28.8% | $0.67 |
| GPT-6 Astra | low | 30.3% | $1.08 |
| GPT-6 Astra | medium | 34.1% | $1.27 |
| GPT-6 Astra | high | 37.1% | $1.44 |
| GPT-6 Astra | xhigh | 39% | $1.50 |
| GPT-6 Astra | max | 41.4% | $1.73 |
| Claude Opus 5 | low | 20.4% | $1.64 |
| Claude Opus 5 | medium | 23.9% | $2.22 |
| Claude Opus 5 | high | 20.5% | $2.27 |
| Claude Opus 5 | xhigh | 25.3% | $2.71 |
| Claude Opus 5 | max | 26.9% | $3.05 |
| Claude Fable 5.1 | max | 31.4% | $2.45 |
- Exact values from the data labels on OpenAI's charts. OpenAI took competitor scores from publicly available reports.
- Claude Fable 5.1 ran with Claude Opus 5 as a fallback. OpenAI notes its cost omits the fallback runs (about 40% of tasks), so its real cost is higher.
Score against cost · reported by OpenAI on 22 Sept 2026 · exact values
AI agents are evaluated on long-horizon, economically valuable tasks spanning 55 sub-industries of professional computer work.
- GPT-6 Luna
- GPT-5.6 Luna
- GPT-6 Sol
- GPT-5.6 Sol
- GPT-6 Astra
- Claude Opus 5
- Claude Fable 5
Show data table
| Model | Effort | Score | Cost per task |
|---|---|---|---|
| GPT-6 Luna | low | 36.3% | $0.025 |
| GPT-6 Luna | medium | 46.8% | $0.11 |
| GPT-6 Luna | high | 43.6% | $0.11 |
| GPT-6 Luna | xhigh | 47.9% | $0.11 |
| GPT-6 Luna | max | 50.9% | $0.15 |
| GPT-5.6 Luna | low | 31% | $0.18 |
| GPT-5.6 Luna | medium | 38.5% | $0.38 |
| GPT-5.6 Luna | high | 46.1% | $0.84 |
| GPT-5.6 Luna | xhigh | 49.4% | $1.55 |
| GPT-5.6 Luna | max | 50.4% | $2.57 |
| GPT-6 Sol | low | 48.7% | $0.86 |
| GPT-6 Sol | medium | 53.1% | $1.27 |
| GPT-6 Sol | high | 52.6% | $1.53 |
| GPT-6 Sol | xhigh | 55.4% | $1.67 |
| GPT-6 Sol | max | 56.4% | $2.93 |
| GPT-5.6 Sol | low | 45.1% | $1.63 |
| GPT-5.6 Sol | medium | 52.1% | $3.41 |
| GPT-5.6 Sol | high | 52.4% | $3.79 |
| GPT-5.6 Sol | xhigh | 53.6% | $5.08 |
| GPT-5.6 Sol | max | 52.8% | $7.13 |
| GPT-6 Astra | low | 53.4% | $3.07 |
| GPT-6 Astra | medium | 57.6% | $4.10 |
| GPT-6 Astra | high | 57.8% | $4.64 |
| GPT-6 Astra | xhigh | 58.3% | $5.40 |
| GPT-6 Astra | max | 59.3% | $6.23 |
| Claude Opus 5 | low | 51.9% | $4.06 |
| Claude Opus 5 | medium | 53% | $5.29 |
| Claude Opus 5 | high | 55.9% | $7.29 |
| Claude Opus 5 | xhigh | 55.5% | $10 |
| Claude Opus 5 | max | 52.7% | $9.76 |
| Claude Fable 5 | xhigh | 48.7% | $28.6 |
| Claude Fable 5 | adaptive | 41.3% | $15.2 |
- Exact values from the data labels on OpenAI's charts. OpenAI took competitor scores from publicly available reports.
- Claude Fable 5 ran with Claude Opus 4.8 as a fallback.
Answers with any factual error against cost · lower is better · reported by OpenAI on 22 Sept 2026 · exact values
OpenAI's internal evaluation on de-identified ChatGPT conversations where users had flagged a factual error from a prior model.
- GPT-6 Luna
- GPT-5.6 Luna
- GPT-6 Sol
- GPT-5.6 Sol
- GPT-6 Astra
Show data table
| Model | Effort | Error rate | Cost per task |
|---|---|---|---|
| GPT-6 Luna | low | 27.7% | $0.0024 |
| GPT-6 Luna | medium | 17.5% | $0.0033 |
| GPT-6 Luna | high | 12.5% | $0.0045 |
| GPT-6 Luna | xhigh | 10.2% | $0.0062 |
| GPT-6 Luna | max | 7.6% | $0.012 |
| GPT-5.6 Luna | low | 36.8% | $0.0045 |
| GPT-5.6 Luna | medium | 24.7% | $0.0062 |
| GPT-5.6 Luna | high | 17.3% | $0.011 |
| GPT-5.6 Luna | xhigh | 12.2% | $0.015 |
| GPT-5.6 Luna | max | 12% | $0.022 |
| GPT-6 Sol | low | 11.4% | $0.05 |
| GPT-6 Sol | medium | 6.9% | $0.069 |
| GPT-6 Sol | high | 5.1% | $0.099 |
| GPT-6 Sol | xhigh | 4.5% | $0.13 |
| GPT-6 Sol | max | 4.6% | $0.18 |
| GPT-5.6 Sol | low | 19.4% | $0.10 |
| GPT-5.6 Sol | medium | 15% | $0.15 |
| GPT-5.6 Sol | high | 10.8% | $0.23 |
| GPT-5.6 Sol | xhigh | 8.4% | $0.39 |
| GPT-5.6 Sol | max | 8.5% | $0.87 |
| GPT-6 Astra | low | 6.3% | $0.24 |
| GPT-6 Astra | medium | 4.4% | $0.31 |
| GPT-6 Astra | high | 3.9% | $0.48 |
| GPT-6 Astra | xhigh | 4% | $0.60 |
| GPT-6 Astra | max | 3.9% | $0.79 |
- Exact values from the data labels on OpenAI's charts. OpenAI took competitor scores from publicly available reports.
- These prompts were chosen because they caused errors before, so error rates are far higher than in typical use.
Score against cost · reported by OpenAI on 22 Sept 2026 · exact values
AI agents write code graded on correctness and mergeability: test quality, scope discipline, code style and codebase standards.
- GPT-6 Luna
- GPT-5.6 Luna
- GPT-6 Sol
- GPT-5.6 Sol
- GPT-6 Astra
- Claude Opus 5
- Claude Fable 5.1
Show data table
| Model | Effort | Score | Cost per task |
|---|---|---|---|
| GPT-6 Luna | low | 25.7% | $0.021 |
| GPT-6 Luna | medium | 35.5% | $0.053 |
| GPT-6 Luna | high | 37.3% | $0.067 |
| GPT-6 Luna | xhigh | 37.1% | $0.073 |
| GPT-6 Luna | max | 42.4% | $0.11 |
| GPT-5.6 Luna | low | 15.4% | $0.06 |
| GPT-5.6 Luna | medium | 25.7% | $0.13 |
| GPT-5.6 Luna | high | 35.9% | $0.23 |
| GPT-5.6 Luna | xhigh | 38.9% | $0.31 |
| GPT-5.6 Luna | max | 39.8% | $0.37 |
| GPT-6 Sol | low | 37.3% | $0.45 |
| GPT-6 Sol | medium | 45.9% | $0.80 |
| GPT-6 Sol | high | 47.7% | $1.08 |
| GPT-6 Sol | xhigh | 48.4% | $1.37 |
| GPT-6 Sol | max | 49.3% | $2.14 |
| GPT-5.6 Sol | low | 35.4% | $1.89 |
| GPT-5.6 Sol | medium | 39.9% | $2.69 |
| GPT-5.6 Sol | high | 45.1% | $3.48 |
| GPT-5.6 Sol | xhigh | 46.8% | $4.15 |
| GPT-5.6 Sol | max | 47.5% | $5.19 |
| GPT-6 Astra | low | 45.3% | $1.70 |
| GPT-6 Astra | medium | 48.8% | $2.43 |
| GPT-6 Astra | high | 50.9% | $3.01 |
| GPT-6 Astra | xhigh | 50.6% | $3.28 |
| GPT-6 Astra | max | 53.3% | $4.59 |
| Claude Opus 5 | low | 41.9% | $2.68 |
| Claude Opus 5 | medium | 53.4% | $4.31 |
| Claude Opus 5 | high | 48% | $7.24 |
| Claude Opus 5 | xhigh | 43.6% | $9.14 |
| Claude Opus 5 | max | 48% | $11.4 |
| Claude Fable 5.1 | low | 49.8% | $2.38 |
| Claude Fable 5.1 | medium | 50.9% | $3.28 |
| Claude Fable 5.1 | high | 50.3% | $5.27 |
| Claude Fable 5.1 | xhigh | 48.7% | $9.27 |
| Claude Fable 5.1 | max | 50.3% | $12.8 |
- Exact values from the data labels on OpenAI's charts. OpenAI took competitor scores from publicly available reports.
Score against cost · reported by OpenAI on 22 Sept 2026 · exact values
AI agents solve original, long-horizon software engineering tasks in real codebases.
- GPT-6 Luna
- GPT-5.6 Luna
- GPT-6 Sol
- GPT-5.6 Sol
- GPT-6 Astra
- Claude Opus 5
- Claude Fable 5
Show data table
| Model | Effort | Score | Cost per task |
|---|---|---|---|
| GPT-6 Luna | low | 2.4% | $0.0057 |
| GPT-6 Luna | medium | 44.5% | $0.052 |
| GPT-6 Luna | high | 59.3% | $0.084 |
| GPT-6 Luna | xhigh | 61.3% | $0.11 |
| GPT-6 Luna | max | 66.6% | $0.22 |
| GPT-5.6 Luna | low | 1.2% | $0.011 |
| GPT-5.6 Luna | medium | 9.3% | $0.031 |
| GPT-5.6 Luna | high | 42.4% | $0.13 |
| GPT-5.6 Luna | xhigh | 56.2% | $0.27 |
| GPT-5.6 Luna | max | 62.2% | $0.53 |
| GPT-6 Sol | low | 37.2% | $0.16 |
| GPT-6 Sol | medium | 56.6% | $0.38 |
| GPT-6 Sol | high | 65.3% | $0.64 |
| GPT-6 Sol | xhigh | 66.6% | $1.00 |
| GPT-6 Sol | max | 68.8% | $2.74 |
| GPT-5.6 Sol | low | 45.4% | $0.82 |
| GPT-5.6 Sol | medium | 61.1% | $1.42 |
| GPT-5.6 Sol | high | 69.4% | $2.66 |
| GPT-5.6 Sol | xhigh | 70.7% | $3.60 |
| GPT-5.6 Sol | max | 72.7% | $6.46 |
| GPT-6 Astra | low | 67% | $1.60 |
| GPT-6 Astra | medium | 72.8% | $3.08 |
| GPT-6 Astra | high | 73.2% | $3.92 |
| GPT-6 Astra | xhigh | 74.1% | $4.43 |
| GPT-6 Astra | max | 73.2% | $7.50 |
| Claude Opus 5 | low | 58.1% | $1.66 |
| Claude Opus 5 | medium | 68.9% | $3.29 |
| Claude Opus 5 | high | 72.8% | $6.08 |
| Claude Opus 5 | xhigh | 73.2% | $9.07 |
| Claude Opus 5 | max | 73.7% | $11.8 |
| Claude Fable 5 | low | 59.6% | $3.76 |
| Claude Fable 5 | medium | 65.4% | $6.09 |
| Claude Fable 5 | high | 68.6% | $9.18 |
| Claude Fable 5 | xhigh | 69.9% | $13.4 |
| Claude Fable 5 | max | 69.7% | $21.6 |
- Exact values from the data labels on OpenAI's charts. OpenAI took competitor scores from publicly available reports.
- OpenAI used Claude Fable 5 scores because Fable 5.1 scores were unavailable.
Partial reward against cost · release v2026.08.08 · reported by OpenAI on 22 Sept 2026 · exact values
AI agents attempt long-horizon computer-use workflows covering everyday and professional tasks.
- GPT-6 Luna
- GPT-5.6 Luna
- GPT-6 Sol
- GPT-5.6 Sol
- GPT-6 Astra
- Claude Opus 5
Show data table
| Model | Effort | Score | Cost per task |
|---|---|---|---|
| GPT-6 Luna | low | 8.3% | $0.03 |
| GPT-6 Luna | medium | 31.5% | $0.062 |
| GPT-6 Luna | high | 41.4% | $0.12 |
| GPT-6 Luna | xhigh | 46.7% | $0.16 |
| GPT-6 Luna | max | 52.7% | $0.27 |
| GPT-5.6 Luna | low | 12% | $0.019 |
| GPT-5.6 Luna | medium | 22.7% | $0.052 |
| GPT-5.6 Luna | high | 35.9% | $0.16 |
| GPT-5.6 Luna | xhigh | 48% | $0.36 |
| GPT-5.6 Luna | max | 52.7% | $0.49 |
| GPT-6 Sol | low | 43.9% | $0.97 |
| GPT-6 Sol | medium | 54% | $1.32 |
| GPT-6 Sol | high | 58.3% | $1.64 |
| GPT-6 Sol | xhigh | 60.5% | $2.21 |
| GPT-6 Sol | max | 64.4% | $3.25 |
| GPT-5.6 Sol | low | 29.8% | $0.91 |
| GPT-5.6 Sol | medium | 49.7% | $2.73 |
| GPT-5.6 Sol | high | 56.5% | $4.46 |
| GPT-5.6 Sol | xhigh | 60.9% | $5.93 |
| GPT-5.6 Sol | max | 66.2% | $7.71 |
| GPT-6 Astra | low | 62.2% | $2.55 |
| GPT-6 Astra | medium | 69.3% | $5.10 |
| GPT-6 Astra | high | 70% | $6.60 |
| GPT-6 Astra | xhigh | 71.3% | $7.17 |
| GPT-6 Astra | max | 73.5% | $9.07 |
| Claude Opus 5 | low | 55.2% | $9.88 |
| Claude Opus 5 | medium | 60.3% | $12.7 |
| Claude Opus 5 | high | 65.9% | $15.9 |
| Claude Opus 5 | xhigh | 70.1% | $23.9 |
| Claude Opus 5 | max | 70.2% | $24.1 |
- Exact values from the data labels on OpenAI's charts. OpenAI took competitor scores from publicly available reports.
- Claude Opus 5 values match the official OSWorld 2.0 leaderboard (osworld-v2.xlang.ai).
Score against cost · reported by OpenAI on 29 Sept 2026 · exact values
Agentic software engineering performance across reasoning effort settings.
- GPT-6.1 Sol
- GPT-6 Sol
- GPT-6 Astra
Show data table
| Model | Effort | Score (%) | Cost per task |
|---|---|---|---|
| GPT-6.1 Sol | low | 64.38% | $0.17 |
| GPT-6.1 Sol | medium | 73.01% | $0.42 |
| GPT-6.1 Sol | high | 75.22% | $0.65 |
| GPT-6.1 Sol | xhigh | 71.9% | $0.79 |
| GPT-6.1 Sol | max | 71.9% | $1.57 |
| GPT-6 Sol | low | 37.17% | $0.16 |
| GPT-6 Sol | medium | 56.64% | $0.38 |
| GPT-6 Sol | high | 65.27% | $0.64 |
| GPT-6 Sol | xhigh | 66.59% | $1.00 |
| GPT-6 Sol | max | 68.81% | $2.74 |
| GPT-6 Astra | low | 67.04% | $1.60 |
| GPT-6 Astra | medium | 72.79% | $3.08 |
| GPT-6 Astra | high | 73.23% | $3.92 |
| GPT-6 Astra | xhigh | 74.12% | $4.43 |
| GPT-6 Astra | max | 73.23% | $7.50 |
- Exact score and cost values from the chart data embedded in OpenAI's announcement.
Score against cost · reported by OpenAI on 29 Sept 2026 · exact values
Accuracy on professional questions using complex PDF documents.
- GPT-6.1 Sol
- GPT-6 Sol
- GPT-6 Astra
- Claude Opus 5.5 with fallbacks
Show data table
| Model | Effort | Score (%) | Cost per task |
|---|---|---|---|
| GPT-6.1 Sol | low | 27% | $0.33 |
| GPT-6.1 Sol | medium | 30% | $0.34 |
| GPT-6.1 Sol | high | 32% | $0.35 |
| GPT-6.1 Sol | xhigh | 31.8% | $0.37 |
| GPT-6.1 Sol | max | 31% | $0.42 |
| GPT-6 Sol | low | 21.8% | $0.33 |
| GPT-6 Sol | medium | 25.4% | $0.34 |
| GPT-6 Sol | high | 28% | $0.35 |
| GPT-6 Sol | xhigh | 23.8% | $0.37 |
| GPT-6 Sol | max | 24.8% | $0.43 |
| GPT-6 Astra | low | 30.4% | $1.70 |
| GPT-6 Astra | medium | 30.4% | $1.72 |
| GPT-6 Astra | high | 31% | $1.79 |
| GPT-6 Astra | xhigh | 32.2% | $1.91 |
| GPT-6 Astra | max | 31% | $2.08 |
| Claude Opus 5.5 with fallbacks | low | 25.6% | $0.76 |
| Claude Opus 5.5 with fallbacks | medium | 25.6% | $0.80 |
| Claude Opus 5.5 with fallbacks | high | 28.8% | $0.83 |
| Claude Opus 5.5 with fallbacks | xhigh | 26.6% | $0.96 |
| Claude Opus 5.5 with fallbacks | max | 26.2% | $1.55 |
- Exact score and cost values from the chart data embedded in OpenAI's announcement.
- Opus 5.5 results use fallback models as reported by OpenAI; these are not standalone Opus 5.5 results.
Score against cost · reported by OpenAI on 29 Sept 2026 · exact values
End-to-end business workflows using 47 tools across sales, marketing, operations, support, finance and HR.
- GPT-6.1 Sol
- GPT-6 Sol
- GPT-6 Astra
- Claude Opus 5.5 with fallbacks
- Claude Fable 5.1 with Opus 5 fallback
Show data table
| Model | Effort | Score (%) | Cost per task |
|---|---|---|---|
| GPT-6.1 Sol | low | 24.7% | $0.16 |
| GPT-6.1 Sol | medium | 31.7% | $0.19 |
| GPT-6.1 Sol | high | 33.2% | $0.23 |
| GPT-6.1 Sol | xhigh | 35.5% | $0.25 |
| GPT-6.1 Sol | max | 36.1% | $0.30 |
| GPT-6 Sol | low | 21.16% | $0.19 |
| GPT-6 Sol | medium | 26.94% | $0.21 |
| GPT-6 Sol | high | 31.2% | $0.24 |
| GPT-6 Sol | xhigh | 33.18% | $0.27 |
| GPT-6 Sol | max | 31.96% | $0.34 |
| GPT-6 Astra | low | 30.3% | $1.08 |
| GPT-6 Astra | medium | 34.1% | $1.27 |
| GPT-6 Astra | high | 37.1% | $1.44 |
| GPT-6 Astra | xhigh | 39% | $1.50 |
| GPT-6 Astra | max | 41.4% | $1.73 |
| Claude Opus 5.5 with fallbacks | low | 24.2% | $0.51 |
| Claude Opus 5.5 with fallbacks | medium | 29.53% | $0.65 |
| Claude Opus 5.5 with fallbacks | high | 33.03% | $0.71 |
| Claude Opus 5.5 with fallbacks | xhigh | 35.77% | $0.89 |
| Claude Opus 5.5 with fallbacks | max | 42.47% | $1.44 |
| Claude Fable 5.1 with Opus 5 fallback | max | 31.4% | $2.45 |
- Exact score and cost values from the chart data embedded in OpenAI's announcement.
- Opus 5.5 results use fallback models as reported by OpenAI; these are not standalone Opus 5.5 results.
- Fable 5.1 is reported at max effort only. Its cost omits fallbacks, which occurred on approximately 40% of tasks, so its actual cost is higher.
Score against cost · reported by OpenAI on 29 Sept 2026 · exact values
Partial reward on long-horizon computer-use workflows, using the offline set from release v2026.08.08.
- GPT-6.1 Sol
- GPT-6 Sol
- GPT-6 Astra
Show data table
| Model | Effort | Score (%) | Cost per task |
|---|---|---|---|
| GPT-6.1 Sol | low | 58.96% | $0.42 |
| GPT-6.1 Sol | medium | 66.84% | $0.77 |
| GPT-6.1 Sol | high | 69.56% | $0.96 |
| GPT-6.1 Sol | xhigh | 69.38% | $1.05 |
| GPT-6.1 Sol | max | 71.42% | $1.27 |
| GPT-6 Sol | low | 43.9% | $1.01 |
| GPT-6 Sol | medium | 54% | $1.38 |
| GPT-6 Sol | high | 58.29% | $1.71 |
| GPT-6 Sol | xhigh | 60.54% | $2.30 |
| GPT-6 Sol | max | 64.43% | $3.37 |
| GPT-6 Astra | low | 62.17% | $2.72 |
| GPT-6 Astra | medium | 69.25% | $5.36 |
| GPT-6 Astra | high | 70.02% | $6.91 |
| GPT-6 Astra | xhigh | 71.27% | $7.49 |
| GPT-6 Astra | max | 73.49% | $9.44 |
- Exact score and cost values from the chart data embedded in OpenAI's announcement.
Score against cost · reported by OpenAI on 29 Sept 2026 · exact values
Scientific research tasks completed through a terminal.
- GPT-6.1 Sol
- GPT-6 Sol
- GPT-6 Astra
- Claude Opus 5.5 with fallbacks
Show data table
| Model | Effort | Score (%) | Cost per task |
|---|---|---|---|
| GPT-6.1 Sol | low | 43.71% | $1.79 |
| GPT-6.1 Sol | medium | 47.56% | $2.34 |
| GPT-6.1 Sol | high | 51.14% | $2.76 |
| GPT-6.1 Sol | xhigh | 53.71% | $2.89 |
| GPT-6.1 Sol | max | 57.02% | $5.47 |
| GPT-6 Sol | low | 9.17% | $3.00 |
| GPT-6 Sol | medium | 14.49% | $4.41 |
| GPT-6 Sol | high | 14.61% | $4.63 |
| GPT-6 Sol | xhigh | 25.29% | $6.77 |
| GPT-6 Sol | max | 27.59% | $12.2 |
| GPT-6 Astra | low | 55.43% | $11.4 |
| GPT-6 Astra | medium | 57.43% | $12.3 |
| GPT-6 Astra | high | 62% | $15 |
| GPT-6 Astra | xhigh | 60.86% | $15.8 |
| GPT-6 Astra | max | 68.1% | $23.8 |
| Claude Opus 5.5 with fallbacks | max | 63.33% | $23.2 |
- Exact score and cost values from the chart data embedded in OpenAI's announcement.
- Opus 5.5 results use fallback models as reported by OpenAI; these are not standalone Opus 5.5 results.
Error rate against cost · reported by OpenAI on 29 Sept 2026 · exact values
Answers containing at least one factual error on deliberately difficult prompts. Lower is better.
- GPT-6.1 Sol
- GPT-6 Sol
- GPT-6 Astra
Show data table
| Model | Effort | Answers with any factual error (%) | Cost per task |
|---|---|---|---|
| GPT-6.1 Sol | low | 7.72% | $0.045 |
| GPT-6.1 Sol | medium | 6.29% | $0.056 |
| GPT-6.1 Sol | high | 4.52% | $0.082 |
| GPT-6.1 Sol | xhigh | 4.12% | $0.10 |
| GPT-6.1 Sol | max | 4.61% | $0.13 |
| GPT-6 Sol | low | 11.42% | $0.05 |
| GPT-6 Sol | medium | 6.86% | $0.069 |
| GPT-6 Sol | high | 5.14% | $0.099 |
| GPT-6 Sol | xhigh | 4.52% | $0.13 |
| GPT-6 Sol | max | 4.57% | $0.18 |
| GPT-6 Astra | low | 6.26% | $0.24 |
| GPT-6 Astra | medium | 4.41% | $0.31 |
| GPT-6 Astra | high | 3.9% | $0.48 |
| GPT-6 Astra | xhigh | 3.99% | $0.60 |
| GPT-6 Astra | max | 3.91% | $0.79 |
- Exact score and cost values from the chart data embedded in OpenAI's announcement.
- Prompts are de-identified conversations where users flagged an earlier model error. They are not representative of typical usage.
Accuracy against cost · reported by Anthropic on 28 Sept 2026 · exact values
Measures whether an agent's code changes would be merged.
- Claude Sonnet 5.5
- Claude Opus 5.5
- Claude Sonnet 5
- GPT-6 Sol
Show data table
| Model | Effort | Score | Cost per task |
|---|---|---|---|
| Claude Sonnet 5.5 | low | 29.3% | $0.19 |
| Claude Sonnet 5.5 | medium | 36.5% | $0.24 |
| Claude Sonnet 5.5 | high | 49.4% | $0.42 |
| Claude Sonnet 5.5 | xhigh | 52.1% | $1.59 |
| Claude Sonnet 5.5 | max | 46.2% | $20.8 |
| Claude Opus 5.5 | low | 47.3% | $0.40 |
| Claude Opus 5.5 | medium | 54.6% | $0.80 |
| Claude Opus 5.5 | high | 54% | $1.09 |
| Claude Opus 5.5 | xhigh | 51.4% | $2.25 |
| Claude Opus 5.5 | max | 54.4% | $6.19 |
| Claude Sonnet 5 | low | 28.7% | $2.39 |
| Claude Sonnet 5 | medium | 35.2% | $3.81 |
| Claude Sonnet 5 | high | 39.4% | $6.10 |
| Claude Sonnet 5 | xhigh | 42.7% | $10.1 |
| Claude Sonnet 5 | max | 42.4% | $17.1 |
| GPT-6 Sol | low | 37.3% | $0.43 |
| GPT-6 Sol | medium | 45.9% | $0.77 |
| GPT-6 Sol | high | 47.7% | $1.04 |
| GPT-6 Sol | xhigh | 48.4% | $1.32 |
| GPT-6 Sol | max | 49.3% | $2.07 |
- Exact values from the data published with Anthropic's announcement.
Elo against cost · reported by Anthropic on 28 Sept 2026 · exact values
Artificial Analysis's benchmark of long-horizon knowledge work.
- Claude Sonnet 5.5
- Claude Opus 5.5
- Claude Sonnet 5
- GPT-6 Sol
Show data table
| Model | Effort | Elo | Cost per task |
|---|---|---|---|
| Claude Sonnet 5.5 | low | 1264 Elo | $0.87 |
| Claude Sonnet 5.5 | medium | 1461 Elo | $1.64 |
| Claude Sonnet 5.5 | high | 1634 Elo | $3.95 |
| Claude Sonnet 5.5 | xhigh | 1746 Elo | $9.63 |
| Claude Sonnet 5.5 | max | 1811 Elo | $29.2 |
| Claude Opus 5.5 | low | 1285 Elo | $1.15 |
| Claude Opus 5.5 | medium | 1642 Elo | $4.40 |
| Claude Opus 5.5 | high | 1705 Elo | $6.27 |
| Claude Opus 5.5 | xhigh | 1780 Elo | $12.3 |
| Claude Opus 5.5 | max | 1822 Elo | $21 |
| Claude Sonnet 5 | low | 923 Elo | $0.82 |
| Claude Sonnet 5 | medium | 1056 Elo | $1.73 |
| Claude Sonnet 5 | high | 1177 Elo | $3.76 |
| Claude Sonnet 5 | xhigh | 1274 Elo | $7.56 |
| Claude Sonnet 5 | max | 1359 Elo | $14.4 |
| GPT-6 Sol | low | 905 Elo | $0.12 |
| GPT-6 Sol | medium | 1142 Elo | $0.34 |
| GPT-6 Sol | high | 1289 Elo | $0.63 |
| GPT-6 Sol | xhigh | 1364 Elo | $1.19 |
| GPT-6 Sol | max | 1483 Elo | $2.67 |
- Exact values from the data published with Anthropic's announcement.
- Artificial Analysis ran Sonnet 5.5 on a pre-release deployment with a since-fixed structured output bug, which may slightly understate its score.