The AIs we tested
We tested 28 AIs from eight makers. They include OpenAI's GPT models, the family behind ChatGPT, Anthropic's Claude models, such as Opus, Sonnet, Haiku and Fable, and one of Google's, Gemini 4 Argon. The other five makers offer AIs anyone can download. Most of OpenAI's ran in Codex, most of Anthropic's in Claude Code and Google's in Antigravity, the makers' own apps for running an AI as an agent on a computer. We haven't tested the ChatGPT or Claude chat apps, or Microsoft's AIs, and we didn't test every AI on every job.
The three strongest were close
On the 62 jobs we gave all five of the most‑tested AIs, GPT‑6 Astra, Opus 5.5 and GPT‑6.1 Sol came out close, ahead of Sonnet 5.5 and GPT‑6 Luna. Even they got everything right on only 5 to 7 of those jobs.
| AI | Size | Everything right | Average score |
|---|---|---|---|
| GPT‑6 AstraOpenAI | Large | 5 of 62 | 74 |
| Opus 5.5Anthropic | Large | 7 of 62 | 72 |
| GPT‑6.1 SolOpenAI | Mid‑sized | 5 of 62 | 70 |
| Sonnet 5.5Anthropic | Mid‑sized | 3 of 62 | 65 |
| GPT‑6 LunaOpenAI | Small | 0 of 62 | 27 |
Everything right: the jobs where the AI met every check, every time we counted. Average score: its average out of 100 across the jobs these five shared.
Who did best in each benchmark
- Your AI personal assistant
- GPT‑6 Astra had the best result, or shared it, on four of the ten jobs, and with GPT‑6.1 Sol got everything right on next term's classes.
- Your AI office assistant
- GPT‑6 Astra did best on the office jobs, with the top score on five of the eleven, one of them shared with Fable 5.1.
- Your AI app builder
- Opus 5.5 had the best result on seven of the 13 apps, and was the only AI to get everything right on one, the train‑ticket catcher.
- Your AI customer service agent
- GPT‑6 Astra, Opus 5.5 and GPT‑6.1 Sol each got all 80 repair customers right, Opus 5.5 had the best result, or tied for it, on three of the seven jobs, and Sonnet 5.5 got every rental search right.
- Your AI operations manager
- Opus 5.5 got everything right on four of the nine jobs, and GPT‑6.1 Sol on three.
- Your AI hospital assistant
- Opus 5.5 got everything right on all three jobs, and was the only AI to do so on the ward.
- Your AI facilities engineer
- Sonnet 5.5 did best on the cooling failure and Fable 5.1 on the server hall, and GPT‑6 Astra and Opus 5.5 shared the top score on moving the air handler.
- Your AI engineering assistant
- Sonnet 5.5 got everything right reading the plant's scans, and Fable 5.1 bringing its drawings up to date; GPT‑6 Astra did best on the watchdog and shared the top score on the sketches.
- Your AI DIY assistant
- Opus 5.5 had the best average and the top score on three of the six jobs, one shared with Fable 5.2; GPT‑6 Astra did best on the furnished room and the wet floor, and shared the top score on the lighting plan with Fable 5.2.
- Your AI robot operator
- GPT‑6.1 Sol, the only AI tested on the ten builds, completed none under their strict check; at batting it hit two pitches, more than any other AI.
- Your AI race team
- GPT‑6.1 Sol, GPT‑6.1 Terra and GPT‑6 Astra finished both races; designing a race car, GPT‑6 Astra came closest to the fastest achievable car, 2.0% slower.
How much size matters
We sort most of the AIs into large, mid‑sized and small, as a rough guide. Bigger usually does better, but not always. On the 69 jobs where we tested AIs of all three sizes, a large AI got everything right on 14, a mid‑sized one on 11 and a small one on 2. GPT‑6.1 Sol, a mid‑sized AI, kept up with the two strongest large ones.
AIs anyone can download
Five makers offer AIs anyone can download and run. DeepSeek V4.1 Flash came closest to the strongest, and had the top score, or shared it, on 2 of the 13 jobs we tested it on: it got everything right on the radiation‑dose records program, and made the best insurance claim for a broken freezer. On the hospital ward it scored 96. Qwen3.8‑27B also got everything right on the radiation‑dose records program.
Every AI we tested
| AI | Size | Jobs tested | Everything right |
|---|---|---|---|
| Opus 5.5Anthropic | Large | 67 | 9 |
| GPT‑6.1 SolOpenAI | Mid‑sized | 78 | 8 |
| GPT‑6 AstraOpenAI | Large | 69 | 7 |
| Sonnet 5.5Anthropic | Mid‑sized | 65 | 3 |
| Fable 5.1Anthropic | Large | 50 | 3 |
| GPT‑6.1 TerraOpenAI | – | 5 | 2 |
| GPT‑6 LunaOpenAI | Small | 69 | 1 |
| Opus 5Anthropic | Large | 35 | 1 |
| DeepSeek V4.1 Flash openDeepSeek | Small | 13 | 1 |
| Qwen3.8‑27B openAlibaba | Small | 10 | 1 |
| GPT‑5.6 SolOpenAI | Large | 3 | 1 |
| Sonnet 5Anthropic | Mid‑sized | 35 | 0 |
| GPT‑6 SolOpenAI | Mid‑sized | 19 | 0 |
| GLM‑5.3‑Flash openZhipu | Small | 11 | 0 |
| Kimi K3 openMoonshot | Mid‑sized | 9 | 0 |
| Fable 5.2Anthropic | – | 8 | 0 |
| GPT‑5.6 LunaOpenAI | Small | 7 | 0 |
| Haiku 4.5Anthropic | Mid‑sized | 2 | 0 |
| Haiku 5.5Anthropic | – | 2 | 0 |
| Opus 4.8Anthropic | Large | 2 | 0 |
| GPT‑5.6 TerraOpenAI | – | 2 | 0 |
Everything right: the jobs where the AI met every check, every time we counted. We tested seven more AIs on one job each: DeepSeek V3.2 (DeepSeek), GLM‑5 (Zhipu), GLM‑5.3 (Zhipu), Gemini 4 Argon (Google), Kimi K2.5 (Moonshot), Nemotron Super 3 (NVIDIA), Qwen3‑235B (Alibaba).
Asapi