The Lab · Tracker

AI models compared: price and performance

Nine AI models, one from each of nine labs: what they cost to use, how they score on independent coding and reasoning tests, and how fast they write. Every number has a source, linked in the table or in the notes below it.

Updated Oct 8, 2026

What changed

  • Oct 8, 2026 Launched with nine models from nine labs.
Claude Opus 5.5 Anthropic $4 / $20 Coding 65.15%
Price per 1M
$4 in / $20 out
Context window
1,000,000 tokens
Released
Sep 22, 2026
Weights
Closed
Level Coding Reasoning Speed
max 65.15% 92.2 96
xhigh No score No score 80
high No score No score 75
medium No score No score 75
low No score No score 69

Vals says 22 of Opus 5.5's 198 coding attempts were answered by older Claude models through a provider fallback. Counting those as failures lowers its score to 58.08%. Artificial Analysis also marks its Opus 5.5 speed results as including fallback.

GPT-6 Astra OpenAI $10 / $50 Coding 59.6%
Price per 1M
$10 in / $50 out
Context window
1,050,000 tokens
Released
Sep 3, 2026
Weights
Closed
Level Coding Reasoning Speed
max 59.6% 92.7 44
xhigh No score No score 43
high No score No score 42
medium No score No score 41
low No score No score 43

Prompts with more than 272K input tokens are billed at twice the input and cache rates and 1.5 times the output rate for the full request.

Qwen3.8 Max Alibaba $2 / $6 Coding 34.34%
Price per 1M
$2 in / $6 out
Context window
1,000,000 tokens
Released
Aug 2, 2026
Weights
Open base model
Level Coding Reasoning Speed
level not stated 34.34% 88.2 36

The price shown is Alibaba's international rate. Alibaba says Max is based on Qwen3.8-2.4T-A95B, whose weights it publishes. Artificial Analysis tested the September 2 snapshot of Max; the other two leaderboards don't say which snapshot they tested.

Grok 4.7 SpaceXAI $2 / $6 Coding 28.79%
Price per 1M
$2 in / $6 out
Context window
500,000 tokens
Released
Sep 21, 2026
Weights
Closed
Level Coding Reasoning Speed
xhigh 28.79% 82.7 68
high No score No score 64
low No score No score 60

Prompts over 200K tokens cost $4 in and $12 out.

Muse Spark 1.3 Meta $1.25 / $4.25 Coding 24.75%
Price per 1M
$1.25 in / $4.25 out
Context window
1,000,000 tokens
Released
Sep 2, 2026
Weights
Closed
Level Coding Reasoning Speed
max 24.75% No score 177
xhigh 10.61% 89.7 189

Meta's Contributor tier costs $0.10 in and $0.20 out if you let Meta train on your prompts and completions.

Mistral Large 4 Mistral $1.36 / $4.18 Coding 22.73%
Price per 1M
$1.36 in / $4.18 out
Context window
1,000,000 tokens
Released
Oct 6, 2026
Weights
Closed
Level Coding Reasoning Speed
high 22.73% 83.9 No score
level not stated No score No score 116

Released as a public preview. The price shown is the list price. Mistral set launch pricing at 50% off for two weeks, which came to $0.68 in and $2.09 out when we checked. Mistral says open weights are coming soon.

DeepSeek V4.1 Flash DeepSeek $0.30 / $1.20 Coding 19.7%
Price per 1M
$0.30 in / $1.20 out
Context window
1,000,000 tokens
Released
Sep 10, 2026
Weights
Open
Level Coding Reasoning Speed
max 19.7% 86.7 217
non-reasoning No score No score 207

The price shown is DeepSeek's peak-hours rate. Off-peak is half. Vals lists max effort in its model settings, though its write-up says its evaluations ran at high effort.

Gemini 3.8 Flash Google $0.75 / $3.75 Coding 19.19%
Price per 1M
$0.75 in / $3.75 out
Context window
1,048,576 tokens
Released
Sep 2, 2026
Weights
Closed
Level Coding Reasoning Speed
high 19.19% 89.3 117

The price shown runs until December 31, 2026. From January 1, 2027, it is $1.50 in and $7.50 out.

Kimi K3 Moonshot AI $3 / $15 Coding 17.17%
Price per 1M
$3 in / $15 out
Context window
1,048,576 tokens
Released
Jul 2026
Weights
Open
Level Coding Reasoning Speed
max 17.17% No score 41
low No score No score 40
level not stated No score 90.7 No score

Moonshot's changelog dates the release to July 2026 without a day.

How to read this

Tokens are the small chunks of text, often parts of words, that models read and write. Prices are each lab's standard API rate in US dollars per million tokens, taken from the lab's own pages. Input is what you send the model; output is what it writes back. The Checked column gives the date we last compared the price with its source.

Scores come from independent leaderboards that test every model on the same tasks. We don't use the scores labs publish about their own models, because each lab tests in its own way. Coding is Vals.ai Terminal-Bench 4.0 (the share of 66 long, realistic tasks an AI agent completes in a computer terminal). Reasoning is LiveBench Reasoning (the average score out of 100 across LiveBench's reasoning tasks). Speed is Artificial Analysis (the median number of tokens a model writes per second).

Most of these models can be set to think for longer before answering, at a higher cost. Each row under a model is one of those settings, called a thinking level. Where a leaderboard's table shows no result for a level, the cell says "No score", and we never fill the gap from another level or another source. "Level not stated" means the source didn't say which level it used.

The context window is the most text, counted in tokens, that a model can handle in one request. "Open" in the Weights column means the lab publishes the trained model, known as its weights, for anyone to download and run. "Open base model" means the lab publishes the weights of the model this one is built on.

Claude Opus 5.5: Vals says 22 of Opus 5.5's 198 coding attempts were answered by older Claude models through a provider fallback. Counting those as failures lowers its score to 58.08%. Artificial Analysis also marks its Opus 5.5 speed results as including fallback.

GPT-6 Astra: Prompts with more than 272K input tokens are billed at twice the input and cache rates and 1.5 times the output rate for the full request.

Gemini 3.8 Flash: The price shown runs until December 31, 2026. From January 1, 2027, it is $1.50 in and $7.50 out.

Grok 4.7: Prompts over 200K tokens cost $4 in and $12 out.

Muse Spark 1.3: Meta's Contributor tier costs $0.10 in and $0.20 out if you let Meta train on your prompts and completions.

DeepSeek V4.1 Flash: The price shown is DeepSeek's peak-hours rate. Off-peak is half. Vals lists max effort in its model settings, though its write-up says its evaluations ran at high effort.

Mistral Large 4: Released as a public preview. The price shown is the list price. Mistral set launch pricing at 50% off for two weeks, which came to $0.68 in and $2.09 out when we checked. Mistral says open weights are coming soon.

Qwen3.8 Max: The price shown is Alibaba's international rate. Alibaba says Max is based on Qwen3.8-2.4T-A95B, whose weights it publishes. Artificial Analysis tested the September 2 snapshot of Max; the other two leaderboards don't say which snapshot they tested.

Kimi K3: Moonshot's changelog dates the release to July 2026 without a day.

New in AI Briefings

Every part of AI that's moving, in your inbox.

Not a link dump. What actually moved across all five beats (a model release, a deployment, a deal) and what it changes for the people paying for it.

Free · No spam · Unsubscribe in one click

General

The big AI story of the day, whoever it happens to

The Lab

Frontier models, research and the labs building them

AI at Work

Adoption, tools and how the job actually changes

E-commerce

AI for merchants, marketplaces and marketing

The Exchange

AI capital and compute crossing borders