The Lab · Tracker
AI models compared: price and performance
Nine AI models, one from each of nine labs: what they cost to use, how they score on independent coding and reasoning tests, and how fast they write. Every number has a source, linked in the table or in the notes below it.
Updated Oct 8, 2026
What changed
- Oct 8, 2026 Launched with nine models from nine labs.
| Checked | ||||||||
|---|---|---|---|---|---|---|---|---|
| Claude Opus 5.5 Anthropic | $4 / $20 | 1M | Sep 22, 2026 | Closed | Oct 8, 2026 | |||
| max | 65.15% | 92.2 | 96 | |||||
| xhigh | No score | No score | 80 | |||||
| high | No score | No score | 75 | |||||
| medium | No score | No score | 75 | |||||
| low | No score | No score | 69 | |||||
| GPT-6 Astra OpenAI | $10 / $50 | 1.05M | Sep 3, 2026 | Closed | Oct 8, 2026 | |||
| max | 59.6% | 92.7 | 44 | |||||
| xhigh | No score | No score | 43 | |||||
| high | No score | No score | 42 | |||||
| medium | No score | No score | 41 | |||||
| low | No score | No score | 43 | |||||
| Qwen3.8 Max Alibaba | $2 / $6 | 1M | Aug 2, 2026 | Open base model | Oct 8, 2026 | |||
| level not stated | 34.34% | 88.2 | 36 | |||||
| Grok 4.7 SpaceXAI | $2 / $6 | 500K | Sep 21, 2026 | Closed | Oct 8, 2026 | |||
| xhigh | 28.79% | 82.7 | 68 | |||||
| high | No score | No score | 64 | |||||
| low | No score | No score | 60 | |||||
| Muse Spark 1.3 Meta | $1.25 / $4.25 | 1M | Sep 2, 2026 | Closed | Oct 8, 2026 | |||
| max | 24.75% | No score | 177 | |||||
| xhigh | 10.61% | 89.7 | 189 | |||||
| Mistral Large 4 Mistral | $1.36 / $4.18 | 1M | Oct 6, 2026 | Closed | Oct 8, 2026 | |||
| high | 22.73% | 83.9 | No score | |||||
| level not stated | No score | No score | 116 | |||||
| DeepSeek V4.1 Flash DeepSeek | $0.30 / $1.20 | 1M | Sep 10, 2026 | Open | Oct 8, 2026 | |||
| max | 19.7% | 86.7 | 217 | |||||
| non-reasoning | No score | No score | 207 | |||||
| Gemini 3.8 Flash Google | $0.75 / $3.75 | 1.05M | Sep 2, 2026 | Closed | Oct 8, 2026 | |||
| high | 19.19% | 89.3 | 117 | |||||
| Kimi K3 Moonshot AI | $3 / $15 | 1.05M | Jul 2026 | Open | Oct 8, 2026 | |||
| max | 17.17% | No score | 41 | |||||
| low | No score | No score | 40 | |||||
| level not stated | No score | 90.7 | No score |
Claude Opus 5.5 Anthropic $4 / $20 Coding 65.15%
- Price per 1M
- $4 in / $20 out
- Context window
- 1,000,000 tokens
- Released
- Sep 22, 2026
- Weights
- Closed
| Level | Coding | Reasoning | Speed |
|---|---|---|---|
| max | 65.15% | 92.2 | 96 |
| xhigh | No score | No score | 80 |
| high | No score | No score | 75 |
| medium | No score | No score | 75 |
| low | No score | No score | 69 |
Vals says 22 of Opus 5.5's 198 coding attempts were answered by older Claude models through a provider fallback. Counting those as failures lowers its score to 58.08%. Artificial Analysis also marks its Opus 5.5 speed results as including fallback.
GPT-6 Astra OpenAI $10 / $50 Coding 59.6%
- Price per 1M
- $10 in / $50 out
- Context window
- 1,050,000 tokens
- Released
- Sep 3, 2026
- Weights
- Closed
| Level | Coding | Reasoning | Speed |
|---|---|---|---|
| max | 59.6% | 92.7 | 44 |
| xhigh | No score | No score | 43 |
| high | No score | No score | 42 |
| medium | No score | No score | 41 |
| low | No score | No score | 43 |
Prompts with more than 272K input tokens are billed at twice the input and cache rates and 1.5 times the output rate for the full request.
Qwen3.8 Max Alibaba $2 / $6 Coding 34.34%
- Price per 1M
- $2 in / $6 out
- Context window
- 1,000,000 tokens
- Released
- Aug 2, 2026
- Weights
- Open base model
| Level | Coding | Reasoning | Speed |
|---|---|---|---|
| level not stated | 34.34% | 88.2 | 36 |
The price shown is Alibaba's international rate. Alibaba says Max is based on Qwen3.8-2.4T-A95B, whose weights it publishes. Artificial Analysis tested the September 2 snapshot of Max; the other two leaderboards don't say which snapshot they tested.
Grok 4.7 SpaceXAI $2 / $6 Coding 28.79%
- Price per 1M
- $2 in / $6 out
- Context window
- 500,000 tokens
- Released
- Sep 21, 2026
- Weights
- Closed
| Level | Coding | Reasoning | Speed |
|---|---|---|---|
| xhigh | 28.79% | 82.7 | 68 |
| high | No score | No score | 64 |
| low | No score | No score | 60 |
Prompts over 200K tokens cost $4 in and $12 out.
Muse Spark 1.3 Meta $1.25 / $4.25 Coding 24.75%
- Price per 1M
- $1.25 in / $4.25 out
- Context window
- 1,000,000 tokens
- Released
- Sep 2, 2026
- Weights
- Closed
| Level | Coding | Reasoning | Speed |
|---|---|---|---|
| max | 24.75% | No score | 177 |
| xhigh | 10.61% | 89.7 | 189 |
Meta's Contributor tier costs $0.10 in and $0.20 out if you let Meta train on your prompts and completions.
Mistral Large 4 Mistral $1.36 / $4.18 Coding 22.73%
- Price per 1M
- $1.36 in / $4.18 out
- Context window
- 1,000,000 tokens
- Released
- Oct 6, 2026
- Weights
- Closed
| Level | Coding | Reasoning | Speed |
|---|---|---|---|
| high | 22.73% | 83.9 | No score |
| level not stated | No score | No score | 116 |
Released as a public preview. The price shown is the list price. Mistral set launch pricing at 50% off for two weeks, which came to $0.68 in and $2.09 out when we checked. Mistral says open weights are coming soon.
DeepSeek V4.1 Flash DeepSeek $0.30 / $1.20 Coding 19.7%
- Price per 1M
- $0.30 in / $1.20 out
- Context window
- 1,000,000 tokens
- Released
- Sep 10, 2026
- Weights
- Open
| Level | Coding | Reasoning | Speed |
|---|---|---|---|
| max | 19.7% | 86.7 | 217 |
| non-reasoning | No score | No score | 207 |
The price shown is DeepSeek's peak-hours rate. Off-peak is half. Vals lists max effort in its model settings, though its write-up says its evaluations ran at high effort.
Gemini 3.8 Flash Google $0.75 / $3.75 Coding 19.19%
- Price per 1M
- $0.75 in / $3.75 out
- Context window
- 1,048,576 tokens
- Released
- Sep 2, 2026
- Weights
- Closed
| Level | Coding | Reasoning | Speed |
|---|---|---|---|
| high | 19.19% | 89.3 | 117 |
The price shown runs until December 31, 2026. From January 1, 2027, it is $1.50 in and $7.50 out.
Kimi K3 Moonshot AI $3 / $15 Coding 17.17%
- Price per 1M
- $3 in / $15 out
- Context window
- 1,048,576 tokens
- Released
- Jul 2026
- Weights
- Open
| Level | Coding | Reasoning | Speed |
|---|---|---|---|
| max | 17.17% | No score | 41 |
| low | No score | No score | 40 |
| level not stated | No score | 90.7 | No score |
Moonshot's changelog dates the release to July 2026 without a day.
How to read this
Tokens are the small chunks of text, often parts of words, that models read and write. Prices are each lab's standard API rate in US dollars per million tokens, taken from the lab's own pages. Input is what you send the model; output is what it writes back. The Checked column gives the date we last compared the price with its source.
Scores come from independent leaderboards that test every model on the same tasks. We don't use the scores labs publish about their own models, because each lab tests in its own way. Coding is Vals.ai Terminal-Bench 4.0 (the share of 66 long, realistic tasks an AI agent completes in a computer terminal). Reasoning is LiveBench Reasoning (the average score out of 100 across LiveBench's reasoning tasks). Speed is Artificial Analysis (the median number of tokens a model writes per second).
Most of these models can be set to think for longer before answering, at a higher cost. Each row under a model is one of those settings, called a thinking level. Where a leaderboard's table shows no result for a level, the cell says "No score", and we never fill the gap from another level or another source. "Level not stated" means the source didn't say which level it used.
The context window is the most text, counted in tokens, that a model can handle in one request. "Open" in the Weights column means the lab publishes the trained model, known as its weights, for anyone to download and run. "Open base model" means the lab publishes the weights of the model this one is built on.
Claude Opus 5.5: Vals says 22 of Opus 5.5's 198 coding attempts were answered by older Claude models through a provider fallback. Counting those as failures lowers its score to 58.08%. Artificial Analysis also marks its Opus 5.5 speed results as including fallback.
GPT-6 Astra: Prompts with more than 272K input tokens are billed at twice the input and cache rates and 1.5 times the output rate for the full request.
Gemini 3.8 Flash: The price shown runs until December 31, 2026. From January 1, 2027, it is $1.50 in and $7.50 out.
Grok 4.7: Prompts over 200K tokens cost $4 in and $12 out.
Muse Spark 1.3: Meta's Contributor tier costs $0.10 in and $0.20 out if you let Meta train on your prompts and completions.
DeepSeek V4.1 Flash: The price shown is DeepSeek's peak-hours rate. Off-peak is half. Vals lists max effort in its model settings, though its write-up says its evaluations ran at high effort.
Mistral Large 4: Released as a public preview. The price shown is the list price. Mistral set launch pricing at 50% off for two weeks, which came to $0.68 in and $2.09 out when we checked. Mistral says open weights are coming soon.
Qwen3.8 Max: The price shown is Alibaba's international rate. Alibaba says Max is based on Qwen3.8-2.4T-A95B, whose weights it publishes. Artificial Analysis tested the September 2 snapshot of Max; the other two leaderboards don't say which snapshot they tested.
Kimi K3: Moonshot's changelog dates the release to July 2026 without a day.