Estimated AI Usage Costs
Where the bill comes from
How token size changes cost per user
COST PER USER / MONTH
Each line changes only that token size while keeping the rest of your Expected scenario fixed. The Y-axis shows API cost per active user per month.
Magenta marks the Max token setting on the same Expected-usage baseline, so the graph isolates token-size impact rather than mixing in heavier usage assumptions.
What does “500 tokens” actually look like?
Rough English-text examples. They are orientation, not a tokenizer. Your current settings are highlighted and update with the controls.
User prompt
Everything sent to the model: instructions, question, pasted text, documents and chat history.
AI reply
The billable model output. For reasoning models, provider-reported reasoning tokens can also matter.
Text size is easy to estimate roughly; agentic and multimodal work is not. A single visible user action can create several billable calls behind the scenes.
Three cost levers to test first.
There is no honest universal percentage split: the weight depends on your model and workload. These are the levers with the clearest effect.
Pass the quality test first
Same workload, different unit price.
How to find out: run the same 10–20 real tasks on a few models and compare quality, latency and cost.
Count what one user action really triggers
Within the same model and token sizes, 2× as many API calls means about 2× the API cost.
How to find out: log actual API calls per user action, especially for agents, retries and tool loops.
Measure payload, history and output
Within the same model, doubling both input and output tokens roughly doubles token cost.
How to find out: inspect real usage tokens and watch repeated history, documents and long reasoning/output.
Keep usage under control
Someone scripts a public form and fires requests in a loop. No login, no rate limit, no daily cap — it happens to free tools constantly. This stress test shows what that burst costs at your current prompt size.
Current burst stress test: —.
A public AI feature without limits is a blank cheque. Max expected is a planning scenario, not a spending limit.
Get a useful range, not one magic number.
Founders, product owners, indie devs, agencies and technical PMs planning or pricing an AI feature.
Start broad. Then keep everything fixed and change one thing at a time. Compare a few models and scenarios.
Precise production billing. If you already have real usage telemetry, use that instead.
Same workload. Different model.
All bars use the same cost scale. Select a model to update the estimate; test quality on your own tasks.
| Model | Expected | Max expected |
|---|
Alternatives are the lowest-cost models in the supplied frontier and fast tiers. These tiers are editorial guidance, not a guarantee of task quality.
The same workload can cost wildly different amounts across models. Model choice is usually the first lever to test before squeezing prompts or betting on caching.
Model fit
Consider it for
Think twice for
Fit notes are supplied editorial guidance. Validate with your own examples.
Detailed assumptions & pricing
Calculation: users × requests per user/day × active days × token cost per request. Input cost includes the cache-hit share at the cached rate; output is billed separately.
Standard text-token rates only. Excludes cache-write and storage fees, tools, images, audio, retries, batch discounts and taxes. Include all billable output in your output-token estimate. Prices and model availability are not fetched live.
What these words mean.
TokenA chunk of text, roughly ¾ of an English word. 1,000 tokens is roughly 750 words, but language and content change the ratio.
Input / user promptEverything you send: the question, system prompt, attached text/documents and relevant chat history.
Output / AI replyWhat the model writes back. Reasoning models may also report billable reasoning/output tokens depending on provider.
Cached inputRepeated context the provider can serve at a lower rate when its cache rules are actually met.
Context windowThe maximum the model can hold at once. It is a limit, not the amount you automatically pay for.
Batch / Flex / FastAlternative processing modes some providers offer. This estimator uses its saved standard-rate dataset unless explicitly stated otherwise.
Rate limitA cap on how often a user or client can call the API. One of the cheapest protections against runaway usage.