LLM Throughput Calculator
See response time and throughput at a given tokens/sec.
Results update automatically as you type.
Result
8.73s per response
~6.9 responses/minute per stream
- Time to first token
- 400 ms
- Generation time
- 8.33 s
- Total per response
- 8.73 s
- Responses / minute
- 6.9
Enter output length, generation speed and time-to-first-token to see how long a response takes and how many responses per minute a single stream can produce.
How this is calculated
This calculator uses the infrastructure formulas described in our methodology. All figures are estimates for planning; verify current pricing with each provider before relying on them.
Worked example (defaults)
With the default inputs above, here is the result:
Result
8.73s per response
~6.9 responses/minute per stream
- Time to first token
- 400 ms
- Generation time
- 8.33 s
- Total per response
- 8.73 s
- Responses / minute
- 6.9
Frequently asked questions
What is time to first token?+
The delay before the first output token appears. It matters a lot for perceived responsiveness in chat UIs.
How do I get more throughput?+
Batch requests, use faster/smaller models, or add more replicas. See our concurrency planner.