Parallel vs sequential tool calls: what does each cost?
Modern models can call several tools in a single response (parallel tool calling) instead of one tool per round trip (sequential). For multi-tool agent turns the difference is large, because every sequential round trip re-sends the entire growing context as input. This calculator estimates the token cost of each strategy so you can quantify the savings before you architect a workflow.
Why sequential calling is expensive
When a model calls tools one at a time, each round trip is a full API request. That means:
- The system prompt is re-sent as input (again)
- All tool schemas are re-sent as input (again)
- The conversation so far — including any previous tool calls and results — is re-sent as input
- The model generates its next tool call as output
- Your code calls the tool, gets a result, and adds it to the conversation
- Repeat for every remaining tool
With N tools, you pay for the base context roughly N times. The context also grows with each step as results accumulate, so later round trips are more expensive than earlier ones.
How parallel calling differs
When a model supports parallel tool calling, it returns all N tool calls in a single response. You execute them concurrently, collect the results, and send one final request with all results included. The base context is read only once, and total latency drops to the latency of the slowest single tool — not the sum of all tool latencies.
sequential_input ≈ Σ over N round trips of (base + schemas + accumulated results)
parallel_input ≈ base + schemas + one round of results (read once)
The calculator applies your model’s input price to both and multiplies by your daily turn volume to show the cost gap.
Worked example
Consider a 3-tool workflow: a database lookup, a web search, and a calendar check. Each tool schema is 200 tokens. The base context (system prompt + conversation) is 1,000 tokens. Each result is 100 tokens.
Sequential input tokens:
- Round 1: 1,000 base + 600 schemas = 1,600
- Round 2: 1,000 + 600 + 100 result = 1,700
- Round 3: 1,000 + 600 + 200 results = 1,800
- Total input: 5,100 tokens + 3 output responses
Parallel input tokens:
- Single round: 1,000 + 600 = 1,600 plus one output with 3 tool calls
- Follow-up: 1,000 + 600 + 300 results = 1,900
- Total input: 3,500 tokens + 2 output responses
That is a roughly 31% reduction in input tokens for just three tools. With 10 tools the gap widens substantially.
Tips for cheaper tool use
- Prefer parallel calling for independent tools. If three lookups do not depend on each other’s outputs, request them in one response. Tools that depend on each other’s results must still run sequentially.
- Keep tool schemas lean. Every exposed tool’s JSON definition is re-sent as input on each call — trim descriptions and redundant parameter docs without removing information that affects model behaviour.
- Cache the static prefix. The system prompt plus tool schemas are stable across calls and are ideal candidates for prompt caching. On models with caching support, the cache hit dramatically reduces the cost of both strategies, but the parallel advantage remains.
- Prune unused tools. Schemas for tools that a given turn will never call still cost tokens on every round trip. Dynamically selecting only the relevant tool subset can cut schema overhead significantly for agents with many available tools.