mcp-context-cost

shopify-dev — context cost

6,841 tokens across 6 tools — moderate (5–15K). Measured 2026-09-04 under methodology v1.0.

An Anthropic request carries 6,793 of those tokens as tool definitions, and Claude counts those at 11,831.

   
server (self-reported) shopify-dev-mcp v1.15.0
status measured
tokenizer tiktoken / o200k_base
launch command npx -y @shopify/dev-mcp@latest
isolation docker · public.ecr.aws/docker/library/node:22-slim · network bridge · linux/amd64 · network enabled for package fetch; clean FS, no host credentials
env vars supplied none
canonical SHA-256 6817cd262c23cdfbac2ac9e04b037d307d7d21907f9028707ae6dbac3f0a284d
category vendor-official
source https://shopify.dev/docs/apps/build/devmcp (GitHub repo not public)

Where the tokens are

tool tokens share description input schema
learn_shopify_api 2,847 41.6% 2,425 348
validate_graphql_codeblocks 1,273 18.6% 202 1,043
validate_component_codeblocks 1,173 17.1% 547 550
feedback 794 11.6% 421 345
validate_theme 451 6.6% 194 236
search_docs_chunks 301 4.4% 29 253

Each tool is tokenized on its own, so the parts do not sum exactly to the whole: the array adds its own brackets and commas, and the tokenizer merges tokens across object boundaries. The badge number is always the count of the whole array, never a sum of parts.

What this costs on Claude

Measured 2026-09-14 against claude-opus-5 via Anthropic’s count_tokens (method tools-delta/v1).

  tokens  
o200k, full capture 6,841 the badge number — every byte tools/list returned
o200k, Anthropic fields only 6,793 0.7% of the capture is MCP-only metadata
Claude, same fields 11,831 1.73× the badge number

An Anthropic tool definition carries name, description, and input_schema and nothing else, so title, annotations, outputSchema, execution, and icons are dropped before the request — that is the second row. The third row is the same tools counted by Anthropic, which is larger than the second because Anthropic’s tokenizer is denser on this content than o200k_base and the API adds its own framing (at most 328 tokens of it fixed, measured against a single minimal tool). The two effects run in opposite directions, which is why the Claude number is not a fixed multiple of the badge.

Over time

date tokens tools release measured in change
2026-08-16 5,624 5 not recorded not recorded —
2026-08-19 5,624 5 not recorded docker no change
2026-09-03 6,841 6 not recorded docker +1,217
2026-09-04 6,841 6 1.15.0 docker no change

Some of these sweeps predate the isolation column, so the conditions they were measured under are not on record.

Full series: results/history.csv.

Re-derive it

npx -y mcp-context-cost verify results/shopify-dev/measurement.json

That re-tokenizes the published capture and checks the count and the hash. If it disagrees with the badge, the badge is wrong — open an issue and it gets corrected.

Badge JSON · All servers · Leaderboard · Methodology