MMAchain
News

The Cache Hit Rate Is the New Gas Fee: What ZCode's 98.6% Efficiency Reveals About Agentic AI's Hidden Cost Geometry

CryptoPlanB
Dax Raad built a coding agent named OpenCode. He expected his own dogfooding to dominate a 48-hour cache-efficiency benchmark. He was wrong—by 0.74 percentage points, and by a factor of 1.2 in relative input cost. The leaderboard is not his. Zhipu's ZCode, a name he admits he doesn't recognize, posted a 98.60% client-side cache hit rate for DeepSeek traffic. OpenCode V2 landed at 97.86%. Claude Code / CLI—the product with the most aggressive enterprise behind it—stumbled to 89.31%. Raad's response was a public confession: "I don't know what ZCode is, but it's doing a really good job." That admission deserves a forensic read, and a broader one. In a market exhausted by sideways price action and low-conviction narratives, a raw efficiency metric like this is the only signal that speaks without white papers or marketing decks. The code does not lie, but it often omits. The forty-eight-hour sample is small. The token structures are not fully specified. The client-side measurement is self-reported. And yet, the underlying arithmetic is unforgiving. DeepSeek's pricing model charges roughly 50 times more for cache-miss inputs than for cache hits. That is not a minor spread; that is a structural cliff. If you take ZCode's hit rate at face value, the implied input cost for ZCode is about 27% of Claude Code's input cost, given identical token volumes. A 9.3 percentage point gap in hit rates does not translate to a 9.3% difference in spending. It translates to a 3.7x cost multiplier. This is the geometry of exponential cost curves hiding inside linear-looking percentages. I have seen this pattern before. In my work auditing DeFi protocols, a 0.1% fee difference can redirect billions in liquidity across exchanges. In EigenLayer restaking, a two-line slashing ambiguity can convert a supposed "shared security" model into a hidden liability calculator. The stakes are different, but the epistemic lesson is identical: when a system has a sharp non-linearity, the measured variable that seems stable—like an approval percentage or a hit rate—is rarely the variable that matters. The collapse or advantage lives in the tail. Here, the tail is the cache-miss rate. ZCode's miss rate is 1.40%. Claude Code's is 10.69%. That is a 7.6x difference in the tail. And the tail is where the money burns. Let's strip the narrative down to first principles. DeepSeek, like many LLM providers, offers a prompt-caching mechanism. When a client sends a request that shares a prefix with recent requests, the backend can reuse previously computed key-value states. The input price for that reuse is set at a fraction of the original computation. The cache hit rate, measured client-side, reflects how often that reuse actually happens. It is not a metric of model quality; it is a metric of system behavior. It measures how well the client shapes prompts to exploit the provider's caching pool. ZCode, for context, is an Agentic Development Environment—an ADE—launched by Zhipu, the Beijing-based AI lab behind the GLM-5.2 model. It was designed originally to showcase GLM's coding abilities, but it also supports third-party models. In that sense, ZCode is not a pure DeepSeek product. Yet its DeepSeek cache hit rate is the highest observed in this sample. The more interesting finding is that OpenCode V2, Raad's own project, is close behind at 97.86%. That suggests the architecture of an ADE—how it segments conversation context, when it rewrites system prompts, how it maintains session state—has a greater impact on cache efficiency than the model brand. This is where my own reading diverges from the mainstream takes. Most observers will interpret ZCode's number as a triumph for Zhipu. I interpret it as a data point that validates a broader thesis: the next performance frontier in agentic AI is not the model's parameter count, but the orchestration layer's ability to minimize computational redundancy. That is a security property, not a speed property. In my audit of cross-chain bridge designs, the same principle applied: you cannot secure what you repeatedly re-derive. A bridge that re-verifies the same state on every transaction is a bridge that eats its own fee revenue. The efficient solution is centralized verification of state transitions, with light client updates on the periphery. Cache hits are the light client version of token generation. Based on my audit experience, I can tell you that teams obsess over correctness and latency while ignoring the economics of repeated computation. I have seen smart contract teams write storage-heavy patterns that reconstruct the same booleans from scratch inside every function call. They passed security reviews, but they failed gas-efficiency reviews. The on-chain outcome: users paid 3x gas costs for zero additional security. The same failure mode exists in AI agent clients. If the client does not maintain a coherent prefix structure, it forces the model provider to recompute the same conversation state billions of times per day. The provider's cache misses are the client's bill. Compiling the truth from fragmented logs is my profession. When I see a 98.60% hit rate, I do not cheer. I ask about the 1.4% of misses. What causes them? Is it the first prompt after a session restart? Is it the injection of tool results that are too long to cache? Is it the model's own output feeding back as a new input with a changed prefix? These are the engineering details that separate a metric from a methodology. A 98.60% rate also raises a suspicious question: is ZCode's workload simply more homogeneous than Claude Code's? If ZCode's user base is smaller and more specialized—perhaps dominated by GLM-centric test suites or repetitive refactoring tasks—then the high hit rate might be a function of low diversity, not superior engineering. Dax Raad's own OpenCode V2, with 97.86%, is likely deployed by users who are also testing DeepSeek heavily. A concentrated user base produces a larger shared prefix pool, which naturally pushes hit rates higher. Claude Code's 89.31% could reflect a different reality. Anthropic's CLI may be used in more varied production environments, with users feeding it more unique codebases and contextual prompts. Diversity is the enemy of cache reuse. The system that solves the hardest, most varied tasks will always look worse on a hit-rate leaderboard. This is the same trap we see in blockchain validators: a validator with a highly correlated set of other validators can have perfect uptime while providing zero diversity for the network. Uptime is not a robustness metric. Similarly, hit rate is not a quality metric. Now, let's dig into the cost calculation itself. DeepSeek's cache-miss input cost is approximately 50x the cache-hit cost. If readers recall, this is not unprecedented in the AI industry, but it is aggressive. Providers use pricing to explicitly steer client design. A 50x differential is a directive: you must structure your prompts to be cache-friendly, or you will be priced out of the market. This is analogous to Ethereum's EIP-1559 fee mechanism, which penalizes bursty transactions that do not align with the network's base fee. The protocol does not care about the client's panic; it only cares about the equilibrium. Using the same token structure, ZCode's 98.60% rate yields a weighted cost multiplier of 1.686 (assuming hit cost = 1 and miss cost = 50). Claude Code's 89.31% rate yields a multiplier of 6.236. The ratio is 1.686 / 6.236 = 0.270. So you read the headline correctly: ZCode's input cost is approximately 27% of Claude Code's, for the same number of tokens. That is a 73% reduction in input spend. No model quality improvement on that scale can be achieved this quarter. But a client-side caching strategy can. This is where the "contrarian" angle is required. The bulls—the ones championing ZCode as the new king—are missing the more profound implication. The most significant financial winner here is not ZCode, not OpenCode, and not Claude Code. It is DeepSeek. By publishing a 48-hour cache telemetry benchmark, the community has started treating cache hit rate as a first-class competitive metric. That is exactly what a model provider wants. If users begin selecting clients based on hit rate, then every user is now optimizing for the provider's infrastructure efficiency. Dax's own stunned tweet became free marketing for DeepSeek's pricing structure. The model provider sells the shovel, and the clients are now competing on how efficiently they use the shovel. It is brilliant. But the bulls also got a second thing right: ZCode's high hit rate, combined with its support for external models, suggests that the ADE layer is becoming the real customer lock-in surface. A developer who builds a workflow on ZCode and sees a 98.60% hit rate now has an explicit incentive to remain within that ecosystem—even if they switch models. The agent client owns the prompt cache. This is analogous to a DeFi wallet that accumulates withdrawal stamps and social recovery data: the more history it holds, the costlier to leave. The geometric trust model changes from "I trust the model" to "I trust the client to remember my session." Security is the absence of assumptions. In a zero-knowledge world, we verify. In the AI agent world, there is no such verification mechanism for cache claims. Dax Raad himself only knows his own client's numbers. ZCode's 98.60% is a self-reported number from a third party. We have no on-chain data to confirm the token structure, no public logs. This is exactly why my discipline matters: the code does not lie, but the omission of its measurement conditions does. We need standardized benchmark setups, with fixed prompt templates, fixed session durations, and fixed model routers. Until then, the 48-hour hit-rate chart is a hint, not a verdict. My advice to protocol builders who are watching this from the sidelines is different from what most AI commentators expect. Do not chase the highest hit rate. Chase the cache-hit architecture that is least sensitive to user diversity. A client that maintains 98% hit rate across a diverse workload is a system that has solved context compression, prefix reuse, and dynamic prompting in a way that is analogous to a well-designed rollup: it batches state, verifies minimally, and only touches the base layer when necessary. This also maps to the deeper market context. The current sideways market in crypto is forcing every builder to focus on costs. L2 fees are being scrutinized. Validator efficiency is being audited. AI agent infrastructure is no different. The teams that survive this consolidation will be the ones that internalize the geometry of recurring costs. And right now, the geometry says that a one-percentage-point improvement in cache hit rate is worth more than a twenty-percent improvement in response latency. Take the contrarian step further. Claude Code's 89.31% hit rate, while appearing inferior on this chart, might be the result of Anthropic's deliberate refusal to bias its CLI toward any single provider. Claude Code does not just work with DeepSeek; it works with Claude models, with OpenAI-compatible endpoints, with local inference. A multi-provider client has to fragment its context pools across many backends. That fragmentation reduces cache hit rates across each individual provider. The lower number is not a failure of engineering; it is a cost of portability. ZCode, by contrast, was designed primarily for GLM-5.2, and even though it supports other models, its DeepSeek traffic likely shares a consistent prompt template. The hit rate is high because the workload is narrow. If I were auditing this data for an investor, I would ask for a second dataset: cache hit rate by session length. Short sessions naturally have a lower prefix reuse; long sessions that stay under the same topic will have increasingly high hit rates. A tool that resets session context aggressively will crash in hit rate. A tool that maintains a persistent session tree will excel. The real engineering skill is knowing when to reuse and when to invalidate. That is not a static policy; it is a dynamic optimization. Zero trust is not a policy; it is a geometry. In the world of smart contracts, zero trust means every cross-contract call re-verifies calldata, leading to quadratic overhead. In the world of AI agents, zero trust of your own client's memory means you re-send redundant context in every API call, destroying your cache hit rate and multiplying your input bill. The lesson is the same on both sides: trust, when correctly designed, is not a vulnerability. It is a compression. Let me put this in terms that my audit reports would use: The 2x2x4 protocol had a reentrancy flaw because it recalculated the user's balance on every external call instead of trusting a checked internal state. The fix was not to remove trust; it was to define a single source of truth. Similarly, the high cache hit rate of ZCode is not a mystery. It means ZCode has defined a single source of truth for its conversation state. It keeps the prefix stable. It only changes the suffix. That is a classic algebraic optimization. In the end, the most important output here is the signal for the industry. The next generation of AI development environments will be judged not by their feature list, but by their cost-to-complete-a-task. The cache hit rate is the tip of that iceberg. It is the on-chain equivalent of the MEV extraction rate: a single number that hides an enormous amount of underlying mechanics. Those who can dissect the mechanics will find the edge. The future is not building a better model. It is building a better way to not recompute the past. The last question I would pose to Dax Raad and every other coding agent builder is this: if your cache hit rate suddenly became public on-chain data, would your architecture survive the audit? Because that is the direction we are heading. When AI agents start transacting with each other, the cache hit rate will become a financial primitive—a cost oracle for agentic compute. And in a world of 50x penalties, the geometry of trust will decide who lives and who dies. The code does not lie. The omission of its cache policy, however, is a lie by default. Verify the hit rate; verify the token context; verify the session distribution. Then, and only then, let the leaderboard speak.

The Cache Hit Rate Is the New Gas Fee: What ZCode's 98.6% Efficiency Reveals About Agentic AI's Hidden Cost Geometry

Market Prices

BTC Bitcoin
$65,016.6 +1.04%
ETH Ethereum
$1,917.3 +0.89%
SOL Solana
$74.63 +2.56%
BNB BNB Chain
$593.4 +0.66%
XRP XRP Ledger
$1.04 +1.20%
DOGE Dogecoin
$0.0702 +1.55%
ADA Cardano
$0.2011 +0.55%
AVAX Avalanche
$6.52 +1.86%
DOT Polkadot
$0.8221 +0.50%
LINK Chainlink
$8.26 +1.30%

Fear & Greed

30

Fear

Market Sentiment

Event Calendar

{{年份}}
15
04
halving Bitcoin Halving

Block reward reduced to 3.125 BTC

22
03
unlock Optimism Unlock

Circulating supply increases by about 2%

30
04
upgrade Celestia Mainnet Upgrade

Improves data availability sampling efficiency

18
03
unlock Sui Token Unlock

Team and early investor shares released

28
03
unlock Arbitrum Token Unlock

92 million ARB released

08
04
upgrade Solana Firedancer

Independent validator client goes live on mainnet

10
05
upgrade Ethereum Pectra Upgrade

Raises validator limit and account abstraction

12
05
halving BCH Halving

Block reward halving event

Altseason Index

43

Bitcoin Season

BTC Dominance Altseason

Gas Tracker

Ethereum 28 Gwei
BNB Chain 3 Gwei
Polygon 42 Gwei
Arbitrum 0.5 Gwei
Optimism 0.3 Gwei

Market Cap

All →
# Coin Price
1
Bitcoin BTC
$65,016.6
1
Ethereum ETH
$1,917.3
1
Solana SOL
$74.63
1
BNB Chain BNB
$593.4
1
XRP Ledger XRP
$1.04
1
Dogecoin DOGE
$0.0702
1
Cardano ADA
$0.2011
1
Avalanche AVAX
$6.52
1
Polkadot DOT
$0.8221
1
Chainlink LINK
$8.26

🐋 Whale Tracker

🔵
0xdfcb...ef42
6h ago
Stake
35,670 SOL
🔴
0x25e3...e383
6h ago
Out
41,293 SOL
🟢
0x6146...03d4
1h ago
In
1,791 ETH

💡 Smart Money

0x184f...fd94
Experienced On-chain Trader
-$1.4M
95%
0x6b18...9011
Arbitrage Bot
+$3.8M
88%
0x48bb...b6c8
Experienced On-chain Trader
+$3.4M
61%

Tools

All →