Skip to main content
Measured savings across 11 LLMs — Claude Opus 4.7 to Gemini Flash.→ See per-model data
Connect your client
FeaturedResearchSources: 4

Perfect retrieval isn't enough: the hidden cost of long LLM context

LLMs lose 13.9%–85% accuracy as context grows even with perfect retrieval and full masking. Compression is a lever that improves accuracy and cost at the same time.

2026-06-01James Hollingsworth7 min read read

All posts

Engineering, research, cost, and tutorial posts in one feed.

Showing 10 of 44
Date
Title
Category
Author
2026-05-20We Compressed a 3,448-Line MCP Gateway to a Searchable Symbol MapEngineeringJames Hollingsworth2026-05-19Resend bounce handling, PostHog funnel instrumentation, and an AST fence against billing driftEngineeringJames Hollingsworth2026-05-09How we measure quality at 5× compression: corpora, judge prompts, and anti-bias controlsResearchJames Hollingsworth2026-05-09gotcontext + TokenSpeed: stack input compression with TRT-LLM-class inference for self-hostersEngineeringJames Hollingsworth2026-05-08gotcontext + rtk: stack two compression layers, kill 90%+ of your token billEngineeringJames Hollingsworth2026-05-08Your LLM Gets Measurably Worse as the Conversation Grows. All of Them Do.ResearchJames Hollingsworth2026-05-08You Can Cut Chain-of-Thought Token Costs ~66% With One Prompt ChangeEngineeringJames Hollingsworth2026-05-08Why Long Agent Sessions Fall Apart (And the Paper That Explains It)EngineeringJames Hollingsworth2026-05-08What Chunking Strategy Actually Matters for RAG QualityResearchJames Hollingsworth2026-05-08Vision Tokens Are Expensive and Nobody Reads the Pricing PageCostJames Hollingsworth
Email updates
One engineering post a week,
no marketing in between.

Long-form pieces from the team building gotcontext. Compression internals, model evals, customer post-mortems. RSS feed available — see /blog/rss.xml. Unsubscribe with one click.

Subscribe — one engineering post a weekSubscribing creates a free gotcontext account. You can unsubscribe from emails without canceling the account.