Latenode

Anthropic cuts Claude Code first-token wait with gzip, prewarm

Agent teams can cut perceived latency without changing models by optimizing payload transfer and environment startup. Similar fixes may deliver bigger UX gains than small inference-speed improvements.

Anthropic cuts Claude Code first-token wait with gzip, prewarm

Anthropic says Claude Code now starts responding much faster after adding request gzip and session prewarming.

Claude Code compresses the conversation sent on each turn, reducing upload time for large contexts. Cloud sessions begin warming as soon as the user starts typing rather than waiting for submission, according to AICoder.

Anthropic’s reported p90 wait before the first token fell from 4.07 seconds to 1.33 seconds for local sessions and from 16.99 seconds to 6.00 seconds in the cloud. Those measurements exclude model inference time, so the gains come from transport and startup work rather than faster generation.

For builders, the playbook is practical: compress long conversational payloads, prewarm execution environments early, and test proxy compatibility. The changes follow the latency-focused approach described in Anthropic’s broader engineering account.

When models and APIs shift keep the workflow running

Connect the models and apps from stories like this in one scenario. If a vendor changes routing, pricing, or availability, you update the workflow — you don't start over.

Start Free

Free forever plan. No credit card required.