Articles tagged “API Design”
3 articles in the library
#API Design
Clear filters
5 min readGuideMay 31, 2026
Prompt Caching Explained: Anthropic, OpenAI, and the Math
How prompt caching works at Anthropic and OpenAI in 2026 — cache breakpoints, write and read pricing, TTL, breakeven math, and how to design cache-friendly prompts.
Read more
6 min readGuideMay 31, 2026
Rate Limiting AI APIs: Strategies That Actually Work
A 2026 guide to AI API rate limiting — token bucket, sliding window, per-tenant fairness, 429 handling, and Redis-backed scale patterns.
Read more
6 min readGuideMay 16, 2026
Streaming AI Responses: SSE, WebSockets, and the Pitfalls
A 2026 production guide to streaming LLM responses — SSE vs WebSockets, TTFT targets, backpressure, client-disconnect handling, and error recovery.
Read more