Tag
1 article
Tags cut across the blog’s categories: the articles below approach streaming from whichever angle their subject demanded — a pricing breakdown, a benchmark reading, a migration note, or a postmortem from running something in production. They are ordered newest first, so the top of the list reflects where our current thinking sits rather than where it started.
First-token latency is what users perceive, so streaming isn't optional. But every provider streams differently, and a mid-stream failure surfaces to your app as a truncated response. Here is what normalising the stream at the gateway actually buys you.
Articles tagged “streaming” also carry the tags below. They are ranked by how often they appear alongside this one, so the first few are the closest neighbours to what you are already reading.