Streaming

Order the stream parts emitted by streamText for one tool call plus a final text response

Match each LCEL Runnable method to the call pattern it is designed for

Pick the right LangGraph stream_mode for showing tokens vs node updates

Why production chat UIs stream tokens token by token instead of returning the full reply

Does asking for top-k logprobs add real compute cost per token, or only bytes on the wire?

TTFT: name the metric it captures and what dominates it

Server-Sent Events streaming: define it and explain why chat APIs default to it

Walk through the shape of an OpenAI compatible chat completions request and response.

Does Anthropic's message_start event count toward TTFT in production benchmarks?

Match TTFT and TPOT to the latency they measure during streaming

Why does streaming (SSE) improve perceived latency without changing total decode time?