Api

Does asking for top-k logprobs add real compute cost per token, or only bytes on the wire?

A response comes back with finish_reason = 'length' which interpretation is correct?

Bytes, characters, tokens: which one gets billed and how do they relate?

Define a stop sequence in an LLM API call

Server-Sent Events streaming: define it and explain why chat APIs default to it