Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Inference Optimization
/
Api
Api
Subtopic
5 questions
Questions tagged with Api — part of Inference Optimization.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Does asking for top-k logprobs add real compute cost per token, or only bytes on the wire?
Short Answer
Medium
A response comes back with finish_reason = 'length' which interpretation is correct?
Multiple Choice
Medium
Bytes, characters, tokens: which one gets billed and how do they relate?
Flashcard
Easy
Define a stop sequence in an LLM API call
Flashcard
Easy
Server-Sent Events streaming: define it and explain why chat APIs default to it
Flashcard
Easy
Descript
OpenAI
Dust
OpenAI
Comet Ml
Haptik
Ai4bharat
Baidu
Meesho
Uniphore