Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Inference Optimization
/
Eos Token
Eos Token
Subtopic
5 questions
Questions tagged with Eos Token — part of Inference Optimization.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
A response comes back with finish_reason = 'length' which interpretation is correct?
Multiple Choice
Medium
·
Qual 4.0
OpenAI
Define a stop sequence in an LLM API call
Flashcard
Easy
·
Qual 4.0
What is the EOS token and how does the runtime use it?
Flashcard
Easy
·
Qual 4.0
Spot the errors in this stop-sequence configuration recommendation
Spot the Error
Hard
·
Qual 4.0
How does the serving stack actually decide when to stop generation and what bugs come from mis-set stop sequences?
Short Answer
Medium
·
Qual 4.0