Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Inference Optimization
/
Top K
Top K
Subtopic
3 questions
Questions tagged with Top K — part of Inference Optimization.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Walk through how top_p (nucleus) sampling truncates the distribution
Flashcard
Easy
·
Qual 4.0
Compare top_k and top_p as truncation strategies for sampling
Flashcard
Easy
·
Qual 4.0
Your team is tuning top-k for the retriever in a production RAG system. What is the strongest reason NOT to just push top-k to its highest possible value?
Multiple Choice
Medium
·
Qual 4.0