Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Fine-Tuning
/
Context Extension
Context Extension
Subtopic
3 questions
Questions tagged with Context Extension — part of Fine-Tuning.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Extending a 4k-context model to 32k via FT: how RoPE scaling fits in
Short Answer
Hard
·
Qual 4.0
Why does pure long-context FT (without RoPE scaling) fail to extrapolate?
Multiple Choice
Hard
·
Qual 4.0
How do you extend a pretrained LLM's context window beyond its training length using position interpolation / YaRN?
Short Answer
Hard
·
Qual 4.0