Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Attention Mechanism
/
Position Interpolation
Position Interpolation
Subtopic
5 questions
Questions tagged with Position Interpolation — part of Attention Mechanism.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Order the three steps of a position-interpolation fine-tune that takes RoPE from 4k to 16k.
Order Steps
Medium
·
Qual 4.0
Extending a 4k-context model to 32k via FT: how RoPE scaling fits in
Short Answer
Hard
·
Qual 4.0
Why does pure long-context FT (without RoPE scaling) fail to extrapolate?
Multiple Choice
Hard
·
Qual 4.0
How are RoPE NTK scaling and YaRN used at inference time to extend context beyond the training length?
Short Answer
Hard
·
Qual 4.0
How do you extend a pretrained LLM's context window beyond its training length using position interpolation / YaRN?
Short Answer
Hard
·
Qual 4.0