Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Fine-Tuning
/
Sequence Packing
Sequence Packing
Subtopic
6 questions
Questions tagged with Sequence Packing — part of Fine-Tuning.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Spot the bug: packed-sequence SFT where the model learns to copy across unrelated examples
Spot the Error
Hard
·
Qual 4.0
QLoRA OOMs at step 7000 after one clean epoch on a 24 GB GPU: which non-obvious causes deserve a look?
Multi-select
Medium
·
Qual 4.0
`max_seq_len` controls one bound, what happens to examples that exceed it?
Flashcard
Easy
·
Qual 4.0
You are fine-tuning Llama 3 8B on variable-length instruction data. Which padding strategy and side do you pick?
Multiple Choice
Medium
·
Qual 4.0
Spot the bug in this sequence-packing setup
Spot the Error
Hard
·
Qual 4.0
Sequence packing: what it does, and the attention-mask gotcha
Short Answer
Hard
·
Qual 4.0