Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Fine-Tuning
/
Sequence Packing
Sequence Packing
Subtopic
6 questions
Questions tagged with Sequence Packing — part of Fine-Tuning.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Default
Quality
Difficulty ↑
Difficulty ↓
Questions
Premium
Spot the bug: packed…
Spot the Error
Hard
Which causes deserve a look when QLoRA OOMs at step 7000 after one clean epoch on a 24 GB GPU?
Multi-select
Medium
What bound does max_seq_len control, and what happens to examples that exceed it?
Flashcard
Easy
You are fine-tuning Llama 3 8B on variable length instruction data. Which padding strategy and side do you pick?
Multiple Choice
Medium
Spot the bug in this sequence packing setup
Spot the Error
Hard
What does sequence packing do, and what can go wrong with the attention mask?
Short Answer
Hard
Cursor
Decagon
N8n
NVIDIA
NVIDIA
Ai4bharat
Razorpay
Midjourney
Sambanova
Flowise
NVIDIA