Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Fine-Tuning
/
Gradient Checkpointing
Gradient Checkpointing
Subtopic
4 questions
Questions tagged with Gradient Checkpointing — part of Fine-Tuning.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
LoRA freezes the base weights: does that mean activation checkpointing on the base is unnecessary?
Multiple Choice
Medium
Adam stores two fp32 buffers per trainable parameter: what does that imply for LoRA vs full FT on a 7B?
Short Answer
Medium
Gradient checkpointing, what does it trade, and roughly by how much?
Flashcard
Easy
Explain bf16's advantage over fp16 and what gradient checkpointing trades
Short Answer
Medium
Sarvam
Vernacular Ai
Descript
Ltimindtree
Cred
Gnani
Ai21
Datadog