Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Fine-Tuning
/
Gradient Checkpointing
Gradient Checkpointing
Subtopic
4 questions
Questions tagged with Gradient Checkpointing — part of Fine-Tuning.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Default
Quality
Difficulty ↑
Difficulty ↓
Questions
If LoRA freezes the base weights, does that mean activation checkpointing on the base is unnecessary?
Multiple Choice
Medium
What does Adam's two fp32 buffers per trainable parameter imply for LoRA vs full FT on a 7B?
Short Answer
Medium
What does gradient checkpointing trade, and roughly by how much?
Flashcard
Easy
What is bf16's advantage over fp16, and what does gradient checkpointing trade?
Short Answer
Medium
Sarvam
Vernacular Ai
Descript
Snowflake
Cred
Gnani
Ai21
Datadog