Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Fine-Tuning
/
Fp16
Fp16
Subtopic
3 questions
Questions tagged with Fp16 — part of Fine-Tuning.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Default
Quality
Difficulty ↑
Difficulty ↓
Questions
Which of bf16 and fp16 preserves fp32's exponent range?
Multiple Choice
Easy
What is bf16's advantage over fp16, and what does gradient checkpointing trade?
Short Answer
Medium
Why does fp16 fine-tuning need dynamic loss scaling but bf16 doesn't?
Multiple Choice
Medium
Airbnb
Sambanova
Modal Labs
NVIDIA
Cred
Gnani