Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Fine-Tuning
/
Bf16
Bf16
Subtopic
6 questions
Questions tagged with Bf16 — part of Fine-Tuning.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Default
Quality
Difficulty ↑
Difficulty ↓
Questions
Which property explains bf16 preference over fp16 in frontier pretraining?
Multiple Choice
Easy
What precision should you use for the same LoRA setup on H100 vs A100?
Multiple Choice
Medium
Which of bf16 and fp16 preserves fp32's exponent range?
Multiple Choice
Easy
Fill in the memory delta when a 7B weight tensor moves from fp32 to bf16
Fill in Blank
Easy
What is bf16's advantage over fp16, and what does gradient checkpointing trade?
Short Answer
Medium
Why does fp16 fine-tuning need dynamic loss scaling but bf16 doesn't?
Multiple Choice
Medium
NVIDIA
OpenAI
Dataiku
NVIDIA
Airbnb
Sambanova
Modal Labs
NVIDIA
Modal Labs
Sarvam
Cred
Gnani