Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Inference Optimization
/
Bandwidth Bound
Bandwidth Bound
Subtopic
7 questions
Questions tagged with Bandwidth Bound — part of Inference Optimization.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Default
Quality
Difficulty ↑
Difficulty ↓
Questions
Which quantization combo squeezes the most decode bandwidth per percent of quality lost?
Multiple Choice
Medium
Which statements about FP8, INT8 and INT4 weight quantization are correct?
Multi-select
Medium
Premium
Which statement best explains…
Multiple Choice
Medium
Premium
An engineer says 'FP8…
Multiple Choice
Hard
Spot the errors in this explanation of input vs output pricing
Spot the Error
Medium
Walk through the byte accounting that proves a single batch decode step is bandwidth bound on H100.
Short Answer
Hard
Compute the bandwidth vs compute latency of a single Llama-70B decode step on H100
Predict Output
Hard
Descript
NVIDIA
NVIDIA
Arize Ai
NVIDIA
Nykaa
Tata Digital
Observe Ai
Snap
Intuit
NVIDIA
Airbnb
Graphcore