Topics Practice Study

Zenaique

Personalized AI interview prep. Structured questions across every GenAI sub-discipline. Practice, score, master.

Practice

Topics
Practice
Challenges
Dashboard

Browse

Formats
Roles
Companies
Top questions

Product

Pricing
Sign in

© 2026 Zenaique

Topics/Fine-Tuning/Data Parallel

Data Parallel

Subtopic4 questions

Questions tagged with Data Parallel — part of Fine-Tuning.

Premium questions for this topic

Sort

Questions

Compute the effective batch from per device batch, accum steps, and GPU count
Fill in BlankEasy
Fill in the DeepSpeed config keys that select a ZeRO stage
Fill in BlankEasy
Multi-GPU FT: pick the right sharding strategy for a 70B full FT on 8 H100s
Multiple ChoiceHard
Match multi-GPU training strategy to what it shards
Match PairsHard

Study answers

Read the beginner answer for every question in this topic.

Study beginner answers

Master this topic

Daily practice mixes topics. Topic specific drill is a Pro feature.

Anduril Robinhood

Canva Fiddler Ai