Data Parallel

Compute the effective batch from per-device batch, accum steps, and GPU count

Fill in the DeepSpeed config keys that select a ZeRO stage

Multi-GPU FT: pick the right sharding strategy for a 70B full FT on 8 H100s

Match multi-GPU training strategy to what it shards