Level 20: Train models with billions of parameters

Scale to billions of parameters with multiple distributed strategies.

---

Scale with distributed strategies

Learn about different distributed strategies to reach bigger model parameter sizes.

intermediate

Train models with billions of parameters

Scale to billions of params on GPUs with FSDP, TP or Deepspeed.

advanced