---
title: 'Level 19: Train models with billions of parameters'
description: Scale to billions of parameters with multiple distributed strategies.
canonical: 'https://lightning.ai/docs/pytorch/stable/level-up/advanced/advanced_level_21'
---
# Level 19: Train models with billions of parameters {#level-19-train-models-with-billions-of-parameters}

Scale to billions of parameters with multiple distributed strategies.

- [Scale with distributed strategies](/docs/pytorch/2.6.6/reference/accelerators/gpu_intermediate.md) — Learn about different distributed strategies to reach bigger model parameter sizes.

- [Train models with billions of parameters](/docs/pytorch/2.6.6/reference/advanced/model_parallel.md) — Scale to billions of params on GPUs with FSDP, TP or Deepspeed.

---

**Navigation**

- Parent: [Advanced skills](/docs/pytorch/2.6.6/level-up/advanced.md)