---
title: GPU training (Advanced)
description: 'Audience: Users looking to scale massive models (ie: 1 Trillion parameters).'
canonical: 'https://lightning.ai/docs/pytorch/stable/reference/accelerators/gpu_advanced'
---
# GPU training (Advanced) {#gpu-training-advanced}

**Audience:** Users looking to scale massive models (ie: 1 Trillion parameters).

For experts pushing the state-of-the-art in model development, Lightning offers various techniques to enable Trillion+ parameter-scale models.

- [Train models with billions of parameters](/docs/pytorch/2.6.6/reference/advanced/model_parallel.md)

---

**Navigation**

- Parent: [Accelerators](/docs/pytorch/2.6.6/reference/accelerators.md)