---
title: GPU
description: >-
  - Prepare your code (Optional) — Prepare your code to run on any hardware -
  Basic — Learn the basics of single and multi-GPU training. - Intermediate —...
canonical: 'https://lightning.ai/docs/pytorch/stable/reference/accelerators/gpu'
---
# GPU {#gpu}

- [Prepare your code (Optional)](/docs/pytorch/2.6.6/reference/accelerators/accelerator_prepare.md) — Prepare your code to run on any hardware

- [Basic](/docs/pytorch/2.6.6/reference/accelerators/gpu_basic.md) — Learn the basics of single and multi-GPU training.

- [Intermediate](/docs/pytorch/2.6.6/reference/accelerators/gpu_intermediate.md) — Learn about different distributed strategies, torchelastic and how to optimize communication layers.

- [Advanced](/docs/pytorch/2.6.6/reference/accelerators/gpu_advanced.md) — Train models with billions of parameters

- [Expert](/docs/pytorch/2.6.6/reference/accelerators/gpu_expert.md) — Develop new strategies for training and deploying larger and larger models.

- [FAQ](/docs/pytorch/2.6.6/reference/accelerators/gpu_faq.md) — Frequently asked questions about GPU training.

---

**Navigation**

- Parent: [Accelerators](/docs/pytorch/2.6.6/reference/accelerators.md)