Table of Contents
2.5.1rc2

Home

  • Lightning in 15 minutes
  • Install
  • 2.0 Upgrade Guide

Level Up

  • Basic skills
  • Intermediate skills
  • Advanced skills
  • Expert skills

Core API

  • LightningModule
  • Trainer

Optional API

  • accelerators
  • callbacks
  • cli
  • core
  • loggers
  • profiler
  • trainer
  • strategies
  • tuner
  • utilities

More

  • Community
  • Examples
  • Glossary
  • How-to Guides
  • Overview
  • Team management
  • Production
  • Security
  • Open source
    • Overview
    • PyTorch Lightning
    • Fabric
    • Lit-GPT
    • Torchmetrics
    • Litdata
    • Lit LLaMA
    • Litserve
  • Examples
  • Glossary
  • FAQ
  • Docs >
  • Glossary >
  • Run on a multi-node cluster
Shortcuts

Run on a multi-node clusterΒΆ

Run single or multi-node on Lightning Studios

The easiest way to scale models in the cloud. No infrastructure setup required.

basic

Run on an on-prem cluster

Learn to train models on a general compute cluster.

intermediate

Run with Torch Distributed

Run models on a cluster with torch distributed.

intermediate

Run on a SLURM cluster

Run models on a SLURM-managed cluster

intermediate

Integrate your own cluster

Learn how to integrate your own cluster

expert

  • Run on a multi-node cluster

To analyze traffic and optimize your experience, we serve cookies on this site. By clicking or navigating, you agree to allow our usage of cookies. Read PyTorch Lightning's Privacy Policy.