Table of Contents
2.5.1rc2

Home

  • Welcome to ⚡ Lightning Fabric
  • Install

Get started in steps

  • Basic skills
  • Intermediate skills
  • Advanced skills

Core API Reference

  • Fabric Arguments
  • Fabric Methods

Full API Reference

  • Accelerators
  • Collectives
  • Environments
  • Fabric
  • IO
  • Loggers
  • Precision
  • Strategies
  • Utilities

More

  • Examples
  • Glossary
  • How-tos
  • Style Guide
  • Overview
  • Team management
  • Production
  • Security
  • Open source
    • Overview
    • PyTorch Lightning
    • Fabric
    • Lit-GPT
    • Torchmetrics
    • Litdata
    • Lit LLaMA
    • Litserve
  • Examples
  • Glossary
  • FAQ
  • Docs >
  • Glossary
Shortcuts

Glossary¶

2D Parallelism

Accelerator

Apple Silicon

Autocast

Barrier

Bfloat16

Broadcast

Callback

Checkpoint

CLI

Cloud

Collective

Compile

CUDA

FabricModule

FSDP

Gather

Gradient Accumulation

GPU

Initialization

Jupyter

Launch

LightningModule

Logger

Mixed Precision

Model Parallelism

MPI

MPS

Multi-GPU

Multi-Node

Notebook

Optimizers

Precision

Quantization

Reduce

SLURM

TensorBoard

Tensor Parallelism

TorchElastic

TorchRun

TPU

Trainer

Weights and Biases

16-bit, 8-bit, 4-bit

  • Glossary

To analyze traffic and optimize your experience, we serve cookies on this site. By clicking or navigating, you agree to allow our usage of cookies. Read PyTorch Lightning's Privacy Policy.