Search — PyTorch Lightning 1.6.4 documentation

Get Started
Blog
Docs
PyTorch Lightning Lightning Fabric TorchMetrics Lightning Flash Lightning Bolts
GitHub
Lightning AI

Table of Contents

1.6.4

Getting started

Lightning in 2 Steps
Installation
How to Organize PyTorch Into Lightning
LightningLite - Stepping Stone to Lightning

Best practices

Speed Up Model Training
Managing Data
Style Guide
Lightning project template
Benchmark with vanilla PyTorch

Lightning API

LightningModule
Trainer

Optional Extensions

Accelerators
Callback
LightningDataModule
Logging
Plugins
Strategy
Loops

Accelerators

Graphics Processing Unit (GPU)
Tensor Processing Unit (TPU)
Intelligence Processing Unit (IPU)
Habana Gaudi AI Processor (HPU)

Common Use Cases

Cloud Training
Checkpointing
Computing cluster
Debugging
Early Stopping
Effective Training Techniques
Evaluation
Fault-tolerant Training
Hyperparameters
Inference in Production
Lightning CLI and config files
Loggers
Model Parallel GPU Training
N-Bit Precision
Optimization
Profiling
Progress Bar
Pruning and Quantization
Remote Filesystems
Strategy Registry
Transfer Learning

Tutorials

Step-by-step Walk-through
Transfer Learning
PyTorch Lightning 101 class
From PyTorch to PyTorch Lightning [Blog]
From PyTorch to PyTorch Lightning [Video]
Tutorial 1: Introduction to PyTorch
Tutorial 2: Activation Functions
Tutorial 3: Initialization and Optimization
Tutorial 4: Inception, ResNet and DenseNet
Tutorial 5: Transformers and Multi-Head Attention
Tutorial 6: Basics of Graph Neural Networks
Tutorial 7: Deep Energy-Based Generative Models
Tutorial 8: Deep Autoencoders
Tutorial 9: Normalizing Flows for Image Modeling
Tutorial 10: Autoregressive Image Modeling
Tutorial 11: Vision Transformers
Tutorial 12: Meta-Learning - Learning to Learn
Tutorial 13: Self-Supervised Contrastive Learning with SimCLR
GPU and batched data augmentation with Kornia and PyTorch-Lightning
Barlow Twins Tutorial
PyTorch Lightning Basic GAN Tutorial
PyTorch Lightning CIFAR10 ~94% Baseline Tutorial
PyTorch Lightning DataModules
Introduction to Pytorch Lightning
TPU training with PyTorch Lightning
How to train a Deep Q Network
Finetune Transformers Models with PyTorch Lightning

API References

API References

Lightning Ecosystem

TorchMetrics
Lightning Flash
Lightning Bolts
Lightning Transformers
Ecosystem CI

Examples

Community Examples
PyTorch Ecosystem Examples
Conversational AI
Autoencoder
BYOL
DQN
GAN
GPT-2
Image-GPT
SimCLR
VAE

Community

Contributor Covenant Code of Conduct
Contributing
How to Become a Core Contributor
Lightning Governance
Changelog

Docs >
Search

Shortcuts

Built with Sphinx using a theme provided by Read the Docs.

To analyze traffic and optimize your experience, we serve cookies on this site. By clicking or navigating, you agree to allow our usage of cookies. Read PyTorch Lightning's Privacy Policy.

Get Started
Blog
Ecosystem

PyTorch Lightning
Lightning Fabric
TorchMetrics
Fabric

Github
Lightning.ai