GPU training (Advanced)
Audience: Users looking to scale massive models (ie: 1 Trillion parameters).
For experts pushing the state-of-the-art in model development, Lightning offers various techniques to enable Trillion+ parameter-scale models.
You are viewing an outdated version of PyTorch Lightning Docs
Click here to view the latest version→