Lightning AI Studios: Never set up a local environment again →

← Back to blog

Automatic Batch Size Finder in Lightning

How To Let Lightning Automatically Figure Out Batch Size

Lightning is a lightweight PyTorch wrapper for high-performance AI research that reduces the boilerplate without limiting flexibility. In this series, we are covering all the tricks Lightning offers to supercharge your machine learning training.

In this video, we give a short intro to Lightning’s flag auto_scale_batch_size. Larger batches can help you train faster and give you better estimates of gradients. Watch the video to learn more!