How To Let Lightning Automatically Figure Out Batch Size
Lightning is a lightweight PyTorch wrapper for high-performance AI research that reduces the boilerplate without limiting flexibility. In this series, we are covering all the tricks Lightning offers to supercharge your machine learning training.
In this video, we give a short intro to Lightning’s flag auto_scale_batch_size
. Larger batches can help you train faster and give you better estimates of gradients. Watch the video to learn more!