TorchSyncBatchNorm¶
- class lightning.pytorch.plugins.TorchSyncBatchNorm[source]¶
Bases:
LayerSync
A plugin that wraps all batch normalization layers of a model with synchronization logic for multiprocessing.
This plugin has no effect in single-device operation.