DDPShardedPlugin¶
- class pytorch_lightning.plugins.training_type.DDPShardedPlugin(*args, **kwargs)[source]¶
Bases:
pytorch_lightning.plugins.training_type.ddp.DDPPlugin
Optimizer and gradient sharded training provided by FairScale.
- block_backward_sync()[source]¶
Blocks syncing gradients behaviour on backwards pass.
This is useful for skipping sync when accumulating gradients, reducing communication overhead Returns: context manager with sync behaviour off
- Return type
- property lightning_module: pytorch_lightning.core.lightning.LightningModule¶
Returns the pure LightningModule without potential wrappers.