LayerSync
- class lightning.pytorch.plugins.LayerSync
Bases:
ABCAbstract base class for creating plugins that wrap layers of a model with synchronization logic for multiprocessing.
- abstract apply(model)
Override this method to apply synchronization to the layers of this model.
- Return type:
Was this page helpful?
Thanks for the feedback.