LayerSync

class lightning.pytorch.plugins.LayerSync

Bases: ABC

Abstract base class for creating plugins that wrap layers of a model with synchronization logic for multiprocessing.

abstract apply(model)

Override this method to apply synchronization to the layers of this model.

Return type:

Module

abstract revert(model)

Override this method to undo all modifications made in apply().

Return type:

Module

Was this page helpful?

What went wrong?

↑↓ Navigate↵ Open⌘↵ New tabesc Close