ShardedNativeMixedPrecisionPlugin

class pytorch_lightning.plugins.precision.ShardedNativeMixedPrecisionPlugin(precision, device, scaler=None)

Bases: pytorch_lightning.plugins.precision.native_amp.NativeMixedPrecisionPlugin

Native AMP for Sharded Training.

clip_grad_by_norm(optimizer, clip_val)

Clip gradients by norm.

Return type:

None