FSDPMixedPrecisionPlugin¶

class lightning.pytorch.plugins.precision.FSDPMixedPrecisionPlugin(precision, device, scaler=None)[source]¶

AMP for Fully Sharded Data Parallel (FSDP) Training.

Warning

This is an experimental feature.

clip_grad_by_norm(*_, **__)[source]¶

Clip gradients by norm.