Precision

Precision — Base class for all plugins handling the precision-specific parts of the training.
DoublePrecision — Plugin for training with double (torch.float64) precision.
MixedPrecision — Plugin for Automatic Mixed Precision (AMP) training with torch.autocast.
HalfPrecision — Plugin for training with half precision.
XLAPrecision — Plugin for training with XLA.
FSDPPrecision — Precision plugin for training with Fully Sharded Data Parallel (FSDP).
DeepSpeedPrecision — Precision plugin for DeepSpeed integration.
TransformerEnginePrecision — Plugin for training with fp8 precision via nvidia’s Transformer Engine.
BitsandbytesPrecision — Plugin for quantizing weights with bitsandbytes.

Was this page helpful?