DeepSpeedPrecision¶
- class lightning.fabric.plugins.precision.DeepSpeedPrecision(precision)[source]¶
Bases:
Precision
Precision plugin for DeepSpeed integration.
- Parameters:
precision¶ (
Literal
['32-true'
,'16-true'
,'bf16-true'
,'16-mixed'
,'bf16-mixed'
]) – Full precision (32-true), half precision (16-true, bf16-true) or mixed precision (16-mixed, bf16-mixed).- Raises:
ValueError – If unsupported
precision
is provided.
- backward(tensor, model, *args, **kwargs)[source]¶
Performs back-propagation using DeepSpeed’s engine.
- Return type:
- convert_input(data)[source]¶
Convert model inputs (forward) to the floating point precision type of this plugin.
This is a no-op in the base precision plugin, since we assume the data already has the desired type (default is torch.float32).
- Return type:
- convert_module(module)[source]¶
Convert the module parameters to the precision type this plugin handles.
This is optional and depends on the precision limitations during optimization.
- Return type:
- convert_output(data)[source]¶
Convert outputs to the floating point precision type expected after model’s forward.
This is a no-op in the base precision plugin, since we assume the data already has the desired type (default is torch.float32).
- Return type:
- module_init_context()[source]¶
Instantiate module parameters or tensors in the precision type this plugin handles.
This is optional and depends on the precision limitations during optimization.
- Return type: