TorchElasticEnvironment¶
- class lightning.pytorch.plugins.environments.TorchElasticEnvironment[source]¶
Bases:
lightning.fabric.plugins.environments.cluster_environment.ClusterEnvironment
Environment for fault-tolerant and elastic training with torchelastic
- static detect()[source]¶
Returns
True
if the current process was launched using the torchelastic command.- Return type
- global_rank()[source]¶
The rank (index) of the currently running process across all nodes and devices.
- Return type
- local_rank()[source]¶
The rank (index) of the currently running process inside of the current node.
- Return type
- property creates_processes_externally: bool¶
Whether the environment creates the subprocesses or not.
- Return type