ClusterEnvironment¶

class pytorch_lightning.plugins.environments.ClusterEnvironment[source]¶

Specification of a cluster environment.

creates_children()[source]¶: Whether the environment creates the subprocesses or not. :rtype: bool

Deprecated since version v1.5: This method was deprecated in v1.5 and will be removed in v1.6. Use the property creates_processes_externally instead.

abstract global_rank()[source]¶

The rank (index) of the currently running process across all nodes and devices.

abstract local_rank()[source]¶

The rank (index) of the currently running process inside of the current node.

abstract master_address()[source]¶

The master address through which all processes connect and communicate.

abstract master_port()[source]¶

An open and configured port in the master node through which all processes communicate.

abstract node_rank()[source]¶

The rank (index) of the node on which the current process runs.

Clean up any state set after execution finishes.

abstract world_size()[source]¶

The number of processes across all devices and nodes.

abstract property creates_processes_externally: bool¶: Whether the environment creates the subprocesses or not.