TorchCollective

class lightning.fabric.plugins.collectives.TorchCollective[source]

Bases: Collective

Collective operations using torch.distributed.

Warning

This is an experimental feature which is still in development.

property rank: int

Rank.

property world_size: int

World size.