Collective

class lightning.fabric.plugins.collectives.Collective

Bases: ABC

Interface for collective operations.

Supports communications between multiple processes and multiple nodes. A collective owns a group.

Warning

This is an experimental feature which is still in development.

create_group(**kwargs)

Create a group.

This assumes that init_group() has been called already by the user.

Return type:

Self

abstract property rank: int

Rank.

abstract property world_size: int

World size.