Collective
- class lightning.fabric.plugins.collectives.Collective
Bases:
ABCInterface for collective operations.
Supports communications between multiple processes and multiple nodes. A collective owns a group.
Warning
This is an experimental feature which is still in development.
- create_group(**kwargs)
Create a group.
This assumes that
init_group()has been called already by the user.- Return type:
Self
- abstract property rank: int
Rank.
- abstract property world_size: int
World size.
Was this page helpful?
Thanks for the feedback.