Table of Contents
2.5.1.post0

Home

  • Welcome to ⚡ Lightning Fabric
  • Install

Get started in steps

  • Basic skills
  • Intermediate skills
  • Advanced skills

Core API Reference

  • Fabric Arguments
  • Fabric Methods

Full API Reference

  • Accelerators
  • Collectives
  • Environments
  • Fabric
  • IO
  • Loggers
  • Precision
  • Strategies
  • Utilities

More

  • Examples
  • Glossary
  • How-tos
  • Style Guide
  • Overview
  • Team management
  • Production
  • Security
  • Open source
    • Overview
    • PyTorch Lightning
    • Fabric
    • Lit-GPT
    • Torchmetrics
    • Litdata
    • Lit LLaMA
    • Litserve
  • Examples
  • Glossary
  • FAQ
  • Docs >
  • lightning.fabric.plugins.collectives
Shortcuts

lightning.fabric.plugins.collectives¶

Warning

This is an experimental feature.

Collectives¶

Collective

Interface for collective operations.

TorchCollective

Collective operations using torch.distributed.

SingleDeviceCollective

Support for collective operations on a single device (no-op).

  • lightning.fabric.plugins.collectives
    • Collectives

To analyze traffic and optimize your experience, we serve cookies on this site. By clicking or navigating, you agree to allow our usage of cookies. Read PyTorch Lightning's Privacy Policy.