---
title: Distributed
description: API reference for all public classes and functions.
canonical: 'https://lightning.ai/docs/thunder/stable/api-reference/distributed'
---
# Distributed {#distributed}

- [`ddp`](/docs/thunder/0.2.6/api-reference/generated/thunder.distributed.ddp.md) — Thunder’s Distributed Data Parallel.
- [`fsdp`](/docs/thunder/0.2.6/api-reference/generated/thunder.distributed.fsdp.md) — Convert model into Fully Sharded Data Parallel.
- [`FSDPType`](/docs/thunder/0.2.6/api-reference/generated/thunder.distributed.FSDPType.md) — Specifies the sharding strategy to be used for FSDP in Thunder.
- [`FSDPBucketingStrategy`](/docs/thunder/0.2.6/api-reference/generated/thunder.distributed.FSDPBucketingStrategy.md) — Specify how we group parameters into a bucket for collective communication in fsdp.
- [`set_skip_data_parallel_grad_sync`](/docs/thunder/0.2.6/api-reference/generated/thunder.distributed.set_skip_data_parallel_grad_sync.md) — Set whether to skip data parallel grad sync.
- [`reset_skip_data_parallel_grad_sync`](/docs/thunder/0.2.6/api-reference/generated/thunder.distributed.reset_skip_data_parallel_grad_sync.md) — Reset whether to skip data parallel grad sync.
- [`get_skip_data_parallel_grad_sync`](/docs/thunder/0.2.6/api-reference/generated/thunder.distributed.get_skip_data_parallel_grad_sync.md) — Get whether to skip data parallel grad sync.
- [`skip_data_parallel_grad_sync`](/docs/thunder/0.2.6/api-reference/generated/thunder.distributed.skip_data_parallel_grad_sync.md) — A context manager to skip data parallel grad sync.
- [`column_parallel`](/docs/thunder/0.2.6/api-reference/generated/thunder.distributed.column_parallel.md) — Convert specified modules into column-wise parallel ones.
- [`row_parallel`](/docs/thunder/0.2.6/api-reference/generated/thunder.distributed.row_parallel.md) — Convert specified modules into row-wise parallel ones.

---

**Navigation**

- Parent: [API reference](/docs/thunder/0.2.6/api-reference.md)