---
title: thunder.distributed.FSDPBucketingStrategy
description: >-
  Specify how we group parameters into a bucket for collective communication in
  fsdp.
canonical: >-
  https://lightning.ai/docs/thunder/stable/api-reference/generated/thunder.distributed.FSDPBucketingStrategy
---
# thunder.distributed.FSDPBucketingStrategy {#thunder-distributed-fsdpbucketingstrategy}

### `class thunder.distributed.FSDPBucketingStrategy(value)` {#thunder.distributed.FSDPBucketingStrategy}

[\[source\]](https://github.com/Lightning-AI/lightning-thunder/blob/0.2.6/thunder/distributed/__init__.py#L337-L350)

Bases: [`Enum`](https://docs.python.org/3/library/enum.html#enum.Enum "(in Python v3.15)")

Specify how we group parameters into a bucket for collective communication in fsdp.

#### `NONE` {#thunder.distributed.FSDPBucketingStrategy.NONE}

[\[source\]](https://github.com/Lightning-AI/lightning-thunder/blob/thunder/distributed.py)

Disables bucketing.

#### `LAYER` {#thunder.distributed.FSDPBucketingStrategy.LAYER}

[\[source\]](https://github.com/Lightning-AI/lightning-thunder/blob/thunder/distributed.py)

Creates buckets per layer such as [`torch.nn.Linear`](https://docs.pytorch.org/docs/stable/generated/torch.nn.Linear.html#torch.nn.Linear "(in PyTorch v2.15)") and [`torch.nn.LayerNorm`](https://docs.pytorch.org/docs/stable/generated/torch.nn.LayerNorm.html#torch.nn.LayerNorm "(in PyTorch v2.15)").

#### `BLOCK` {#thunder.distributed.FSDPBucketingStrategy.BLOCK}

[\[source\]](https://github.com/Lightning-AI/lightning-thunder/blob/thunder/distributed.py)

Creates buckets per block such as Transformer block.

#### `__init__()` {#thunder.distributed.FSDPBucketingStrategy.__init__}

[\[source\]](https://github.com/Lightning-AI/lightning-thunder/blob/thunder/distributed.py)

Attributes

- [`NONE`](#thunder.distributed.FSDPBucketingStrategy.NONE)
- [`LAYER`](#thunder.distributed.FSDPBucketingStrategy.LAYER)
- [`BLOCK`](#thunder.distributed.FSDPBucketingStrategy.BLOCK)

---

**Navigation**

- Parent: [Generated](/docs/thunder/0.2.6/api-reference/generated.md)