---
title: Glossary
description: >-
  - 2D Parallelism - Gradient Accumulation - Initialization - LightningModule -
  Mixed Precision - Model Parallelism - Tensor Parallelism - Weights and Biases
canonical: 'https://lightning.ai/docs/fabric/stable/more/glossary'
---
# Glossary {#glossary}

- [2D Parallelism](/docs/fabric/2.6.6/reference/advanced/model_parallel/tp_fsdp.md)

- [Accelerator](/docs/fabric/2.6.6/home/installation/convert/accelerators.md)

- [Apple Silicon](/docs/fabric/2.6.6/home/installation/convert/accelerators.md)

- [Autocast](/docs/fabric/2.6.6/reference/fundamentals/precision.md)

- [Barrier](/docs/fabric/2.6.6/reference/advanced/distributed_communication.md)

- [Bfloat16](/docs/fabric/2.6.6/reference/fundamentals/precision.md)

- [Broadcast](/docs/fabric/2.6.6/reference/advanced/distributed_communication.md)

- [Callback](/docs/fabric/2.6.6/reference/guide/callbacks.md)

- [Checkpoint](/docs/fabric/2.6.6/reference/guide/checkpoint.md)

- [CLI](/docs/fabric/2.6.6/reference/fundamentals/launch.md)

- [Cloud](/docs/fabric/2.6.6/reference/guide/multi_node/cloud.md)

- [Collective](/docs/fabric/2.6.6/reference/advanced/distributed_communication.md)

- [Compile](/docs/fabric/2.6.6/reference/advanced/compile.md)

- [CUDA](/docs/fabric/2.6.6/home/installation/convert/accelerators.md)

- [FabricModule](/docs/fabric/2.6.6/full-api-reference/api/wrappers.md)

- [FSDP](/docs/fabric/2.6.6/reference/advanced/model_parallel/fsdp.md)

- [Gather](/docs/fabric/2.6.6/reference/advanced/distributed_communication.md)

- [Gradient Accumulation](/docs/fabric/2.6.6/reference/advanced/gradient_accumulation.md)

- [GPU](/docs/fabric/2.6.6/home/installation/convert/accelerators.md)

- [Initialization](/docs/fabric/2.6.6/reference/advanced/model_init.md)

- [Jupyter](/docs/fabric/2.6.6/launch/notebooks.md)

- [Launch](/docs/fabric/2.6.6/reference/fundamentals/launch.md)

- [LightningModule](/docs/fabric/2.6.6/reference/guide/lightning_module.md)

- [Logger](/docs/fabric/2.6.6/reference/guide/logging.md)

- [Mixed Precision](/docs/fabric/2.6.6/reference/fundamentals/precision.md)

- [Model Parallelism](/docs/fabric/2.6.6/reference/advanced/model_parallel.md)

- [MPI](/docs/fabric/2.6.6/reference/guide/multi_node/other.md)

- [MPS](/docs/fabric/2.6.6/home/installation/convert/accelerators.md)

- [Multi-GPU](/docs/fabric/2.6.6/reference/fundamentals/launch.md)

- [Multi-Node](/docs/fabric/2.6.6/reference/fundamentals/launch.md)

- [Notebook](/docs/fabric/2.6.6/launch/notebook.md)

- [Optimizers](/docs/fabric/2.6.6/reference/advanced/multiple_setup.md)

- [Precision](/docs/fabric/2.6.6/reference/fundamentals/precision.md)

- [Quantization](/docs/fabric/2.6.6/reference/fundamentals/precision.md)

- [Reduce](/docs/fabric/2.6.6/reference/advanced/distributed_communication.md)

- [SLURM](/docs/fabric/2.6.6/reference/guide/multi_node/slurm.md)

- [TensorBoard](/docs/fabric/2.6.6/reference/guide/logging.md)

- [Tensor Parallelism](/docs/fabric/2.6.6/reference/advanced/model_parallel/tp.md)

- [TorchElastic](/docs/fabric/2.6.6/reference/guide/multi_node/barebones.md)

- [TorchRun](/docs/fabric/2.6.6/reference/guide/multi_node/barebones.md)

- [TPU](/docs/fabric/2.6.6/home/installation/convert/accelerators.md)

- [Trainer](/docs/fabric/2.6.6/guide/trainer_template.md)

- [Weights and Biases](/docs/fabric/2.6.6/reference/guide/loggers/wandb.md)

- [16-bit, 8-bit, 4-bit](/docs/fabric/2.6.6/reference/fundamentals/precision.md)

---

**Navigation**

- Parent: [More](/docs/fabric/2.6.6/more.md)