Plugins

DDP — Plugin for enabling Distributed Data Parallel (DDP) training in Thunder.
FSDP — Plugin for enabling Fully Sharded Data Parallel (FSDP) training in Thunder.
QuantizeInt4 — Plugin for 4-bit integer quantization using BitsAndBytes.
FP8 — Plugin for enabling FP8 precision via NVIDIA Transformer Engine, enabling higher throughput of matrix operations in FP8.
ReduceOverhead — Plugin to enable CUDA Graphs and reduce CPU overhead.

Was this page helpful?