thunder.plugins¶
|
Plugin for enabling Distributed Data Parallel (DDP) training in Thunder. |
|
Plugin for enabling Fully Sharded Data Parallel (FSDP) training in Thunder. |
Plugin for 4-bit integer quantization using BitsAndBytes. |
|
|
Plugin for enabling FP8 precision via NVIDIA Transformer Engine, enabling higher throughput of matrix operations in FP8. |
Plugin to enable CUDA Graphs and reduce CPU overhead. |