N-Bit Precision (Expert)¶
Audience: Researchers looking to integrate their new precision techniques into Lightning.
You can also customize and pass your own Precision Plugin by subclassing the
Perform pre and post backward/optimizer step operations such as scaling gradients.
Provide context managers for forward, training_step, etc.
class CustomPrecisionPlugin(PrecisionPlugin): precision = "16-mixed" ... trainer = Trainer(plugins=[CustomPrecisionPlugin()])