• Docs >
  • N-Bit Precision (Expert)
Shortcuts

N-Bit Precision (Expert)

Audience: Researchers looking to integrate their new precision techniques into Lightning.

Precision Plugins

You can also customize and pass your own Precision Plugin by subclassing the PrecisionPlugin class.

  • Perform pre and post backward/optimizer step operations such as scaling gradients.

  • Provide context managers for forward, training_step, etc.

class CustomPrecisionPlugin(PrecisionPlugin):
    precision = "16-mixed"

    ...


trainer = Trainer(plugins=[CustomPrecisionPlugin()])

© Copyright Copyright (c) 2018-2023, Lightning AI et al...

Built with Sphinx using a theme provided by Read the Docs.