thunder.plugins.FP8

class thunder.plugins.FP8

Bases: Plugin

Plugin for enabling FP8 precision via NVIDIA Transformer Engine, enabling higher throughput of matrix operations in FP8.

See lightning-thunder/thunder/executors/transformer_engineex.py for implementation details.

__init__()

Methods

__init__()
setup_executors()	Imports the Transformer Engine executor.
setup_lookasides()	rtype: Optional[list[Lookaside]]
setup_transforms()	rtype: Optional[list[Transform]]

Attributes

policy

setup_executors()

Imports the Transformer Engine executor.

Returns:

A list containing the Transformer Engine executor.

Return type:

list[Executor]