thunder.plugins.ReduceOverhead

class thunder.plugins.ReduceOverhead

Bases: Plugin

Plugin to enable CUDA Graphs and reduce CPU overhead.

__init__()

Methods

__init__()
setup_executors()	rtype: Optional[list[Executor]]
setup_lookasides()	rtype: Optional[list[Lookaside]]
setup_transforms()	Fetches the CUDAGraph transform.

Attributes

policy

setup_transforms()

Fetches the CUDAGraph transform.

Returns:

A list containing the CUDAGraph transform.

Return type:

list[Transform]