thunder.plugins.ReduceOverhead

class thunder.plugins.ReduceOverhead[source]

Bases: Plugin

Plugin to enable CUDA Graphs and reduce CPU overhead.

Methods

`__init__`()
`setup_executors`()	rtype: `Optional`[`list`[`Executor`]]
`setup_lookasides`()	rtype: `Optional`[`list`[`Lookaside`]]
`setup_transforms`()	Fetches the CUDAGraph transform.

Attributes

policy

setup_transforms()[source]

Fetches the CUDAGraph transform.

Was this page helpful?