Table of Contents
0.2.5.dev0

Home

  • Welcome to ⚡ Lightning Thunder
  • Install
  • Hello World
  • Using examine

Basic

  • Overview
  • Zero to Thunder
  • Thunder step by step
  • The sharp edges
  • Train a MLP on MNIST
  • Thunder Concepts - Trace, BoundSymbol, Symbol and Proxy
  • Hello world ThunderFX
  • FAQ

Intermediate

  • Additional executors
  • Distributed Data Parallel
  • What's next
  • FSDP Under the Hood Tutorial
  • Benchmarking Thunder
  • Introduction
  • Transforms
  • Thunder bindings for Liger operators
  • RoPE
  • Test
  • End to end example

Advanced

  • Inside Thunder
  • Extending Thunder
  • Extend Thunder with CUDA-Python
  • Running our kernel in Thunder
  • Inspect
  • Comparing implementations
  • Summary
  • Defining new Thunder operators
  • Defining custom forward and backward for existing operators
  • Contributing to Thunder

Experimental dev tutorials

  • Extending Thunder

API reference

  • thunder
  • thunder.common
  • thunder.core
  • thunder.clang
  • thunder.examine
  • thunder.distributed
  • thunder.executors
  • thunder.torch
  • thunder.extend
  • thunder.transforms
  • thunder.dynamo
  • thunder.recipes
  • thunder.plugins
  • Overview
  • Team management
  • Production
  • Security
  • Open source
    • Overview
    • PyTorch Lightning
    • Fabric
    • Lit-GPT
    • Torchmetrics
    • Litdata
    • Lit LLaMA
    • Litserve
  • Examples
  • Glossary
  • FAQ
  • Docs >
  • thunder.extend
Shortcuts

thunder.extend¶

register_executor(ex)

rtype:

Executor

deregister_executor(ex)

rtype:

None

get_all_executors()

rtype:

tuple[Executor, ...]

get_default_executors()

rtype:

tuple[Executor, ...]

get_always_executors()

rtype:

tuple[Executor, ...]

get_executor(name)

rtype:

Optional[Executor]

set_default_executors(defaults)

rtype:

list[Executor]

set_always_executors(always)

rtype:

list[Executor]

add_default_executor(ex)

rtype:

list[Executor]

add_always_executor(ex)

rtype:

list[Executor]

remove_default_executor(ex)

rtype:

list[Executor]

remove_always_executor(ex)

rtype:

list[Executor]

Executor(name, *[, version])

  • thunder.extend

To analyze traffic and optimize your experience, we serve cookies on this site. By clicking or navigating, you agree to allow our usage of cookies. Read PyTorch Lightning's Privacy Policy.