Table of Contents
0.2.5.dev0

Home

  • Welcome to ⚡ Lightning Thunder
  • Install
  • Hello World
  • Using examine

Basic

  • Overview
  • Zero to Thunder
  • Thunder step by step
  • The sharp edges
  • Train a MLP on MNIST
  • Thunder Concepts - Trace, BoundSymbol, Symbol and Proxy
  • Hello world ThunderFX
  • FAQ

Intermediate

  • Additional executors
  • Distributed Data Parallel
  • What's next
  • FSDP Under the Hood Tutorial
  • Benchmarking Thunder
  • Introduction
  • Transforms
  • Thunder bindings for Liger operators
  • RoPE
  • Test
  • End to end example

Advanced

  • Inside Thunder
  • Extending Thunder
  • Extend Thunder with CUDA-Python
  • Running our kernel in Thunder
  • Inspect
  • Comparing implementations
  • Summary
  • Defining new Thunder operators
  • Defining custom forward and backward for existing operators
  • Contributing to Thunder

Experimental dev tutorials

  • Extending Thunder

API reference

  • thunder
  • thunder.common
  • thunder.core
  • thunder.clang
  • thunder.examine
  • thunder.distributed
  • thunder.executors
  • thunder.torch
  • thunder.extend
  • thunder.transforms
  • thunder.dynamo
  • thunder.recipes
  • thunder.plugins
  • Overview
  • Team management
  • Production
  • Security
  • Open source
    • Overview
    • PyTorch Lightning
    • Fabric
    • Lit-GPT
    • Torchmetrics
    • Litdata
    • Lit LLaMA
    • Litserve
  • Examples
  • Glossary
  • FAQ
  • Docs >
  • Python Module Index
Shortcuts

Python Module Index

t
 
t
- thunder
    thunder.clang
    thunder.common
    thunder.core
    thunder.core.codeutils
    thunder.core.devices
    thunder.core.dtypes
    thunder.core.langctxs
    thunder.core.prims
    thunder.core.proxies
    thunder.core.pytree
    thunder.core.symbol
    thunder.core.trace
    thunder.core.transforms
    thunder.distributed
    thunder.dynamo
    thunder.examine
    thunder.executors
    thunder.executors.apexex
    thunder.executors.cudnnex
    thunder.executors.nvfuserex
    thunder.executors.passes
    thunder.executors.pythonex
    thunder.executors.torch_compile
    thunder.executors.torchex
    thunder.executors.triton_crossentropy
    thunder.executors.utils
    thunder.extend
    thunder.plugins
    thunder.recipes
    thunder.torch
    thunder.transforms
- thundre
    thundre.core.rematerialization

To analyze traffic and optimize your experience, we serve cookies on this site. By clicking or navigating, you agree to allow our usage of cookies. Read PyTorch Lightning's Privacy Policy.