Index

Symbols

**kwargs (thunder.dynamo.thunderfx parameter), [1]

_

__call__() (thunder.core.langctxs.langctx method) (thunder.core.symbol.Symbol method) (thunder.dynamo.ThunderCompiler method) (thunder.dynamo.ThunderFXCompiledObject method) (thunder.torch.torchsymbol method) __init__() (thunder.common.CACHE_OPTIONS method) (thunder.common.CompileData method) (thunder.common.CompileStats method) (thunder.core.baseutils.BoundSymbolInterface method) (thunder.core.baseutils.NumberProxyInterface method) (thunder.core.baseutils.ProxyInterface method) (thunder.core.baseutils.SymbolInterface method) (thunder.core.baseutils.TensorProxyInterface method) (thunder.core.codeutils.SigInfo method) (thunder.core.devices.Device method) (thunder.core.devices.DeviceType method) (thunder.core.dtypes.dtype method) (thunder.core.langctxs.langctx method) (thunder.core.prims.PrimIDs method) (thunder.core.proxies.CollectionProxy method) (thunder.core.proxies.ComplexProxy method) (thunder.core.proxies.FloatProxy method) (thunder.core.proxies.FutureTensorProxy method) (thunder.core.proxies.IntegerProxy method) (thunder.core.proxies.TensorProxy method) (thunder.core.proxies.Variable method) (thunder.core.symbol.BoundSymbol method) (thunder.core.symbol.BoundSymbolRHS method) (thunder.core.symbol.Symbol method) (thunder.core.trace.TraceCtx method) (thunder.core.transforms.Node method) (thunder.core.transforms.VISIT_TYPE method) (thunder.DebugOptions method) (thunder.distributed.FSDPBucketingStrategy method) (thunder.distributed.FSDPType method) (thunder.dynamo.ThunderCompiler method) (thunder.dynamo.ThunderFXCompiledObject method) (thunder.executors.torch_compile.TorchCompileExecutor method) (thunder.executors.utils.Region method) (thunder.extend.Executor method) (thunder.plugins.DDP method) (thunder.plugins.FP8 method) (thunder.plugins.FSDP method) (thunder.plugins.QuantizeInt4 method) (thunder.plugins.ReduceOverhead method) (thunder.recipes.BaseRecipe method) (thunder.recipes.HFTransformers method) (thunder.torch.torchsymbol method) (thunder.transforms.ConstantFolding method) (thunder.transforms.MaterializationTransform method)

_register_custom_op() (in module thunder.torch)

A

a (thunder.clang.matrix_transpose parameter), [1] abs() (in module thunder.clang) acos() (in module thunder.clang) acosh() (in module thunder.clang) add() (in module thunder.clang) add_always_executor() (in module thunder.extend) add_default_executor() (in module thunder.extend) apex_entropy_available() (in module thunder.executors.apexex) apply() (thunder.recipes.HFTransformers method)

arange() (in module thunder.clang) are_all_args_constant (thunder.core.symbol.BoundSymbol property) args (thunder.core.trace.TraceCtx attribute) asin() (in module thunder.clang) asinh() (in module thunder.clang) assign (thunder.ThunderModule.load_state_dict parameter) atan() (in module thunder.clang) atan2() (in module thunder.clang) atanh() (in module thunder.clang)

B

BaseRecipe (class in thunder.recipes) bfloat16 (in module thunder.core.dtypes) bitwise_and() (in module thunder.clang) bitwise_not() (in module thunder.clang) bitwise_or() (in module thunder.clang) bitwise_xor() (in module thunder.clang) BLOCK (thunder.distributed.FSDPBucketingStrategy attribute) bool8 (in module thunder.core.dtypes) bound_symbols (thunder.core.trace.TraceCtx attribute) BoundSymbol (class in thunder.core.symbol)

BoundSymbolInterface (class in thunder.core.baseutils) BoundSymbolRHS (class in thunder.core.symbol) broadcast_from (thunder.distributed.ddp parameter), [1] (thunder.distributed.fsdp parameter), [1] (thunder.plugins.DDP parameter), [1] (thunder.plugins.FSDP parameter), [1] bsym_list_to_dag() (in module thunder.core.transforms) bucket_size_in_mb (thunder.distributed.ddp parameter), [1] (thunder.plugins.DDP parameter), [1] bucketing_strategy (thunder.distributed.fsdp parameter), [1] (thunder.plugins.FSDP parameter), [1]

C

cache (thunder.common.CompileStats attribute) (thunder.jit parameter), [1] cache_hits (thunder.common.CompileStats attribute) cache_hits() (in module thunder) cache_misses (thunder.common.CompileStats attribute) cache_misses() (in module thunder) cache_option() (in module thunder) CACHE_OPTIONS (class in thunder.common) calls (thunder.common.CompileStats attribute) cat() (in module thunder.clang) ceil() (in module thunder.clang) check() (in module thunder.core.baseutils) check_traces (thunder.DebugOptions parameter), [1] check_type() (in module thunder.core.baseutils) clear_mutable_collections (thunder.executors.passes.del_last_used parameter), [1] CollectionProxy (class in thunder.core.proxies)

column_parallel() (in module thunder.distributed) compile_data() (in module thunder) compile_stats() (in module thunder) CompileData (class in thunder.common) CompileStats (class in thunder.common) complex128 (in module thunder.core.dtypes) complex32 (in module thunder.core.dtypes) complex64 (in module thunder.core.dtypes) ComplexProxy (class in thunder.core.proxies) compute_broadcast_shape() (in module thunder.clang) ConstantFolding (class in thunder.transforms) convolution() (in module thunder.clang) copysign() (in module thunder.clang) cos() (in module thunder.clang) cosh() (in module thunder.clang) cudnn_ex (in module thunder.executors.cudnnex) custom_op (thunder.torch._register_custom_op parameter), [1]

D

DDP (class in thunder.plugins) ddp() (in module thunder.distributed) ddp_bucket_size_in_mb (thunder.plugins.FSDP parameter), [1] debug_options (thunder.jit parameter), [1] DebugOptions (class in thunder) del_last_used() (in module thunder.executors.passes) deregister_executor() (in module thunder.extend) destination (thunder.ThunderModule.original_state_dict parameter) (thunder.ThunderModule.state_dict parameter)

Device (class in thunder.core.devices) device (thunder.distributed.fsdp parameter), [1] (thunder.plugins.FSDP parameter), [1] (thunder.transforms.MaterializationTransform parameter), [1] device_from_string() (in module thunder.core.devices) device_put() (in module thunder.clang) DeviceType (class in thunder.core.devices) devicetype_string() (in module thunder.core.devices) diagonal() (in module thunder.clang) dtype (class in thunder.core.dtypes)

E

eq() (in module thunder.clang) erf() (in module thunder.clang) erfc() (in module thunder.clang) erfcinv() (in module thunder.clang) erfinv() (in module thunder.clang) examine() (in module thunder.examine)

Executor (class in thunder.extend) executors (thunder.jit parameter), [1] exp() (in module thunder.clang) exp2() (in module thunder.clang) expand() (in module thunder.clang) expm1() (in module thunder.clang)

F

flatten() (in module thunder.clang) float16 (in module thunder.core.dtypes) float32 (in module thunder.core.dtypes) float64 (in module thunder.core.dtypes) FloatProxy (class in thunder.core.proxies) floor() (in module thunder.clang) floor_divide() (in module thunder.clang) fmod() (in module thunder.clang) fn (thunder.core.trace.TraceCtx attribute) (thunder.core.trace.TraceCtx parameter), [1] (thunder.core.transforms.insert_inplace parameter), [1] (thunder.core.transforms.replace_inplace parameter), [1] (thunder.dynamo.thunderfx parameter), [1] (thunder.jit parameter), [1]

FP8 (class in thunder.plugins) from_bsym_swap_proxies() (thunder.core.symbol.BoundSymbol method) from_trace() (in module thunder.core.trace) FSDP (class in thunder.plugins) fsdp() (in module thunder.distributed) FSDPBucketingStrategy (class in thunder.distributed) FSDPType (class in thunder.distributed) full() (in module thunder.clang) full_like() (in module thunder.clang) fuser (thunder.recipes.BaseRecipe parameter), [1] FutureTensorProxy (class in thunder.core.proxies)

G

ge() (in module thunder.clang) get_all_executors() (in module thunder.extend) get_always_executors() (in module thunder.extend) get_buffer() (thunder.ThunderModule method) get_default_executors() (in module thunder.extend) get_executor() (in module thunder.extend) get_langctx() (in module thunder.core.langctxs)

get_nvfuser_executor() (in module thunder.executors) get_parameter() (thunder.ThunderModule method) get_siginfo() (in module thunder.core.codeutils) get_skip_data_parallel_grad_sync() (in module thunder.distributed) get_submodule() (thunder.ThunderModule method) get_torch_executor() (in module thunder.executors) get_tracectx() (in module thunder.core.trace) gt() (in module thunder.clang)

H

HFTransformers (class in thunder.recipes)

I

idx (thunder.core.transforms.insert_inplace parameter), [1] (thunder.core.transforms.replace_inplace parameter), [1] index_add() (in module thunder.clang) init (thunder.transforms.MaterializationTransform parameter), [1] insert_inplace() (in module thunder.core.transforms) int16 (in module thunder.core.dtypes) int32 (in module thunder.core.dtypes)

int64 (in module thunder.core.dtypes) int8 (in module thunder.core.dtypes) IntegerProxy (class in thunder.core.proxies) interpreter (thunder.recipes.BaseRecipe parameter), [1] (thunder.recipes.HFTransformers parameter), [1] interpreter_cache (thunder.common.CompileStats attribute) is_proxyable() (in module thunder.core.proxies) isfinite() (in module thunder.clang)

J

jit() (in module thunder)

K

keep_vars (thunder.ThunderModule.original_state_dict parameter) (thunder.ThunderModule.state_dict parameter)

kwargs (thunder.core.trace.TraceCtx attribute)

L

langctx (class in thunder.core.langctxs) (thunder.jit parameter), [1] last_backward_traces (thunder.common.CompileStats attribute) (thunder.dynamo.ThunderFXCompiledObject property) last_backward_traces() (in module thunder) last_compile_options() (in module thunder) last_compile_reasons (thunder.common.CompileStats attribute) last_computation (thunder.common.CompileStats attribute) last_computation_execution_start (thunder.common.CompileStats attribute) last_computation_execution_stop (thunder.common.CompileStats attribute) last_interpreted_instructions (thunder.common.CompileStats attribute) last_interpreted_instructions() (in module thunder) last_interpreter_log (thunder.common.CompileStats attribute) last_interpreter_log() (in module thunder) last_prologue (thunder.common.CompileStats attribute) last_prologue_execution_start (thunder.common.CompileStats attribute) last_prologue_execution_stop (thunder.common.CompileStats attribute) last_prologue_traces (thunder.common.CompileStats attribute) last_prologue_traces() (in module thunder) last_prologue_transformation_start (thunder.common.CompileStats attribute) last_prologue_transformation_stop (thunder.common.CompileStats attribute)

last_trace_cache_start (thunder.common.CompileStats attribute) last_trace_cache_stop (thunder.common.CompileStats attribute) last_trace_host_execution_start (thunder.common.CompileStats attribute) last_trace_host_execution_stop (thunder.common.CompileStats attribute) last_trace_host_start (thunder.common.CompileStats attribute) last_trace_host_stop (thunder.common.CompileStats attribute) last_trace_tracing_start (thunder.common.CompileStats attribute) last_trace_tracing_stop (thunder.common.CompileStats attribute) last_traces (thunder.common.CompileStats attribute) (thunder.dynamo.ThunderFXCompiledObject property) last_traces() (in module thunder) LAYER (thunder.distributed.FSDPBucketingStrategy attribute) le() (in module thunder.clang) lgamma() (in module thunder.clang) list_transforms() (in module thunder) load_state_dict() (thunder.ThunderModule method) log() (in module thunder.clang) log10() (in module thunder.clang) log1p() (in module thunder.clang) log2() (in module thunder.clang) logical_and() (in module thunder.clang) lt() (in module thunder.clang)

M

make_compiled() (in module thunder.executors.torch_compile) MaterializationTransform (class in thunder.transforms) matrix_transpose() (in module thunder.clang) maybe_broadcast() (in module thunder.clang) maybe_convert_to_dtype() (in module thunder.clang) mod() (in module thunder.clang) mode (thunder.executors.torch_compile.TorchCompileExecutor parameter), [1] model (thunder.distributed.ddp parameter), [1] (thunder.distributed.fsdp parameter), [1] (thunder.recipes.HFTransformers.apply parameter), [1] (thunder.recipes.HFTransformers.validate parameter), [1] module thunder thunder.clang thunder.common thunder.core thunder.core.codeutils thunder.core.devices thunder.core.dtypes thunder.core.langctxs thunder.core.prims thunder.core.proxies thunder.core.pytree thunder.core.symbol thunder.core.trace thunder.core.transforms thunder.distributed thunder.dynamo thunder.examine thunder.executors thunder.executors.apexex thunder.executors.cudnnex thunder.executors.nvfuserex thunder.executors.passes thunder.executors.pythonex thunder.executors.torch_compile thunder.executors.torchex thunder.executors.triton_crossentropy thunder.executors.utils thunder.extend thunder.plugins thunder.recipes thunder.torch thunder.transforms thundre.core.rematerialization

move_state_dict_to_cpu (thunder.distributed.fsdp parameter), [1] (thunder.plugins.FSDP parameter), [1] movedim() (in module thunder.clang) mul() (in module thunder.clang)

N

name (thunder.executors.torch_compile.TorchCompileExecutor parameter), [1] named_buffers() (thunder.ThunderModule method) named_parameters() (thunder.ThunderModule method) ndtri() (in module thunder.clang) ne() (in module thunder.clang) neg() (in module thunder.clang)

nextafter() (in module thunder.clang) no_sync() (thunder.ThunderModule method) Node (class in thunder.core.transforms) NONE (thunder.distributed.FSDPBucketingStrategy attribute) NumberProxyInterface (class in thunder.core.baseutils) nvfuser_available() (in module thunder.executors)

O

original_state_dict() (thunder.ThunderModule method)

P

plugins (thunder.recipes.BaseRecipe parameter), [1] (thunder.recipes.HFTransformers parameter), [1] pow() (in module thunder.clang) prefix (thunder.core.baseutils.ProxyInterface property) (thunder.core.proxies.IntegerProxy property) (thunder.ThunderModule.named_buffers parameter) (thunder.ThunderModule.named_parameters parameter) (thunder.ThunderModule.original_state_dict parameter) (thunder.ThunderModule.state_dict parameter)

prettyprint() (in module thunder.core.codeutils) PrimIDs (class in thunder.core.prims) process_group (thunder.distributed.column_parallel parameter), [1] (thunder.distributed.row_parallel parameter), [1] (thunder.plugins.DDP parameter), [1] (thunder.plugins.FSDP parameter), [1] proxy() (in module thunder.core.proxies) ProxyInterface (class in thunder.core.baseutils) pytype() (in module thunder.core.proxies) pyval() (in module thunder.core.proxies)

Q

QuantizeInt4 (class in thunder.plugins)

R

reciprocal() (in module thunder.clang) record_interpreter_history (thunder.DebugOptions parameter), [1] recurse (thunder.ThunderModule.named_buffers parameter) (thunder.ThunderModule.named_parameters parameter) ReduceOverhead (class in thunder.plugins) Region (class in thunder.executors.utils) register_executor() (in module thunder.extend) remainder() (in module thunder.clang) rematerialize() (in module thunder.core.rematerialization) remove_always_executor() (in module thunder.extend) remove_default_executor() (in module thunder.extend) remove_duplicate (thunder.ThunderModule.named_buffers parameter) (thunder.ThunderModule.named_parameters parameter) replace() (thunder.core.proxies.ComplexProxy method) (thunder.core.proxies.FloatProxy method) (thunder.core.proxies.FutureTensorProxy method) (thunder.core.proxies.IntegerProxy method) (thunder.core.proxies.TensorProxy method)

replace_inplace() (in module thunder.core.transforms) reproducer_folder (thunder.dynamo.ThunderCompiler.save_reproducer_to_folder parameter), [1] required_ops (thunder.executors.torch_compile.TorchCompileExecutor parameter), [1] reset_langctx() (in module thunder.core.langctxs) reset_skip_data_parallel_grad_sync() (in module thunder.distributed) reset_tracectx() (in module thunder.core.trace) reshape() (in module thunder.clang) round() (in module thunder.clang) row_parallel() (in module thunder.distributed) rsqrt() (in module thunder.clang)

S

save_reproducer_to_folder() (thunder.dynamo.ThunderCompiler method) scatter_add() (in module thunder.clang) scopes (thunder.core.trace.TraceCtx attribute) set_always_executors() (in module thunder.extend) set_default_executors() (in module thunder.extend) set_langctx() (in module thunder.core.langctxs) set_skip_data_parallel_grad_sync() (in module thunder.distributed) set_tracectx() (in module thunder.core.trace) setup_config() (thunder.recipes.BaseRecipe method) (thunder.recipes.HFTransformers method) setup_executors() (thunder.plugins.FP8 method) (thunder.plugins.QuantizeInt4 method) (thunder.recipes.BaseRecipe method) setup_fuser() (thunder.recipes.BaseRecipe method) setup_lookasides() (thunder.recipes.HFTransformers method) setup_transforms() (thunder.plugins.DDP method) (thunder.plugins.FSDP method) (thunder.plugins.QuantizeInt4 method) (thunder.plugins.ReduceOverhead method) (thunder.recipes.BaseRecipe method) (thunder.recipes.HFTransformers method) sharding_strategy (thunder.distributed.fsdp parameter), [1] (thunder.plugins.FSDP parameter), [1] sharp_edges (thunder.jit parameter), [1] show_interpreter_progress (thunder.DebugOptions parameter), [1]

show_progress (thunder.recipes.BaseRecipe parameter), [1] (thunder.recipes.HFTransformers parameter), [1] SigInfo (class in thunder.core.codeutils) sigmoid() (in module thunder.clang) sign() (in module thunder.clang) signbit() (in module thunder.clang) silu() (in module thunder.clang) sin() (in module thunder.clang) sinh() (in module thunder.clang) size() (in module thunder.torch) skip_data_parallel_grad_sync() (in module thunder.distributed) skip_inputs (thunder.core.symbol.BoundSymbol.from_bsym_swap_proxies parameter), [1] skip_output (thunder.core.symbol.BoundSymbol.from_bsym_swap_proxies parameter), [1] skip_subsymbols (thunder.core.symbol.BoundSymbol.from_bsym_swap_proxies parameter), [1] slice_in_dim() (in module thunder.clang) sqrt() (in module thunder.clang) squeeze() (in module thunder.clang) stack() (in module thunder.clang) state_dict (thunder.ThunderModule.load_state_dict parameter) state_dict() (thunder.ThunderModule method) strict (thunder.ThunderModule.load_state_dict parameter) stride_order() (in module thunder.clang) sub() (in module thunder.clang) Symbol (class in thunder.core.symbol) SymbolInterface (class in thunder.core.baseutils)

T

take() (in module thunder.clang) take_along_axis() (in module thunder.clang) tan() (in module thunder.clang) tanh() (in module thunder.clang) target (thunder.ThunderModule.get_buffer parameter) (thunder.ThunderModule.get_parameter parameter) (thunder.ThunderModule.get_submodule parameter) target_modules (thunder.distributed.column_parallel parameter), [1] (thunder.distributed.row_parallel parameter), [1] TensorProxy (class in thunder.core.proxies) TensorProxyInterface (class in thunder.core.baseutils) thunder module thunder.clang module thunder.common module thunder.core module thunder.core.codeutils module thunder.core.devices module thunder.core.dtypes module thunder.core.langctxs module thunder.core.prims module thunder.core.proxies module thunder.core.pytree module thunder.core.symbol module thunder.core.trace module thunder.core.transforms module thunder.distributed module thunder.dynamo module thunder.examine module thunder.executors module thunder.executors.apexex module thunder.executors.cudnnex module thunder.executors.nvfuserex module

thunder.executors.passes module thunder.executors.pythonex module thunder.executors.torch_compile module thunder.executors.torchex module thunder.executors.triton_crossentropy module thunder.executors.utils module thunder.extend module thunder.plugins module thunder.recipes module thunder.torch module thunder.transforms module thunder_module (thunder.distributed.column_parallel parameter), [1] (thunder.distributed.row_parallel parameter), [1] thunder_options (thunder.dynamo.ThunderCompiler parameter), [1], [2], [3] ThunderCompiler (class in thunder.dynamo) thunderfx() (in module thunder.dynamo) ThunderFXCompiledObject (class in thunder.dynamo) ThunderModule (class in thunder) thundre.core.rematerialization module to_device() (in module thunder.core.devices) to_dtype() (in module thunder.core.dtypes) to_float() (in module thunder.torch) token (thunder.distributed.reset_skip_data_parallel_grad_sync parameter), [1] toposort_bsym_dag() (in module thunder.core.transforms) TorchCompileExecutor (class in thunder.executors.torch_compile) torchsymbol (class in thunder.torch) trace (thunder.core.rematerialization.rematerialize parameter), [1] (thunder.executors.passes.del_last_used parameter), [1] (thunder.executors.passes.update_fusion_call_ctx parameter), [1] TraceCtx (class in thunder.core.trace) transform_for_execution() (in module thunder.executors.passes) transform_module() (thunder.transforms.MaterializationTransform method) transform_traces_pre_prologue() (thunder.transforms.ConstantFolding method) transforms (thunder.jit parameter), [1] transpose() (in module thunder.clang) trc (thunder.core.transforms.insert_inplace parameter), [1] (thunder.core.transforms.replace_inplace parameter), [1] true_divide() (in module thunder.clang) trunc() (in module thunder.clang)

U

uint8 (in module thunder.core.dtypes) uniform() (in module thunder.clang) uniform_like() (in module thunder.clang)

unsqueeze() (in module thunder.clang) unvariableify() (in module thunder.core.proxies) update_fusion_call_ctx() (in module thunder.executors.passes) use_pytest_benchmark (thunder.dynamo.ThunderCompiler.save_reproducer_to_folder parameter), [1]

V

validate() (thunder.recipes.HFTransformers class method) value (thunder.distributed.set_skip_data_parallel_grad_sync parameter), [1] Variable (class in thunder.core.proxies)

variableify() (in module thunder.core.proxies) VISIT_TYPE (class in thunder.core.transforms) visitor_transform() (in module thunder.core.transforms)

W

where() (in module thunder.clang)

Z

ZERO2 (thunder.distributed.FSDPType attribute)

ZERO3 (thunder.distributed.FSDPType attribute)