ManualOptimization

class pytorch_lightning.loops.optimization.ManualOptimization

Bases: pytorch_lightning.loops.loop.Loop[Dict[str, Any]]

A special loop implementing what is known in Lightning as Manual Optimization where the optimization happens entirely in the training_step() and therefore the user is responsible for back-propagating gradients and making calls to the optimizers.

This loop is a trivial case because it performs only a single iteration (calling directly into the module’s training_step()) and passing through the output(s).

output_result_cls

alias of pytorch_lightning.loops.optimization.manual_loop.ManualResult

advance(kwargs)

Performs the training step for manual optimization.

Parameters:

kwargs (OrderedDict) – The kwargs passed down to the hooks.

Return type:

None

on_run_end()

Returns the result of this loop, i.e., the post-processed outputs from the training step.

Return type:

Dict[str, Any]

on_run_start(*_, **__)

Hook to be called as the first thing after entering run (except the state reset).

Accepts all arguments passed to run.

Return type:

None

reset()

Resets the internal state of the loop at the beginning of each call to run.

Example:

def reset(self):
    # reset your internal state or add custom logic
    # if you expect run() to be called multiple times
    self.current_iteration = 0
    self.outputs = []

Return type:

None

property done: bool

Property indicating when the loop is finished.

Example:

@property
def done(self):
    return self.trainer.global_step >= self.trainer.max_steps