When using tuner.lr_find
in Lightning 2.2.0
with PyTorch 2.2.0
, I get the warning below:
…\Lib\site-packages\torch\optim\lr_scheduler.py:143: UserWarning: Detected call of lr_scheduler.step()
before optimizer.step()
. In PyTorch 1.1.0 and later, you should call them in the opposite order: optimizer.step()
before lr_scheduler.step()
. Failure to do this will result in PyTorch skipping the first value of the learning rate schedule. See more details at torch.optim — PyTorch 2.2 documentation
warnings.warn("Detected call of lr_scheduler.step()
before optimizer.step()
. "
Is that an issue with Lightning?