How to use warmup lr+CosineAnnealingLR in Lightning

[Arrebol]

If I want to use warmup lr+CosineAnnealingLR in Lightning, how to write in LightningModule

[aniketmaurya]

You can use the configure_optimizers method to implement it in Lightning.

[Ruize_Wu]

can you see my question? it’s similar.

How to get max epochs in pl.LightningModule?

I wang to get max epochs in pl.LightningModule to set CosineAnnealingLR. It’s need this. def configure_optimizers(self): optimizer = optim.Adam(self.parameters(), lr=1e-4, weight_decay=5e-5) scheduler = optim.lr_scheduler.CosineAnnealingLR(optimizer, T_max=self.current_epoch, eta_min=1e-6) return {"optimizer": optimizer, "lr_scheduler": scheduler} Or there is another better way???