If I want to use warmup lr+CosineAnnealingLR in Lightning, how to write in LightningModule
You can use the configure_optimizers method to implement it in Lightning.