How to get path where checkpoints are saved in a Callback?

you can also use trainer.checkpoint_callback.dirpath.

maybe do a brute force search and delete the ones if not found with matching name after checkpoints are saved.