How to checkpoint on multiple validation sets

Trainer
1

My model has multiple validation sets, and each of them behaves the same way. I’m currently logging using:

self.log('val_loss', loss)

However, I noticed that the validation loss from each validation set is automatically added with a name ‘val_loss/dataloader_idx_1’. How to save checkpoints based on the average validation loss of all datasets in this case?

2

Hello, my apology for the late reply. We are slowly converging to deprecate this forum in favor of the GH build-in version… Could we kindly ask you to recreate your question there - Lightning Discussions