Thank you @shreeyak for your suggestion and pointers.
So far I’ve decided to manually set the hydra.run.dir myself, thus enabling the ckpts and logging folders to be shared among the DDP processes.
I am not too familiar with the rank 0 process related callbacks but I am willing to study it more and come back with a better solution granted I can find one.
Have a nice day 