Runing ddp accross two machines

Yeah, you are right. I fogot to say that I was simulate multi-node on a single machine with 2-GPU.

1 Like