Hey @IsidoreSong @fzzfd
You need to set the NODE_RANK to 0 on the first machine and 1 on the second machine. And you need to remove LOCAL_RANK, because Lightning will set that to the correct value.
Please try again using:
export MASTER_ADDR=10.10.10.24
export MASTER_PORT=45547
export NODE_RANK=0 # and 1 on other machine
python3 test.py
Make sure you unset the exported variables you already had (or restart the terminal session).