thunder.distributed.skip_data_parallel_grad_sync¶

thunder.distributed.skip_data_parallel_grad_sync()[source]¶

A context manager to skip data parallel grad sync.