Table of Contents
Shortcuts

thunder.distributed.get_skip_data_parallel_grad_sync

thunder.distributed.get_skip_data_parallel_grad_sync()[source]

Get whether to skip data parallel grad sync.

Return type:

bool

Returns:

Whether to skip data parallel grad sync.

To analyze traffic and optimize your experience, we serve cookies on this site. By clicking or navigating, you agree to allow our usage of cookies. Read PyTorch Lightning's Privacy Policy.