Hi,
I want to replace the following code with the corresponding Fabric code. Any ideas how to do it?
scaler = torch.cuda.amp.GradScaler(enabled=True)
scaler.scale(loss).backward()
scaler.unscale_(self.optimizer)
torch.nn.utils.clip_grad_norm_(self.model.parameters(), self.max_grad_norm)
scaler.step(self.optimizer)
scaler.update()