Is gradient clipping done before or after gradients accumulation?

[zlenyk]

That’s great, thank you for the answer and the documentation!