cerebras.modelzoo.common.run_cstorch_flow.compute_grad_norm#

cerebras.modelzoo.common.run_cstorch_flow.compute_grad_norm(model)[source]#

Compute the model wise and per layer norm of the gradients.

previous

cerebras.modelzoo.common.run_cstorch_flow

next

cerebras.modelzoo.common.run_cstorch_flow.compute_params_norm