cerebras.modelzoo.common.run_cstorch_flow.optimizer_step_with_summaries#

cerebras.modelzoo.common.run_cstorch_flow.optimizer_step_with_summaries(loss, optimizer, grad_scaler, max_gradient_norm=None, max_gradient_value=None, log_summaries=False, model=None)[source]#

Customized equivalent to cstorch.amp.optimizer_step additionally featuring grad norm summaries.

previous

cerebras.modelzoo.common.run_cstorch_flow.log_input_summary

next

cerebras.modelzoo.common.run_cstorch_flow.run_cstorch_eval