cerebras.modelzoo.common.utils.model.transformer_utils.smooth_loss#

cerebras.modelzoo.common.utils.model.transformer_utils.smooth_loss(prediction_scores, loss, label_smoothing, classes)[source]#

Add label smoothing to loss function, this is a workaround method of label smoothing in our system

previous

cerebras.modelzoo.common.utils.model.transformer_utils.replace_with_zero_and_neg_inf

next

cerebras.modelzoo.common.utils.model.vocab_utils