cerebras.modelzoo.common.utils.model.mup_utils.process_lr_adjustment_params#

cerebras.modelzoo.common.utils.model.mup_utils.process_lr_adjustment_params(model_lr_adjustment_groups, params_lr_adjustment_groups)[source]#

Parses the model’s supported lr adjustment groups and optionally overrides any user set scales :param model_lr_adjustment_groups: Keys are the :type model_lr_adjustment_groups: dict :param LR group name and the values are LRAdjustmentGroup instances: :param params_lr_adjustment_groups: Keys are the :type params_lr_adjustment_groups: dict :param LR group name and the values are the scale override value:

Returns

A tuple consisting of a list of the adjustment scales with a corresponding list of parameter filter callables used to identify params that belong to the scales

Return type

Tuple