cerebras.modelzoo.common.utils.model.mup_utils.process_lr_adjustment_params#
- cerebras.modelzoo.common.utils.model.mup_utils.process_lr_adjustment_params(model_lr_adjustment_groups, params_lr_adjustment_groups)[source]#
Parses the model’s supported lr adjustment groups and optionally overrides any user set scales :param model_lr_adjustment_groups: Keys are the :type model_lr_adjustment_groups: dict :param LR group name and the values are LRAdjustmentGroup instances: :param params_lr_adjustment_groups: Keys are the :type params_lr_adjustment_groups: dict :param LR group name and the values are the scale override value:
- Returns
A tuple consisting of a list of the adjustment scales with a corresponding list of parameter filter callables used to identify params that belong to the scales
- Return type
Tuple