cerebras.modelzoo.tools.checkpoint_converters.mup#

Functions

scale_initializers_by_dimension

Classes

ConfigConverter_T5_sP_muP

ConfigConverter_muP_CS22_CS23

Transforms a CS 2.2 muP config to a CS 2.3 muP config with the reworked params.

ConfigConverter_sP_muP_post_CS23

Transforms a CS 2.3 and onwards muP config to a CS sP config.

ConfigConverter_sP_muP_pre_CS23

Transforms a CS 2.2 and before muP config to a CS sP config.

Converter_T5_sP_muP

Transforms a T5 CS muP checkpoint into a T5 CS sP checkpoint.

Converter_sP_muP_post_CS23

Transforms a CS 2.3 and onwards muP checkpoint into a CS sP checkpoint.

Converter_sP_muP_pre_CS23

Transforms a CS 2.2 and older muP checkpoints into a CS sP checkpoint.