cerebras.modelzoo.tools.checkpoint_converters.streaming_checkpoints#
Functions
Converts a size expressed as a string with digits and unit to an integer. |
|
Returns the size (in bytes) occupied by one parameter of type dtype. |
Classes
Wraps around an input dictionary in order to transform its values on-the-fly. |
|
A Read-only dict. |
|
Marks checkpoint keys that can be directly loaded from/saved to the H5 checkpoint. |
|
Writes a Cerebras H5 checkpoint in a streaming (incremental) manner rather than accumulating the full checkpoint into memory and then writing all weights at the end. |
|
StreamingCSWriterView allows for checkpoints with arbitrarily nested dictionaries/lists to be written in a streaming (incremental) manner by offering a "view" into a StreamingCSWriter. |
|
Allows sharded HuggingFace checkpoints to be read in a streaming manner rather than loading all shards into memory all at once. |
|
Writes a HuggingFace sharded checkpoint in a streaming manner rather than accumulating the full checkpoint into memory and then writing all shards at the end. |