cerebras.modelzoo.data.common.SyntheticDataProcessor#

Utilities for generating synthetic data based on some specification.

Functions

custom_dict_flatten

Constructs TensorSpec instances to contain the leaf nodes of the tree structure before flattening.

custom_dict_unflatten

After mapping the TensorSpecs to tensors/callables, return them directly as leaf nodes instead of reconstructing a dictionary when unflattening.

Classes

SyntheticDataProcessor

Creates a synthetic dataset.