cerebras.modelzoo.common.input_utils#

Functions

bucketed_batch

Batch the data from an iterator such that sampels of similar length end up in the same batch.

get_streaming_batch_size

Returns the streaming batch size of the given task.

validate_streaming_and_micro_batch_size

Validates the streaming and micro batch sizes.

Classes

PaddingSample