Getting Started
Concepts
Model Zoo
CS Torch
cerebras.pytorch
cerebras.pytorch.amp
cerebras.pytorch.optim
cerebras.pytorch.sparse
cerebras.pytorch.metrics
Cluster Monitoring
Fundamentals
Support
Transforms image and caption data for pretraining.
example (Dict[str, Any]) – The input data containing image and caption information.
**read_hook_kwargs (Any) – Additional keyword arguments containing data_keys.
Transformed data suitable for pretraining.
List[Dict[str, Any]]
AssertionError – If required keys are not provided in read_hook_kwargs.
previous
cerebras.modelzoo.data_preparation.data_preprocessing.hooks.nlg_read_hook
next
cerebras.modelzoo.data_preparation.data_preprocessing.hooks.prompt_completion_chat_read_hook