Getting Started
Concepts
Model Zoo
CS Torch
cerebras.pytorch
cerebras.pytorch.amp
cerebras.pytorch.optim
cerebras.pytorch.sparse
cerebras.pytorch.metrics
Cluster Monitoring
Fundamentals
Support
Script to generate an HDF5 dataset for GPT Models.
Functions
main
Main function for execution.
previous
cerebras.modelzoo.data_preparation.data_preprocessing.nlg_token_generator.NLGTokenGenerator
next
cerebras.modelzoo.data_preparation.data_preprocessing.preprocess_data.main