Getting Started
Concepts
Model Zoo
CS Torch
cerebras.pytorch
cerebras.pytorch.amp
cerebras.pytorch.optim
cerebras.pytorch.sparse
cerebras.pytorch.metrics
Cluster Monitoring
Fundamentals
Support
Download The Pile dataset from eye.ai website.
args (argparse namespace) – Arguments for downloading the dataset.
split (str) – The subset of the PILE dataset to download.
previous
cerebras.modelzoo.data_preparation.nlp.pile.download.debug_or_download_individual_file
next
cerebras.modelzoo.data_preparation.nlp.pile.download.download_tokenizer_files