Getting Started
Concepts
Model Zoo
CS Torch
cerebras.pytorch
cerebras.pytorch.amp
cerebras.pytorch.optim
cerebras.pytorch.sparse
cerebras.pytorch.metrics
Cluster Monitoring
Fundamentals
Support
Postprocessing of the CSV file. This code should parse commas that are part of the token strings. :param: str text: String with an input text.
List of parsed tokens.
previous
cerebras.modelzoo.data.nlp.bert.bert_utils.get_whole_word_span
next
cerebras.modelzoo.data.nlp.bert.bert_utils.shard_and_shuffle_data