Getting Started
Concepts
Model Zoo
CS Torch
cerebras.pytorch
cerebras.pytorch.amp
cerebras.pytorch.optim
cerebras.pytorch.sparse
cerebras.pytorch.metrics
Cluster Monitoring
Fundamentals
Support
Returns the whole word start and end indices.
list tokens: Tokens to process.
int start_index: Start index.
tuple with start and end index of the word from the token list.
previous
cerebras.modelzoo.data.nlp.bert.bert_utils.get_meta_data
next
cerebras.modelzoo.data.nlp.bert.bert_utils.parse_text