cerebras.modelzoo.data.nlp.transformer.TransformerDynamicDataProcessor#

Processor for PyTorch Transformer training.

Classes

TransformerDynamicDataProcessor

Reads text files containing the input text tokens.