cerebras.modelzoo.data.nlp.gpt

DummyDataProcessor	Pytorch Generic Dataloader
DummyIterableDataProcessor	Pytorch Generic Iterable Dataloader
GptHDF5DataProcessor	Pytorch GPT2/3 Dataloader
GptHDF5MapDataProcessor
HuggingFaceDataProcessorEli5	Pytorch HuggingFace Eli5 map-style Dataloader
HuggingFaceIterableDataProcessorEli5	Pytorch HuggingFace Eli5 Iterable Dataloader
InferenceDataProcessor
config	Config classes of T5 data Configs

previous

cerebras.modelzoo.data.nlp.dpo.config.DpoHDF5DataProcessorConfig

next

cerebras.modelzoo.data.nlp.gpt.DummyDataProcessor