cerebras.modelzoo.data.nlp.gpt.InferenceDataProcessor.EvalHarnessDataset

class cerebras.modelzoo.data.nlp.gpt.InferenceDataProcessor.EvalHarnessDataset(*args, **kwargs)

Bases: torch.utils.data.Dataset

Methods

map

previous

cerebras.modelzoo.data.nlp.gpt.InferenceDataProcessor.tokenize_stop_words

next

cerebras.modelzoo.data.nlp.gpt.InferenceDataProcessor.InferenceDataProcessor