cerebras.modelzoo.data_preparation.nlp.bert.mlm_only_processor.MLMOnlyInstance#

class cerebras.modelzoo.data_preparation.nlp.bert.mlm_only_processor.MLMOnlyInstance(tokens, masked_lm_positions, masked_lm_labels)[source]#

Bases: object

A single training MLMOnly instance. :param list tokens: List of tokens for MLM example :param list masked_lm_positions: List of masked lm positions for sentence pair :param list masked_lm_labels: List of masked lm labels for example

Methods

previous

cerebras.modelzoo.data_preparation.nlp.bert.mlm_only_processor.data_generator

next

cerebras.modelzoo.data_preparation.nlp.bert.ner_data_processor