cerebras.modelzoo.data_preparation.nlp.bert.dynamic_processor.PreprocessInstance

class cerebras.modelzoo.data_preparation.nlp.bert.dynamic_processor.PreprocessInstance(tokens, segment_ids, is_random_next)

Bases: object

A single training (sentence-pair) instance. :param list tokens: List of tokens for sentence pair :param list segment_ids: List of segment ids for sentence pair :param bool is_random_next: Specifies wh ether the second element in the pair is random

Methods

to_dict

previous

cerebras.modelzoo.data_preparation.nlp.bert.dynamic_processor.data_generator

next

cerebras.modelzoo.data_preparation.nlp.bert.fine_tuning