cerebras.modelzoo.data_preparation.nlp.bert.create_csv_static_masking

Preprocessed CSV data generator for BERT pretraining from raw text documents.

Functions

create_csv
main
parse_args

previous

cerebras.modelzoo.data_preparation.nlp.bert.create_csv_mlm_only_static_masking.parse_args

next

cerebras.modelzoo.data_preparation.nlp.bert.create_csv_static_masking.create_csv