cerebras.modelzoo.data_preparation.nlp.bert.ner_data_processor#

Common pre-processing functions taken from: https://github.com/NVIDIA/DeepLearningExamples/blob/master/TensorFlow/LanguageModeling/BERT/run_ner.py with minor modifications

Functions

create_parser

Parse command-line arguments.

get_tokens_and_labels

write_label_map_files

Classes

InputExample

A single training/test example for simple sequence classification.

NERProcessor