cerebras.modelzoo.data_preparation.nlp.gptj.split_trc_dataset#

Split input src file into multiple files. Number of examples per file is controlled by buffer_len param.

Functions

main