cerebras.modelzoo.data_preparation.data_preprocessing.preprocess_data.main#

cerebras.modelzoo.data_preparation.data_preprocessing.preprocess_data.main()[source]#

Main function for execution.

previous

cerebras.modelzoo.data_preparation.data_preprocessing.preprocess_data

next

cerebras.modelzoo.data_preparation.data_preprocessing.pretraining_token_generator