cerebras.modelzoo.data_preparation.nlp.hdf5_preprocessing.utils.get_verification_args#
- cerebras.modelzoo.data_preparation.nlp.hdf5_preprocessing.utils.get_verification_args(processes, data_processor)[source]#
Get arguments for verifying HDF5 dataset. :param params: Dictionary containing parameters for verifying HDF5 dataset. :type params: dict :param data_processor: Class containing methods that specify how the dataset
will be processed and written into HDF5 files.