cerebras.modelzoo.data_preparation.data_preprocessing.data_reader.DataFrame#
- class cerebras.modelzoo.data_preparation.data_preprocessing.data_reader.DataFrame(keys=None, format_hook_fn=None)[source]#
Bases:
object
Initialize the DataFrame object.
- Parameters
keys (Dict) – Keys for the data entries.
Methods
Add an entry to the DataFrame.
Clear the raw data after tokenizing.
Tokenize the data values.