cerebras.modelzoo.data_preparation.data_preprocessing.custom_hook_examples.custom_hooks#

Functions

create_unique_hash

fetch_single_image

Fetches an image from the provided URL.

multiple_images_llava_finetuning_hook

Transforms conversation data for finetuning LLaVA with multiple images.

obelics_hook

Process obelics dataset examples into a semantic_data_array format.

ultra_chat_common_words_mask_hook

Process common words mask data from an Ultra Chat dataset into a semantic_data_array format.