cerebras.modelzoo.data.vision.utils#

Functions

create_worker_cache

Checks for the dir in the worker_cache (SSD) on the worker node corresponding to the src_dir.

is_gpu_distributed

Returns True if DDP is enabled

num_tasks

task_id

Classes

FastDataLoader

ShardedSampler

Modified from: https://pytorch.org/docs/stable/_modules/torch/utils/data/distributed.html#DistributedSampler Sampler that restricts data loading to a subset of the dataset.