cerebras.modelzoo.common.utils.model.lora.LoRA_Embedding#

class cerebras.modelzoo.common.utils.model.lora.LoRA_Embedding(*args, **kwargs)[source]#

Bases: torch.nn.Embedding, cerebras.modelzoo.common.utils.model.lora.LoRALayer

LoRA embedding layer From https://github.com/microsoft/LoRA/blob/main/loralib/layers.py.

Methods

forward

reset_parameters

train