cerebras.modelzoo.common.utils.model.lora.LoRA_Embedding#
- class cerebras.modelzoo.common.utils.model.lora.LoRA_Embedding(*args, **kwargs)[source]#
Bases:
torch.nn.Embedding
,cerebras.modelzoo.common.utils.model.lora.LoRALayer
LoRA embedding layer From https://github.com/microsoft/LoRA/blob/main/loralib/layers.py.
Methods
forward
reset_parameters
train