cerebras.modelzoo.common.utils.model.lora.LoRA_Linear#
- class cerebras.modelzoo.common.utils.model.lora.LoRA_Linear(*args, **kwargs)[source]#
Bases:
torch.nn.Linear
,cerebras.modelzoo.common.utils.model.lora.LoRALayer
LoRA linear layer From https://github.com/microsoft/LoRA/blob/main/loralib/layers.py.
Methods
forward
reset_parameters
train