cerebras.modelzoo.common.utils.model.lora.LoRA_Linear#

class cerebras.modelzoo.common.utils.model.lora.LoRA_Linear(*args, **kwargs)[source]#

Bases: torch.nn.Linear, cerebras.modelzoo.common.utils.model.lora.LoRALayer

LoRA linear layer From https://github.com/microsoft/LoRA/blob/main/loralib/layers.py.

Methods

forward

reset_parameters

train