cerebras.modelzoo.common.utils.model.lora.LoRALayer#

class cerebras.modelzoo.common.utils.model.lora.LoRALayer(r, lora_alpha, lora_dropout, merge_weights)[source]#

Bases: object

Base LoRA layer From https://github.com/microsoft/LoRA/blob/main/loralib/layers.py.

Methods