cerebras.modelzoo.common.utils.model.lora.LoRALayer#
- class cerebras.modelzoo.common.utils.model.lora.LoRALayer(r, lora_alpha, lora_dropout, merge_weights)[source]#
Bases:
object
Base LoRA layer From https://github.com/microsoft/LoRA/blob/main/loralib/layers.py.
Methods