Back to Reading Room

LA BIBLIOTHÈQUE · READING NOTE

LoRA: Low-Rank Adaptation of Large Language Models

Hu et al.

To Read · 想看

AILLMPapers

LoRA, PEFT, Fine-Tuning, Low-Rank Adaptation

冻结原模型参数,只学习低秩矩阵形式的权重更新,从而大幅降低大模型微调成本,是当前参数高效微调技术的重要基础。