A from-scratch PyTorch implementation of Low-Rank Adaptation (LoRA) to efficiently fine-tune BERT models for text classification. This project compares the performance and parameter efficiency of LoRA, full fine-tuning, and from-scratch training.
What is the msmrexe/pytorch-lora-from-scratch GitHub project? Description: "A from-scratch PyTorch implementation of Low-Rank Adaptation (LoRA) to efficiently fine-tune BERT models for text classification. This project compares the performance and parameter efficiency of LoRA, full fine-tuning, and from-scratch training.". Written in Python. Explain what it does, its main use cases, key features, and who would benefit from using it.
Question is copied to clipboard — paste it after the AI opens.
Clone via HTTPS
Clone via SSH
Download ZIP
Download master.zipReport bugs or request features on the pytorch-lora-from-scratch issue tracker:
Open GitHub Issues