Vector-based Random Matrix Adaptation for personalizing LanguageModels
Introducing the Vector-based Random Matrix Adaptation (VeRA) method:
Efficient personalization is the key to next-generation AI. But finetuning large language models for each user is painfully inefficient today - methods like LoRA still demand prohibitive resources. This… pic.twitter.com/7hEHPo8Caa