Bowen232 commited on
Commit
7f859cb
1 Parent(s): 4385b31

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -19,7 +19,7 @@ We released all of our checkpoints used in [LoRA-Flow](https://aclanthology.org/
19
  # Summary
20
  > In this repo, we release LoRA and the gate of 7B models trained in our paper in HuggingFace format.
21
  # Introduction
22
- The following picture has shown our proposed method, we use layer-wise fusion gates to facilitate dynamic LoRA fusion, which project input hidden states of each layer into fusion weights.
23
  ![1.jpg](https://cdn-uploads.huggingface.co/production/uploads/64d99f6cd7e30889c6c477b4/ifiu1FTHilrmUkD4FKkgV.jpeg)
24
  # Citation
25
  if you find our repo is helpful, please cite the following
 
19
  # Summary
20
  > In this repo, we release LoRA and the gate of 7B models trained in our paper in HuggingFace format.
21
  # Introduction
22
+ LoRA-Flow provides an efficient way to fuse different LoRA modules which can outperform existing methods significantly. The following picture shows our proposed method, we use layer-wise fusion gates to facilitate dynamic LoRA fusion, which project input hidden states of each layer into fusion weights. For more details, please refer to our paper.
23
  ![1.jpg](https://cdn-uploads.huggingface.co/production/uploads/64d99f6cd7e30889c6c477b4/ifiu1FTHilrmUkD4FKkgV.jpeg)
24
  # Citation
25
  if you find our repo is helpful, please cite the following