McGill-NLP
/

LLM2Vec-Llama-2-7b-chat-hf-mntp-supervised

Model card Files Files and versions Community

vaibhavad commited on Apr 10

Commit

7dc386a

•

1 Parent(s): 0a925d7

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -2524,6 +2524,7 @@ model-index:
 > LLM2Vec is a simple recipe to convert decoder-only LLMs into text encoders. It consists of 3 simple steps: 1) enabling bidirectional attention, 2) masked next token prediction, and 3) unsupervised contrastive learning. The model can be further fine-tuned to achieve state-of-the-art performance.
 - **Repository:** https://github.com/McGill-NLP/llm2vec
 ## Installation

 > LLM2Vec is a simple recipe to convert decoder-only LLMs into text encoders. It consists of 3 simple steps: 1) enabling bidirectional attention, 2) masked next token prediction, and 3) unsupervised contrastive learning. The model can be further fine-tuned to achieve state-of-the-art performance.
 - **Repository:** https://github.com/McGill-NLP/llm2vec
+- **Paper:** https://arxiv.org/abs/2404.05961
 ## Installation