marcelbinz commited on
Commit
fe0f063
1 Parent(s): 9f0e6b7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -3
README.md CHANGED
@@ -20,7 +20,7 @@ Llama-3.1-Centaur-70B is a foundation model of cognition model that can predict
20
 
21
  Note that Centaur is trained on a data set in which human choices are encapsulated by "<<" and ">>" tokens. For optimal performance, it is recommended to adjust prompts accordingly.
22
 
23
- This is the low-rank adapter that runs with unsloth on a single 80GB GPU.
24
 
25
  ```python
26
  from unsloth import FastLanguageModel
@@ -32,9 +32,13 @@ model, tokenizer = FastLanguageModel.from_pretrained(
32
  dtype = None,
33
  load_in_4bit = True,
34
  )
 
 
35
  ```
36
 
37
- Alternatively, you can also directly use the (untested) [merged model](https://huggingface.co/marcelbinz/Llama-3.1-Centaur-70B).
 
 
38
 
39
 
40
  ### Licensing Information
@@ -43,6 +47,16 @@ Alternatively, you can also directly use the (untested) [merged model](https:/
43
 
44
  ### Citation Information
45
 
46
- Forthcoming.
 
 
 
 
 
 
 
 
 
 
47
 
48
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
20
 
21
  Note that Centaur is trained on a data set in which human choices are encapsulated by "<<" and ">>" tokens. For optimal performance, it is recommended to adjust prompts accordingly.
22
 
23
+ The recommended usage is by loading the low-rank adapter using unsloth:
24
 
25
  ```python
26
  from unsloth import FastLanguageModel
 
32
  dtype = None,
33
  load_in_4bit = True,
34
  )
35
+
36
+ FastLanguageModel.for_inference(model)
37
  ```
38
 
39
+ This requires 80 GB GPU memory.
40
+
41
+ You can alternatively also directly use the less-tested [merged model](https://huggingface.co/marcelbinz/Llama-3.1-Centaur-70B).
42
 
43
 
44
  ### Licensing Information
 
47
 
48
  ### Citation Information
49
 
50
+ ```
51
+ @misc{binz2024centaurfoundationmodelhuman,
52
+ title={Centaur: a foundation model of human cognition},
53
+ author={Marcel Binz and Elif Akata and Matthias Bethge and Franziska Brändle and Fred Callaway and Julian Coda-Forno and Peter Dayan and Can Demircan and Maria K. Eckstein and Noémi Éltető and Thomas L. Griffiths and Susanne Haridi and Akshay K. Jagadish and Li Ji-An and Alexander Kipnis and Sreejan Kumar and Tobias Ludwig and Marvin Mathony and Marcelo Mattar and Alireza Modirshanechi and Surabhi S. Nath and Joshua C. Peterson and Milena Rmus and Evan M. Russek and Tankred Saanum and Natalia Scharfenberg and Johannes A. Schubert and Luca M. Schulze Buschoff and Nishad Singhi and Xin Sui and Mirko Thalmann and Fabian Theis and Vuong Truong and Vishaal Udandarao and Konstantinos Voudouris and Robert Wilson and Kristin Witte and Shuchen Wu and Dirk Wulff and Huadong Xiong and Eric Schulz},
54
+ year={2024},
55
+ eprint={2410.20268},
56
+ archivePrefix={arXiv},
57
+ primaryClass={cs.LG},
58
+ url={https://arxiv.org/abs/2410.20268},
59
+ }
60
+ ```
61
 
62
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)