Update README.md (#6)
Browse files- Update README.md (d0a7c526799534f9734837d74c24f5cb8a6b452c)
Co-authored-by: Doron Adler <[email protected]>
README.md
CHANGED
|
@@ -82,10 +82,11 @@ If you have [FlashAttention](https://github.com/Dao-AILab/flash-attention) insta
|
|
| 82 |
model = AutoModelForCausalLM.from_pretrained('dicta-il/dictalm-7b-instruct', trust_remote_code=True, use_flash_attention=True)
|
| 83 |
```
|
| 84 |
|
| 85 |
-
## Colab notebook
|
| 86 |
-
You can try the model on a free tier google colab
|
|
|
|
|
|
|
| 87 |
|
| 88 |
-
![SCREEN-SHOT][screen-shot]
|
| 89 |
|
| 90 |
## Citation
|
| 91 |
|
|
@@ -116,4 +117,5 @@ This work is licensed under a
|
|
| 116 |
[cc-by]: http://creativecommons.org/licenses/by/4.0/
|
| 117 |
[cc-by-image]: https://i.creativecommons.org/l/by/4.0/88x31.png
|
| 118 |
[cc-by-shield]: https://img.shields.io/badge/License-CC%20BY%204.0-lightgrey.svg
|
| 119 |
-
[screen-shot]: https://mitmachim.top/assets/uploads/files/1696309842384-36f732e3-d168-4f4c-8eaf-e78ec23e6bf6-image.png
|
|
|
|
|
|
| 82 |
model = AutoModelForCausalLM.from_pretrained('dicta-il/dictalm-7b-instruct', trust_remote_code=True, use_flash_attention=True)
|
| 83 |
```
|
| 84 |
|
| 85 |
+
## Colab notebook demos
|
| 86 |
+
You can try the model on a free tier google colab using the following notebooks:
|
| 87 |
+
* [Streamlit based](https://colab.research.google.com/drive/1hn23eA4m7ISW2e40DsAB6sbLRok4RKqS?usp=sharing) - you will need first to log in https://ngrok.com/ and get an authtoken, then paste it in the notebook ([screenshot][screen-shot-streamlit]).
|
| 88 |
+
* [Gradio based](https://gist.github.com/Norod/11997c0c9a330d0eeb9a6d4791b9aa2f) - uses deep speed for faster inference, text streamer to get the results as they are being generated and the UI is a widget embedded in the notebook ([screenshot][screen-shot-gradio]).
|
| 89 |
|
|
|
|
| 90 |
|
| 91 |
## Citation
|
| 92 |
|
|
|
|
| 117 |
[cc-by]: http://creativecommons.org/licenses/by/4.0/
|
| 118 |
[cc-by-image]: https://i.creativecommons.org/l/by/4.0/88x31.png
|
| 119 |
[cc-by-shield]: https://img.shields.io/badge/License-CC%20BY%204.0-lightgrey.svg
|
| 120 |
+
[screen-shot-streamlit]: https://mitmachim.top/assets/uploads/files/1696309842384-36f732e3-d168-4f4c-8eaf-e78ec23e6bf6-image.png
|
| 121 |
+
[screen-shot-gradio]: https://scontent.ftlv2-1.fna.fbcdn.net/v/t39.30808-6/384119874_10160090112344007_6111524432595263230_n.jpg?_nc_cat=111&ccb=1-7&_nc_sid=5f2048&_nc_ohc=tWYAm8uz7T4AX9DNlRD&_nc_ht=scontent.ftlv2-1.fna&cb_e2o_trans=t&oh=00_AfBocAujdLaWJqYWrNGtgdz99Cdz8JEqO_ez70SXqlf_2Q&oe=654D476D
|