Svngoku commited on
Commit
40deac7
1 Parent(s): 60a6208

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +32 -0
README.md CHANGED
@@ -185,6 +185,38 @@ Habari!<|eot_id|><|start_header_id|>assistant<|end_header_id|>
185
  Habari yako? Je, unatafuta ushauri au maelezo kuhusu jambo maalum? Ni furaha yangu kusaidia.<|eot_id|>
186
  ```
187
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
188
  This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
189
 
190
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
185
  Habari yako? Je, unatafuta ushauri au maelezo kuhusu jambo maalum? Ni furaha yangu kusaidia.<|eot_id|>
186
  ```
187
 
188
+
189
+ ## Inference with Unsloth Chat (`new`)
190
+
191
+ - Run our code in a `T4` and try the model.
192
+
193
+ ```sh
194
+ #@title ↙️ Press ▶ to start 🦥 Unsloth Studio Chat for Gemma-2 2b Instruct
195
+
196
+ # Unsloth Studio
197
+ # Copyright (C) 2024-present the Unsloth AI team. All rights reserved.
198
+
199
+ # This program is free software: you can redistribute it and/or modify
200
+ # it under the terms of the GNU Affero General Public License as published
201
+ # by the Free Software Foundation, either version 3 of the License, or
202
+ # (at your option) any later version.
203
+
204
+ # This program is distributed in the hope that it will be useful,
205
+ # but WITHOUT ANY WARRANTY; without even the implied warranty of
206
+ # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
207
+ # GNU Affero General Public License for more details.
208
+
209
+ # You should have received a copy of the GNU Affero General Public License
210
+ # along with this program. If not, see <https://www.gnu.org/licenses/>.
211
+ !git clone https://github.com/unslothai/studio > /dev/null 2>&1
212
+ with open("studio/unsloth_studio/chat.py", "r") as chat_module:
213
+ code = chat_module.read().replace(
214
+ 'MODEL_NAME = "vutuka/Llama-3.1-8B-Instruct-African-Ultrachat"',
215
+ 'MODEL_NAME = "unsloth/gemma-2-2b-it-bnb-4bit"',
216
+ )
217
+ exec(code)
218
+ ```
219
+
220
  This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
221
 
222
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)