Update README.md
Browse files
README.md
CHANGED
@@ -185,6 +185,38 @@ Habari!<|eot_id|><|start_header_id|>assistant<|end_header_id|>
|
|
185 |
Habari yako? Je, unatafuta ushauri au maelezo kuhusu jambo maalum? Ni furaha yangu kusaidia.<|eot_id|>
|
186 |
```
|
187 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
188 |
This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
|
189 |
|
190 |
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|
|
|
185 |
Habari yako? Je, unatafuta ushauri au maelezo kuhusu jambo maalum? Ni furaha yangu kusaidia.<|eot_id|>
|
186 |
```
|
187 |
|
188 |
+
|
189 |
+
## Inference with Unsloth Chat (`new`)
|
190 |
+
|
191 |
+
- Run our code in a `T4` and try the model.
|
192 |
+
|
193 |
+
```sh
|
194 |
+
#@title ↙️ Press ▶ to start 🦥 Unsloth Studio Chat for Gemma-2 2b Instruct
|
195 |
+
|
196 |
+
# Unsloth Studio
|
197 |
+
# Copyright (C) 2024-present the Unsloth AI team. All rights reserved.
|
198 |
+
|
199 |
+
# This program is free software: you can redistribute it and/or modify
|
200 |
+
# it under the terms of the GNU Affero General Public License as published
|
201 |
+
# by the Free Software Foundation, either version 3 of the License, or
|
202 |
+
# (at your option) any later version.
|
203 |
+
|
204 |
+
# This program is distributed in the hope that it will be useful,
|
205 |
+
# but WITHOUT ANY WARRANTY; without even the implied warranty of
|
206 |
+
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
|
207 |
+
# GNU Affero General Public License for more details.
|
208 |
+
|
209 |
+
# You should have received a copy of the GNU Affero General Public License
|
210 |
+
# along with this program. If not, see <https://www.gnu.org/licenses/>.
|
211 |
+
!git clone https://github.com/unslothai/studio > /dev/null 2>&1
|
212 |
+
with open("studio/unsloth_studio/chat.py", "r") as chat_module:
|
213 |
+
code = chat_module.read().replace(
|
214 |
+
'MODEL_NAME = "vutuka/Llama-3.1-8B-Instruct-African-Ultrachat"',
|
215 |
+
'MODEL_NAME = "unsloth/gemma-2-2b-it-bnb-4bit"',
|
216 |
+
)
|
217 |
+
exec(code)
|
218 |
+
```
|
219 |
+
|
220 |
This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
|
221 |
|
222 |
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|