dora
commited on
Commit
•
e5cb7bb
1
Parent(s):
2fda730
fix MODELS env (#663)
Browse files
README.md
CHANGED
@@ -288,7 +288,7 @@ If you want to run chat-ui with llama.cpp, you can do the following, using Zephy
|
|
288 |
3. Add the following to your `.env.local`:
|
289 |
|
290 |
```env
|
291 |
-
MODELS
|
292 |
{
|
293 |
"name": "Local Zephyr",
|
294 |
"chatPromptTemplate": "<|system|>\n{{preprompt}}</s>\n{{#each messages}}{{#ifUser}}<|user|>\n{{content}}</s>\n<|assistant|>\n{{/ifUser}}{{#ifAssistant}}{{content}}</s>\n{{/ifAssistant}}{{/each}}",
|
@@ -308,7 +308,7 @@ MODELS=[
|
|
308 |
}
|
309 |
]
|
310 |
}
|
311 |
-
]
|
312 |
```
|
313 |
|
314 |
Start chat-ui with `npm run dev` and you should be able to chat with Zephyr locally.
|
@@ -324,7 +324,7 @@ ollama run mistral
|
|
324 |
Then specify the endpoints like so:
|
325 |
|
326 |
```env
|
327 |
-
MODELS
|
328 |
{
|
329 |
"name": "Ollama Mistral",
|
330 |
"chatPromptTemplate": "<s>{{#each messages}}{{#ifUser}}[INST] {{#if @first}}{{#if @root.preprompt}}{{@root.preprompt}}\n{{/if}}{{/if}} {{content}} [/INST]{{/ifUser}}{{#ifAssistant}}{{content}}</s> {{/ifAssistant}}{{/each}}",
|
@@ -345,7 +345,7 @@ MODELS=[
|
|
345 |
}
|
346 |
]
|
347 |
}
|
348 |
-
]
|
349 |
```
|
350 |
|
351 |
#### Amazon
|
|
|
288 |
3. Add the following to your `.env.local`:
|
289 |
|
290 |
```env
|
291 |
+
MODELS=`[
|
292 |
{
|
293 |
"name": "Local Zephyr",
|
294 |
"chatPromptTemplate": "<|system|>\n{{preprompt}}</s>\n{{#each messages}}{{#ifUser}}<|user|>\n{{content}}</s>\n<|assistant|>\n{{/ifUser}}{{#ifAssistant}}{{content}}</s>\n{{/ifAssistant}}{{/each}}",
|
|
|
308 |
}
|
309 |
]
|
310 |
}
|
311 |
+
]`
|
312 |
```
|
313 |
|
314 |
Start chat-ui with `npm run dev` and you should be able to chat with Zephyr locally.
|
|
|
324 |
Then specify the endpoints like so:
|
325 |
|
326 |
```env
|
327 |
+
MODELS=`[
|
328 |
{
|
329 |
"name": "Ollama Mistral",
|
330 |
"chatPromptTemplate": "<s>{{#each messages}}{{#ifUser}}[INST] {{#if @first}}{{#if @root.preprompt}}{{@root.preprompt}}\n{{/if}}{{/if}} {{content}} [/INST]{{/ifUser}}{{#ifAssistant}}{{content}}</s> {{/ifAssistant}}{{/each}}",
|
|
|
345 |
}
|
346 |
]
|
347 |
}
|
348 |
+
]`
|
349 |
```
|
350 |
|
351 |
#### Amazon
|