Hugging Face's logo

Spaces:
JDWebProgrammer
/
chatbot
Runtime error

App Files Community
1
chatbot
File size: 2,897 Bytes 
be97644
 
 
 
 
 
 
 
 
476591f
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
be97644
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
 
---
title: ChatBot
sdk: gradio
emoji: 🐢
colorFrom: indigo
colorTo: purple
pinned: true
---


# ChatBot
Basic ChatBot using CTransformers, ChromaDB and Gradio. Configured for CPU.
- See a live demo on HuggingFace at:
- https://huggingface.co/spaces/JDWebProgrammer/chatbot

![ChatBot](./assets/chatbot.png "ChatBot")

# Experimental
Please note that AI is still in experimental stages with known problems such as bias, misinformation and leaking sensitive information. We cannot guarantee the accuracy, completeness, or timeliness of the information provided. We do not assume any responsibility or liability for the use or interpretation of this project.

While we are committed to delivering a valuable user experience, please keep in mind that this AI service operates using advanced algorithms and machine learning techniques, which may occasionally generate results that differ from your expectations or contain errors. If you encounter any inconsistencies or issues, we encourage you to contact us for assistance.

We appreciate your understanding as we continually strive to enhance and improve our AI services. Your feedback is valuable in helping us achieve that goal.

# Description
This is a simple ChatBot to use as a simple starting template. Just add text files into the "./data/reference" folder 
![ChatBot Logic](./assets/logic.png "ChatBot Logic")

# Features
- Full custom RAG implementation
- Copy text files into ./data/reference for embedding
- Auto save chat logs
- Auto download and run open source LLM's locally
- Currently using the awesome combined works of Mistral AI's LLM base model trained with 128k context window by NousResearch and quantized to 4bits for fast speed by TheBloke

# Step 1: Install Dependencies
First make sure you have python and pip installed. Then open a terminal and type:
```shell
pip install -r requirements.txt
```


# Step 2: Add Embeddings [Optional]
Place text files in "./data/reference" to enhance the chatbot with extra information

# Step 3: Run Chatbot
Open a terminal and type:
```shell
python app.py
```

The web interface will start at http://0.0.0.0:7864

# Progress & Updates
- Embeddings properly save & persist, full custom RAG implementation working

# Known Issues
- Chat history may not be saving properly! Working on this..
- There is currently no feedback but will save feedback logs

# Future Plans
- Will be implementing auto retrieval from wiki for RAG(Retrieval Augmented Generation) loop
- Feedback datasets will be used in the trainable project coming soon
- Still working on instructional syntax which could be causing impaired results

# Credits
- Mistral: https://mistral.ai/
- HuggingFace: https://huggingface.co/
- TheBloke: https://huggingface.co/TheBloke
- ctransformers: https://github.com/marella/ctransformers
- gradio: https://github.com/gradio-app/gradio
- chroma: https://github.com/chroma-core/chroma