| **Welcome to my pilot project!** This initiative is designed to explore and evaluate the capabilities of the local Llama 3 model in understanding and providing information about Wandsworth Council, specifically focusing on council tax queries. This application leverages the RAG framework and Prompt Engineering to handle question and answer tasks, similar to the recent [GOV.UK Chat](https://insidegovuk.blog.gov.uk/2024/01/18/the-findings-of-our-first-generative-ai-experiment-gov-uk-chat/) experiment. | |
| ### What is the Llama 3 8B Model? | |
| The Llama 3 model is an advanced language model engineered to comprehend and generate human-like text. This model is part of the latest generation of AI, trained on a diverse dataset, enabling it to deliver accurate and insightful responses to a broad spectrum of questions. | |
| ### How Does It Work? | |
| **Ask a Question:** Users can input their questions regarding Wandsworth Council's council tax in the "Ask a Question" tab. The Llama 3 model will process the query and generate a relevant response based on its extensive training data. | |
| **View Q&A History:** All user queries and corresponding answers are stored in a database, allowing us to analyze the model's performance over time. Users can view the history of questions and answers in the "View Q&A History" tab. Please DO NO personal identifiable information (PII). Please just make up a name if you want to include it into your queries. | |
| ### Objectives | |
| The primary goal of this pilot project is to assess the Llama 3 model’s effectiveness in handling queries emails related to local government information, with a specific focus on council tax this time. (can be expanded by router system later). | |
| By collecting and analyzing user queries, we aim to: | |
| - Identify strengths and weaknesses in the model’s responses. | |
| - Improve the model’s accuracy and reliability in providing information about council tax services. | |
| - Explore the potential of LLMs in enhancing the efficiency local government communications and citizen engagement. | |
| ### Pilot Program and User Participation | |
| This project is inspired by the GOV.UK Chat experiment, where the use of generative AI in government communication was tested. Similarly, we encourage users to ask diverse and challenging questions to push the boundaries of the Llama 3 model’s knowledge and understanding. Your participation and feedback are crucial for the success of this program. | |
| ### Future Plan | |
| - A "like" and "dislike" feature will be added soon to capture user satisfaction directly. | |
| - A Router system will be leveraged. So that more branches other than council tax can be added. | |
| ### Data Review and Scientific Analysis | |
| All responses are recorded in an SQLite database, allowing for scientific review and analysis of the model's performance. This approach ensures that we can systematically assess and improve the model over time. It is open for anyone to view in the 3rd tab. | |
| Thank you for participating in this exciting journey to explore the capabilities of advanced language models in serving local communities and enhancing public sector communications! | |
| By Lorentz Yeung | |
| Data Scientist | |
| **Last Update: 23rd June 2024** | |