|
--- |
|
license: cc-by-sa-4.0 |
|
base_model: |
|
- codellama/CodeLlama-7b-Instruct-hf |
|
tags: |
|
- text-generation-inference |
|
--- |
|
|
|
# Update notice |
|
The model weights were updated at 8 AM UTC on Sep 12, 2024. |
|
|
|
# Model Card for DR-TEXT2SQL-CodeLlama2-7B-Chinese-240913 |
|
A capable large language model for natural language to SQL generation. |
|
|
|
# Language |
|
|
|
Chinese |
|
|
|
## Model Details |
|
### Model Description |
|
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated. |
|
|
|
Developed by: eglym |
|
Model type: [Text to SQL] |
|
License: [CC-by-SA-4.0] |
|
Finetuned from model: [CodeLlama-7B] |
|
|
|
Uses |
|
This model is intended to be used by non-technical users to understand data inside their SQL databases. It is meant as an analytics tool, and not as a database admin tool. |
|
|
|
This model has not been trained to reject malicious requests from users with write access to databases, and should only be used by users with read-only access. |
|
|
|
How to Get Started with the Model |
|
Use the code here to get started with the model. |
|
|
|
Prompt |
|
Please use the following prompt for optimal results. Please remember to use do_sample=False and num_beams=4 for optimal results. |
|
|
|
### Task |
|
Generate a SQL query to answer user_question. |
|
### Answer |
|
Given the database schema, here is the SQL query that realize user_question. |
|
|
|
Evaluation |
|
This model was evaluated on SQL-Eval, a PostgreSQL based evaluation framework developed by Defog for testing and alignment of model capabilities. |
|
|
|
You can read more about the methodology behind SQLEval here. |
|
|
|
Results |
|
We classified each generated question into one of 6 categories. The table displays the percentage of questions answered correctly by each model, broken down by category. |
|
```bash |
|
easy medium hard extra all |
|
count 250 440 174 170 1034 |
|
compare etype exec |
|
===================== EXECUTION ACCURACY ===================== |
|
execution 0.756 0.602 0.477 0.265 0.563 |
|
``` |
