denverbaumgartner commited on
Commit
cab3c07
1 Parent(s): 68dc2b1

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +41 -0
README.md ADDED
@@ -0,0 +1,41 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ pipeline_tag: text-generation
4
+ tags:
5
+ - code
6
+ ---
7
+
8
+ # Model Card for T5-3B/SynQL-KaggleDBQA/Run-02
9
+
10
+ Developed by: Semiotic Labs
11
+
12
+ Model type: [Text to SQL]
13
+
14
+ License: [Apache-2.0]
15
+
16
+ Finetuned from model: [google-t5/t5-3b]
17
+
18
+ Dataset used for finetuning: [semiotic/SynQL-KaggleDBQA]
19
+
20
+ ## Model Context
21
+
22
+ Example metadata can be found below, context represents the prompt that is presented to the model. Database schemas follow the encoding method proposed by [Shaw et al (2020)](https://arxiv.org/pdf/2010.12725).
23
+ ```
24
+ "query": "SELECT count(*) FROM singer",
25
+ "question": "How many singers do we have?",
26
+ "context": "How many singers do we have? | concert_singer | stadium : stadium_id, location, name, capacity, highest, lowest, average | singer : singer_id, name, country, song_name, song_release_year, age, is_male | concert : concert_id, concert_name, theme, stadium_id, year | singer_in_concert : concert_id, singer_id",
27
+ "db_id": "concert_singer",
28
+ ```
29
+ ## Model Results
30
+
31
+ Evaluation set: [KaggleDBQA/test]
32
+
33
+ Evaluation metrics: [Execution Accuracy]
34
+
35
+ | Model | Data | Run | Execution Accuracy |
36
+ |-------|------|-----|-------------------|
37
+ | T5-3B | semiotic/SynQL-KaggleDBQA | 00 | 0.3514 |
38
+ | T5-3B | semiotic/SynQL-KaggleDBQA | 01 | 0.3514 |
39
+ | T5-3B | semiotic/SynQL-KaggleDBQA | 02 | 0.3514 |
40
+
41
+