source_datasets:spider language:en license:cc-by-4.0 text-to-sql SQL spider validation eval spider-eval region:us
---
language:
- en
license:
- cc-by-4.0
source_datasets:
- spider
pretty_name: Spider Context Validation Schema Ranked
tags:
- text-to-sql
- SQL
- spider
- validation
- eval
- spider-eval
dataset_info:
  features:
    - name: index
      dtype: int32
    - name: db_id
      dtype: string
    - name: question
      dtype: string
    - name: db_info
      dtype: string
    - name: ground_truth
      dtype: string
---

# Dataset Card for Spider Context Validation

### Ranked Schema by ChatGPT

The database context used here is generated from ChatGPT after telling it to reorder the schema with the most relevant columns in the beginning of the db_info.

### Dataset Summary

Spider is a large-scale complex and cross-domain semantic parsing and text-to-SQL dataset annotated by 11 Yale students
The goal of the Spider challenge is to develop natural language interfaces to cross-domain databases.

This dataset was created to validate spider-fine-tuned LLMs with database context.

### Yale Lily Spider Leaderboards

The leaderboard can be seen at https://yale-lily.github.io/spider

### Languages

The text in the dataset is in English.

### Licensing Information

The spider dataset is licensed under 
the [CC BY-SA 4.0](https://creativecommons.org/licenses/by-sa/4.0/legalcode)

### Citation
```
@article{yu2018spider,
  title={Spider: A large-scale human-labeled dataset for complex and cross-domain semantic parsing and text-to-sql task},
  author={Yu, Tao and Zhang, Rui and Yang, Kai and Yasunaga, Michihiro and Wang, Dongxu and Li, Zifan and Ma, James and Li, Irene and Yao, Qingning and Roman, Shanelle and others},
  journal={arXiv preprint arXiv:1809.08887},
  year={2018}
}
```