Loading GLUE dataset loads CoLA by default
{'login': 'zphang', 'id': 1668462, 'node_id': 'MDQ6VXNlcjE2Njg0NjI=', 'avatar_url': 'https://avatars.githubusercontent.com/u/1668462?v=4', 'gravatar_id': '', 'url': 'https://api.github.com/users/zphang', 'html_url': 'https://github.com/zphang', 'followers_url': 'https://api.github.com/users/zphang/followers', 'following_url': 'https://api.github.com/users/zphang/following{/other_user}', 'gists_url': 'https://api.github.com/users/zphang/gists{/gist_id}', 'starred_url': 'https://api.github.com/users/zphang/starred{/owner}{/repo}', 'subscriptions_url': 'https://api.github.com/users/zphang/subscriptions', 'organizations_url': 'https://api.github.com/users/zphang/orgs', 'repos_url': 'https://api.github.com/users/zphang/repos', 'events_url': 'https://api.github.com/users/zphang/events{/privacy}', 'received_events_url': 'https://api.github.com/users/zphang/received_events', 'type': 'User', 'site_admin': False}
[{'id': 2067388877, 'node_id': 'MDU6TGFiZWwyMDY3Mzg4ODc3', 'url': 'https://api.github.com/repos/huggingface/datasets/labels/dataset%20bug', 'name': 'dataset bug', 'color': '2edb81', 'default': False, 'description': 'A bug in a dataset script provided in the library'}]
[]
As a follow-up to this: It looks like the actual GLUE task name is supplied as the `name` argument. Is there a way to check what `name`s/sub-datasets are available under a grouping like GLUE? That information doesn't seem to be readily available in info from `nlp.list_datasets()`.

Edit: I found the info under `Glue.BUILDER_CONFIGS` Yes so the first config is loaded by default when no `name` is supplied but for GLUE this should probably throw an error indeed.

We can probably just add an `__init__` at the top of the `class Glue(nlp.GeneratorBasedBuilder)` in the `glue.py` script which does this check:
```
class Glue(nlp.GeneratorBasedBuilder):
    def __init__(self, *args, **kwargs):
        assert 'name' in kwargs and kwargs[name] is not None, "Glue has to be called with a configuration name"
        super(Glue, self).__init__(*args, **kwargs)
``` An error is raised if the sub-dataset is not specified :)
```
ValueError: Config name is missing.
Please pick one among the available configs: ['cola', 'sst2', 'mrpc', 'qqp', 'stsb', 'mnli', 'mnli_mismatched', 'mnli_matched', 'qnli', 'rte', 'wnli', 'ax']
Example of usage:
	`load_dataset('glue', 'cola')`
```
If I run:

```python
dataset = nlp.load_dataset('glue')
```
The resultant dataset seems to be CoLA be default, without throwing any error. This is in contrast to calling:

```python
metric = nlp.load_metric("glue")
```
which throws an error telling the user that they need to specify a task in GLUE. Should the same apply for loading datasets?
{'url': 'https://api.github.com/repos/huggingface/datasets/issues/130/reactions', 'total_count': 0, '+1': 0, '-1': 0, 'laugh': 0, 'hooray': 0, 'confused': 0, 'heart': 0, 'rocket': 0, 'eyes': 0}