Load_dataset for local CSV files
{'login': 'sstojanoska', 'id': 17052700, 'node_id': 'MDQ6VXNlcjE3MDUyNzAw', 'avatar_url': 'https://avatars.githubusercontent.com/u/17052700?v=4', 'gravatar_id': '', 'url': 'https://api.github.com/users/sstojanoska', 'html_url': 'https://github.com/sstojanoska', 'followers_url': 'https://api.github.com/users/sstojanoska/followers', 'following_url': 'https://api.github.com/users/sstojanoska/following{/other_user}', 'gists_url': 'https://api.github.com/users/sstojanoska/gists{/gist_id}', 'starred_url': 'https://api.github.com/users/sstojanoska/starred{/owner}{/repo}', 'subscriptions_url': 'https://api.github.com/users/sstojanoska/subscriptions', 'organizations_url': 'https://api.github.com/users/sstojanoska/orgs', 'repos_url': 'https://api.github.com/users/sstojanoska/repos', 'events_url': 'https://api.github.com/users/sstojanoska/events{/privacy}', 'received_events_url': 'https://api.github.com/users/sstojanoska/received_events', 'type': 'User', 'site_admin': False}
[{'id': 1935892857, 'node_id': 'MDU6TGFiZWwxOTM1ODkyODU3', 'url': 'https://api.github.com/repos/huggingface/datasets/labels/bug', 'name': 'bug', 'color': 'd73a4a', 'default': True, 'description': "Something isn't working"}]
[]
Hi,

this is not a standard CSV file (requires additional preprocessing) so I wouldn't label this as s bug. You could parse the examples with the regex module or the string API to extract the data, but the following approach is probably the easiest (once you load the data):
```python
import ast
# load the dataset and copy the features
def process(ex):
    return {"tokens": ast.literal_eval(ex["tokens"]), "labels": ast.literal_eval(ex["labels"])}
dataset = dataset.map(process, features=new_features)
```
 Hi,

Thanks for the reply.
I  have already used  ```ast.literal_eval``` to evaluate the string into list, but I was getting another error:
```
ArrowInvalid: Could not convert X with type str: tried to convert to int
```
Why this happens ? Should labels be mapped to their ids and use int instead of str ? Yes, just map the labels to their ids.
The method load_dataset fails to correctly load a dataset from csv. 

Moreover, I am working on a token-classification task ( POS tagging) , where each row in my CSV contains two columns each of them having a list of strings.
row example:
```tokens  |  labels
['I' , 'am', 'John']  |  ['PRON', 'AUX', 'PROPN' ] 
```
The method, loads each list as a string:  (i.g "['I' , 'am', 'John']").
To solve this issue, I copied the Datasets.Features, created Sequence types ( instead of Value)  and tried to cast the features type
```
new_features['tokens'] = Sequence(feature=Value(dtype='string', id=None))
new_features['labels'] = Sequence(feature=ClassLabel(num_classes=len(tag2idx), names=list(unique_tags)))
dataset = dataset.cast(new_features)
```
but I got the following error 
```
ArrowNotImplementedError: Unsupported cast from string to list using function cast_list
```
Moreover, I tried to set feature parameter in load_dataset method, to my new_features, but this fails as well.
How can this be solved ?
{'url': 'https://api.github.com/repos/huggingface/datasets/issues/2288/reactions', 'total_count': 0, '+1': 0, '-1': 0, 'laugh': 0, 'hooray': 0, 'confused': 0, 'heart': 0, 'rocket': 0, 'eyes': 0}