Using `set_format(type='torch', columns=columns)` makes Array2D/3D columns stop formatting correctly
{'login': 'plamb-viso', 'id': 99206017, 'node_id': 'U_kgDOBenDgQ', 'avatar_url': 'https://avatars.githubusercontent.com/u/99206017?v=4', 'gravatar_id': '', 'url': 'https://api.github.com/users/plamb-viso', 'html_url': 'https://github.com/plamb-viso', 'followers_url': 'https://api.github.com/users/plamb-viso/followers', 'following_url': 'https://api.github.com/users/plamb-viso/following{/other_user}', 'gists_url': 'https://api.github.com/users/plamb-viso/gists{/gist_id}', 'starred_url': 'https://api.github.com/users/plamb-viso/starred{/owner}{/repo}', 'subscriptions_url': 'https://api.github.com/users/plamb-viso/subscriptions', 'organizations_url': 'https://api.github.com/users/plamb-viso/orgs', 'repos_url': 'https://api.github.com/users/plamb-viso/repos', 'events_url': 'https://api.github.com/users/plamb-viso/events{/privacy}', 'received_events_url': 'https://api.github.com/users/plamb-viso/received_events', 'type': 'User', 'site_admin': False}
[]
[]
In case others find this, the problem was not with set_format, but my usages of `to_pandas()` and `from_pandas()` which I was using during dataset splitting; somewhere in the chain of converting to and from pandas the `Array2D/Array3D` types get converted to series of `Sequence()` types
I have a Dataset with two Features defined as follows:

```
'image': Array3D(dtype="int64", shape=(3, 224, 224)),
'bbox': Array2D(dtype="int64", shape=(512, 4)),
```

On said dataset, if I `dataset.set_format(type='torch')` and then use the dataset in a dataloader, these columns are correctly cast to Tensors of (batch_size, 3, 224, 244) for example.

However, if I `dataset.set_format(type='torch', columns=['image', 'bbox'])` these columns are cast to Lists of tensors and miss the batch size completely (the 3 dimension is the list length).

I'm currently digging through datasets formatting code to try and find out why, but was curious if someone knew an immediate solution for this.
{'url': 'https://api.github.com/repos/huggingface/datasets/issues/5231/reactions', 'total_count': 0, '+1': 0, '-1': 0, 'laugh': 0, 'hooray': 0, 'confused': 0, 'heart': 0, 'rocket': 0, 'eyes': 0}