license:mit region:us
---
license: mit
---
# FACETS Datasets

Datasets described in the paper: 

> Toward a Realistic Benchmark for Out-of-Distribution - Pietro Recalcati, Fabio Garcea, Luca Piano, Fabrizio Lamberti, Lia Morra 

## Baseline

|                          | ID classes | OOD classes | ID samples | OOD samples |
|--------------------------|------------|-------------|------------|-------------|
| **Places365-Standard (val)** | 365        | 0           | 18,250     | 0           |
| **SVHN (train)**          | 0          | 1           | 0          | 16,701      |
| **SVHN (test)**           | 0          | 1           | 0          | 1,549       |
| **Total**                 | **365**        | **2**           | **18,250**     | **18,250**      |

## Inter-Dataset

|                          | ID classes   | OOD classes  | ID samples      | OOD samples     |
|--------------------------|--------------|--------------|-----------------|-----------------|
| Places365-Standard (val) | 365          | 0            | 18,250          | 0               |
| ImageNet (train)         | 0            | 968          | 0               | 18,108          |
| **Total**           | **365** | **968** | **18,250** | **18,108** |

## WordNet ImageNet

| WordNet ImageNet T40 (val/test)    | ID classes   | OOD classes  | ID samples      | OOD samples     |
|------------------------------------|--------------|--------------|-----------------|-----------------|
| Places365-Standard (val)           | 365          | 0            | 18,250          | 0               |
| ImageNet (train)                   | 56           | 944          | 2,800           | 21,332          |
| **Total**                          | **421** | **944** | **21,050** | **21,332** |
| **WordNet ImageNet T45 (val/test)** | ID classes   | OOD classes  | ID samples      | OOD samples     |
| Places365-Standard (val)           | 365          | 0            | 18,250          | 0               |
| ImageNet (train)                   | 90           | 910          | 4,500           | 22,750          |
| **Total**                          | **455** | **910** | **22,750** | **22,750** |
| **WordNet ImageNet T50 (val/test)**    | ID classes   | OOD classes  | ID samples      | OOD samples     |
| Places365-Standard (val)           | 365          | 0            | 18,250          | 0               |
| ImageNet (train)                   | 140          | 860          | 7,000           | 25,560          |
| **Total**                          | **505** | **860** | **25,250** | **25,560** |

## FACETS OOD Detection

| **FACETS OOD Detection T1** | ID classes     | OOD classes    | ID samples      | OOD samples     |
|-----------------------------|----------------|----------------|-----------------|-----------------|
| Places365-Standard (val)    | 365            | 0              | 18,250          | 0               |
| SUN397                      | 319            | 78             | 46,851          | 7,530           |
| ImageNet (train)            | 0              | 644            | 0               | 50,232          |
| **Total**                   | **1,040** | **1,366** | **74,001** | **73,862** |
| **FACETS OOD Detection T2** | ID classes     | OOD classes    | ID samples      | OOD samples     |
| Places365-Standard (val)    | 365            | 0              | 18,250          | 0               |
| SUN397                      | 351            | 46             | 49,827          | 4,554           |
| ImageNet (train)            | 0              | 644            | 0               | 56,606          |
| **Total**                   | **1,072** | **1,334** | **76,977** | **77,260** |
