Update README.md
Browse files
README.md
CHANGED
@@ -20,49 +20,50 @@ These weights are directly usable in OpenCLIP (image + text).
|
|
20 |
- Data Filtering Networks: https://arxiv.org/abs/2309.17425
|
21 |
- **Samples Seen:** 39B (224 x 224) + 5B (384 x 384)
|
22 |
## Model Metrics
|
23 |
-
|
24 |
| dataset | metric |
|
25 |
|:-----------------------|---------:|
|
26 |
-
| ImageNet 1k | 0.
|
27 |
-
| Caltech-101 | 0.
|
28 |
| CIFAR-10 | 0.9879 |
|
29 |
| CIFAR-100 | 0.9041 |
|
30 |
-
| CLEVR Counts | 0.
|
31 |
-
| CLEVR Distance | 0.
|
32 |
-
| Country211 | 0.
|
33 |
-
| Describable Textures | 0.
|
34 |
| EuroSAT | 0.608333 |
|
35 |
-
| FGVC Aircraft | 0.
|
36 |
-
| Food-101 | 0.
|
37 |
-
| GTSRB | 0.
|
38 |
-
| ImageNet Sketch | 0.
|
39 |
-
| ImageNet v2 | 0.
|
40 |
-
| ImageNet-A | 0.
|
41 |
-
| ImageNet-O | 0.
|
42 |
-
| ImageNet-R | 0.
|
43 |
-
| KITTI Vehicle Distance | 0.
|
44 |
| MNIST | 0.8372 |
|
45 |
-
| ObjectNet | 0.796867 |
|
46 |
-
| Oxford Flowers-102 | 0.
|
47 |
-
| Oxford-IIIT Pet | 0.
|
48 |
-
| Pascal VOC 2007 | 0.
|
49 |
| PatchCamelyon | 0.695953 |
|
50 |
| Rendered SST2 | 0.566722 |
|
51 |
| RESISC45 | 0.755079 |
|
52 |
-
| Stanford Cars | 0.
|
53 |
| STL-10 | 0.991125 |
|
54 |
-
| SUN397 | 0.
|
55 |
| SVHN | 0.671251 |
|
56 |
| Flickr | 0.8808 |
|
57 |
-
| MSCOCO | 0.
|
58 |
| WinoGAViL | 0.571813 |
|
59 |
-
| iWildCam | 0.
|
60 |
| Camelyon17 | 0.711536 |
|
61 |
| FMoW | 0.209024 |
|
62 |
-
| Dollar Street | 0.
|
63 |
-
| GeoDE | 0.
|
64 |
-
| **Average** | **0.
|
|
|
65 |
|
|
|
66 |
## Model Usage
|
67 |
### With OpenCLIP
|
68 |
```
|
|
|
20 |
- Data Filtering Networks: https://arxiv.org/abs/2309.17425
|
21 |
- **Samples Seen:** 39B (224 x 224) + 5B (384 x 384)
|
22 |
## Model Metrics
|
|
|
23 |
| dataset | metric |
|
24 |
|:-----------------------|---------:|
|
25 |
+
| ImageNet 1k | 0.84218 |
|
26 |
+
| Caltech-101 | 0.954479 |
|
27 |
| CIFAR-10 | 0.9879 |
|
28 |
| CIFAR-100 | 0.9041 |
|
29 |
+
| CLEVR Counts | 0.362467 |
|
30 |
+
| CLEVR Distance | 0.206067 |
|
31 |
+
| Country211 | 0.37673 |
|
32 |
+
| Describable Textures | 0.71383 |
|
33 |
| EuroSAT | 0.608333 |
|
34 |
+
| FGVC Aircraft | 0.719938 |
|
35 |
+
| Food-101 | 0.963129 |
|
36 |
+
| GTSRB | 0.679018 |
|
37 |
+
| ImageNet Sketch | 0.73338 |
|
38 |
+
| ImageNet v2 | 0.7837 |
|
39 |
+
| ImageNet-A | 0.7992 |
|
40 |
+
| ImageNet-O | 0.3785 |
|
41 |
+
| ImageNet-R | 0.937633 |
|
42 |
+
| KITTI Vehicle Distance | 0.38256 |
|
43 |
| MNIST | 0.8372 |
|
44 |
+
| ObjectNet[^1] | 0.796867 |
|
45 |
+
| Oxford Flowers-102 | 0.896834 |
|
46 |
+
| Oxford-IIIT Pet | 0.966841 |
|
47 |
+
| Pascal VOC 2007 | 0.826255 |
|
48 |
| PatchCamelyon | 0.695953 |
|
49 |
| Rendered SST2 | 0.566722 |
|
50 |
| RESISC45 | 0.755079 |
|
51 |
+
| Stanford Cars | 0.959955 |
|
52 |
| STL-10 | 0.991125 |
|
53 |
+
| SUN397 | 0.772799 |
|
54 |
| SVHN | 0.671251 |
|
55 |
| Flickr | 0.8808 |
|
56 |
+
| MSCOCO | 0.636889 |
|
57 |
| WinoGAViL | 0.571813 |
|
58 |
+
| iWildCam | 0.224911 |
|
59 |
| Camelyon17 | 0.711536 |
|
60 |
| FMoW | 0.209024 |
|
61 |
+
| Dollar Street | 0.71729 |
|
62 |
+
| GeoDE | 0.935699 |
|
63 |
+
| **Average** | **0.709421** |
|
64 |
+
|
65 |
|
66 |
+
[^1]: Center-crop pre-processing used for ObjectNet (squashing results in 6pp lower accuracy)
|
67 |
## Model Usage
|
68 |
### With OpenCLIP
|
69 |
```
|