lixinhao commited on
Commit
c094972
1 Parent(s): ffdf0ea

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +39 -3
README.md CHANGED
@@ -1,3 +1,39 @@
1
- ---
2
- license: cc-by-4.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-4.0
3
+ ---
4
+ # ZeroI2V: Zero-Cost Adaptation of Pre-trained Transformers from Image to Video(ECCV2024)
5
+
6
+ This repo is the official model checkpoints of ["ZeroI2V: Zero-Cost Adaptation of Pre-trained Transformers from Image to Video"](https://arxiv.org/abs/2310.01324)(ECCV2024)
7
+
8
+
9
+ ## Models
10
+
11
+ We provide the checkpoints before reparameterization, you could reparameter the weight refer to `tools\weight_reparam.py` in our [codes](https://github.com/MCG-NJU/ZeroI2V/blob/main/tools/weight_reparam.py).
12
+ ### Kinetics 400
13
+
14
+ | Backbone | Pretrain | GFLOPs | Param | New Param (M) | acc@1 | Views
15
+ | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
16
+ | ViT-B/16 | CLIP | 422 | 86 | 0 | 83.0 | 8x1x3 |
17
+ | ViT-L/14 | CLIP | 1946 | 304 | 0 | 86.3 | 8x1x3 |
18
+ | ViT-L/14 | CLIP | 7783 | 304 | 0 | 87.2 | 32x1x3 |
19
+
20
+ ### Something Something V2
21
+
22
+ | Backbone | Pretrain | GFLOPs | Param | New Param (M) | acc@1 | Views |
23
+ | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
24
+ | ViT-L/14 | CLIP | 7783 | 304 | 0 | 72.2 | 32x3x1 |
25
+
26
+
27
+
28
+ If you find our work useful in your research, please cite:
29
+ ```
30
+ @article{li2023zeroi2v,
31
+ title={ZeroI2V: Zero-Cost Adaptation of Pre-trained Transformers from Image to Video},
32
+ author={Li, Xinhao and Zhu, Yuhan and Wang, Limin},
33
+ journal={arXiv preprint arXiv:2310.01324},
34
+ year={2023}
35
+ }
36
+ ```
37
+
38
+
39
+