Spaces:
Running
on
Zero
Running
on
Zero
DongfuJiang
commited on
Commit
•
c5c1fe7
1
Parent(s):
f4db150
Auto Daily Leaderboard udpate Fri Aug 16 12:00:22 PM EDT 2024
Browse files- arena_elo/results/20240816/clean_battle_t2i_generation.json +0 -0
- arena_elo/results/20240816/clean_battle_video_generation.json +0 -0
- arena_elo/results/20240816/elo_results_t2i_generation.pkl +3 -0
- arena_elo/results/20240816/elo_results_video_generation.pkl +3 -0
- arena_elo/results/20240816/t2i_generation_leaderboard.csv +14 -0
- arena_elo/results/20240816/video_generation_leaderboard.csv +9 -0
- arena_elo/results/latest/clean_battle_t2i_generation.json +176 -0
- arena_elo/results/latest/clean_battle_video_generation.json +280 -0
- arena_elo/results/latest/elo_results_t2i_generation.pkl +1 -1
- arena_elo/results/latest/elo_results_video_generation.pkl +1 -1
- arena_elo/results/latest/t2i_generation_leaderboard.csv +13 -13
- arena_elo/results/latest/video_generation_leaderboard.csv +8 -8
arena_elo/results/20240816/clean_battle_t2i_generation.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
arena_elo/results/20240816/clean_battle_video_generation.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
arena_elo/results/20240816/elo_results_t2i_generation.pkl
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:38986e25cfeb84a2881a48c90c0452e5621609c51b0478ed3c9eeedcd3fa14d8
|
3 |
+
size 73808
|
arena_elo/results/20240816/elo_results_video_generation.pkl
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a741e4702b6e8bfb6e4f99281442f35b951d536c69f95322c4595b497c5fa83b
|
3 |
+
size 59905
|
arena_elo/results/20240816/t2i_generation_leaderboard.csv
ADDED
@@ -0,0 +1,14 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
PlayGround V2.5,PlayGround V2.5,1151.5003889911254,1153.4694745022227,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
|
3 |
+
PlayGround V2,PlayGround V2,1092.2757564506146,1091.49511668867,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
|
4 |
+
HunyuanDiT,HunyuanDiT,1064.1993233690234,1049.4501647957088,tencent-hunyuan-community,Tencent,https://huggingface.co/Tencent-Hunyuan/HunyuanDiT
|
5 |
+
StableCascade,StableCascade,1056.2582682038956,1060.3493390345488,stable-cascade-nc-community (other),Stability AI,https://huggingface.co/stabilityai/stable-cascade
|
6 |
+
SDXLLightning,SDXLLightning,1042.1171870294593,1047.1781761521615,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
|
7 |
+
PixArtAlpha,PixArtAlpha,1040.2875132238112,1030.759804128689,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
|
8 |
+
PixArtSigma,PixArtSigma,1037.878752178197,1038.1867588798452,openrail++,PixArt-alpha,https://fal.ai/models/fal-ai/pixart-sigma
|
9 |
+
SD3,SD3,1018.2716109213237,1012.9764762907159,stabilityai-nc-research-community,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-3-medium
|
10 |
+
SDXL,SDXL,986.723355299696,987.0726906842126,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
|
11 |
+
SDXLTurbo,SDXLTurbo,929.9968811688445,928.0647936396172,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
|
12 |
+
LCM(v1.5/XL),LCM(v1.5/XL),924.8395908955157,919.0173216572904,openrail++,Latent Consistency,https://fal.ai/models/fal-ai/fast-lcm-diffusion/api
|
13 |
+
OpenJourney,OpenJourney,847.0217236457364,841.9706858280956,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
|
14 |
+
LCM,LCM,808.629648622764,822.6328041447692,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
|
arena_elo/results/20240816/video_generation_leaderboard.csv
ADDED
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
StableVideoDiffusion,StableVideoDiffusion,1128.5556341994472,1131.1226712368302,stable-video-diffusion-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
|
3 |
+
T2VTurbo,T2VTurbo,1104.2114319074628,1102.5509654047792,cc-by-nc-4.0,"University of California, Santa Barbara",https://huggingface.co/jiachenli-ucsb/T2V-Turbo-VC2
|
4 |
+
VideoCrafter2,VideoCrafter2,1076.4651982985179,1076.7711382593716,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
|
5 |
+
AnimateDiff,AnimateDiff,1067.3275823442182,1065.8895802273453,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
|
6 |
+
LaVie,LaVie,994.6797361277218,993.743578293222,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
|
7 |
+
OpenSora,OpenSora,912.9431526392987,912.6820481082565,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
8 |
+
ModelScope,ModelScope,863.3588113010672,864.6159871119833,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
|
9 |
+
AnimateDiffTurbo,AnimateDiffTurbo,852.4584531822653,852.6240313582127,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
|
arena_elo/results/latest/clean_battle_t2i_generation.json
CHANGED
@@ -51046,5 +51046,181 @@
|
|
51046 |
"judge": "arena_user_10.16.18.75",
|
51047 |
"anony": true,
|
51048 |
"tstamp": 1723694936.0013
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
51049 |
}
|
51050 |
]
|
|
|
51046 |
"judge": "arena_user_10.16.18.75",
|
51047 |
"anony": true,
|
51048 |
"tstamp": 1723694936.0013
|
51049 |
+
},
|
51050 |
+
{
|
51051 |
+
"model_a": "FluxTimestep",
|
51052 |
+
"model_b": "SDXLLightning",
|
51053 |
+
"winner": "model_b",
|
51054 |
+
"judge": "arena_user_10.16.18.75",
|
51055 |
+
"anony": true,
|
51056 |
+
"tstamp": 1723740305.0597
|
51057 |
+
},
|
51058 |
+
{
|
51059 |
+
"model_a": "Kolors",
|
51060 |
+
"model_b": "AuraFlow",
|
51061 |
+
"winner": "model_a",
|
51062 |
+
"judge": "arena_user_10.16.34.60",
|
51063 |
+
"anony": true,
|
51064 |
+
"tstamp": 1723745241.6975
|
51065 |
+
},
|
51066 |
+
{
|
51067 |
+
"model_a": "OpenJourney",
|
51068 |
+
"model_b": "PixArtSigma",
|
51069 |
+
"winner": "tie (bothbad)",
|
51070 |
+
"judge": "arena_user_10.16.18.162",
|
51071 |
+
"anony": true,
|
51072 |
+
"tstamp": 1723761103.0807
|
51073 |
+
},
|
51074 |
+
{
|
51075 |
+
"model_a": "AuraFlow",
|
51076 |
+
"model_b": "SD3",
|
51077 |
+
"winner": "model_a",
|
51078 |
+
"judge": "arena_user_10.16.18.75",
|
51079 |
+
"anony": true,
|
51080 |
+
"tstamp": 1723764843.3515
|
51081 |
+
},
|
51082 |
+
{
|
51083 |
+
"model_a": "FluxTimestep",
|
51084 |
+
"model_b": "SDXLTurbo",
|
51085 |
+
"winner": "model_b",
|
51086 |
+
"judge": "arena_user_10.16.18.75",
|
51087 |
+
"anony": true,
|
51088 |
+
"tstamp": 1723764855.5548
|
51089 |
+
},
|
51090 |
+
{
|
51091 |
+
"model_a": "FluxTimestep",
|
51092 |
+
"model_b": "PixArtSigma",
|
51093 |
+
"winner": "model_b",
|
51094 |
+
"judge": "arena_user_10.16.1.165",
|
51095 |
+
"anony": true,
|
51096 |
+
"tstamp": 1723764869.228
|
51097 |
+
},
|
51098 |
+
{
|
51099 |
+
"model_a": "StableCascade",
|
51100 |
+
"model_b": "OpenJourney",
|
51101 |
+
"winner": "model_a",
|
51102 |
+
"judge": "arena_user_10.16.1.165",
|
51103 |
+
"anony": true,
|
51104 |
+
"tstamp": 1723764889.9278
|
51105 |
+
},
|
51106 |
+
{
|
51107 |
+
"model_a": "FluxTimestep",
|
51108 |
+
"model_b": "SD3",
|
51109 |
+
"winner": "tie (bothbad)",
|
51110 |
+
"judge": "arena_user_10.16.18.75",
|
51111 |
+
"anony": true,
|
51112 |
+
"tstamp": 1723764929.3144
|
51113 |
+
},
|
51114 |
+
{
|
51115 |
+
"model_a": "SDXLTurbo",
|
51116 |
+
"model_b": "PlayGround V2.5",
|
51117 |
+
"winner": "model_b",
|
51118 |
+
"judge": "arena_user_10.16.18.75",
|
51119 |
+
"anony": true,
|
51120 |
+
"tstamp": 1723764943.1899
|
51121 |
+
},
|
51122 |
+
{
|
51123 |
+
"model_a": "SD3",
|
51124 |
+
"model_b": "PixArtSigma",
|
51125 |
+
"winner": "tie",
|
51126 |
+
"judge": "arena_user_10.16.1.165",
|
51127 |
+
"anony": true,
|
51128 |
+
"tstamp": 1723764960.3193
|
51129 |
+
},
|
51130 |
+
{
|
51131 |
+
"model_a": "Kolors",
|
51132 |
+
"model_b": "FluxTimestep",
|
51133 |
+
"winner": "tie",
|
51134 |
+
"judge": "arena_user_10.16.18.75",
|
51135 |
+
"anony": true,
|
51136 |
+
"tstamp": 1723764989.8441
|
51137 |
+
},
|
51138 |
+
{
|
51139 |
+
"model_a": "HunyuanDiT",
|
51140 |
+
"model_b": "PixArtSigma",
|
51141 |
+
"winner": "model_a",
|
51142 |
+
"judge": "arena_user_10.16.18.75",
|
51143 |
+
"anony": true,
|
51144 |
+
"tstamp": 1723764998.463
|
51145 |
+
},
|
51146 |
+
{
|
51147 |
+
"model_a": "SDXL",
|
51148 |
+
"model_b": "SDXLLightning",
|
51149 |
+
"winner": "model_b",
|
51150 |
+
"judge": "arena_user_10.16.1.165",
|
51151 |
+
"anony": true,
|
51152 |
+
"tstamp": 1723765010.4897
|
51153 |
+
},
|
51154 |
+
{
|
51155 |
+
"model_a": "Kolors",
|
51156 |
+
"model_b": "SDXLTurbo",
|
51157 |
+
"winner": "tie",
|
51158 |
+
"judge": "arena_user_10.16.1.165",
|
51159 |
+
"anony": true,
|
51160 |
+
"tstamp": 1723765025.5685
|
51161 |
+
},
|
51162 |
+
{
|
51163 |
+
"model_a": "PixArtAlpha",
|
51164 |
+
"model_b": "FluxTimestep",
|
51165 |
+
"winner": "model_a",
|
51166 |
+
"judge": "arena_user_10.16.18.162",
|
51167 |
+
"anony": true,
|
51168 |
+
"tstamp": 1723765040.0284
|
51169 |
+
},
|
51170 |
+
{
|
51171 |
+
"model_a": "SD3",
|
51172 |
+
"model_b": "SDXLLightning",
|
51173 |
+
"winner": "model_b",
|
51174 |
+
"judge": "arena_user_10.16.1.165",
|
51175 |
+
"anony": true,
|
51176 |
+
"tstamp": 1723765066.5704
|
51177 |
+
},
|
51178 |
+
{
|
51179 |
+
"model_a": "OpenJourney",
|
51180 |
+
"model_b": "AuraFlow",
|
51181 |
+
"winner": "model_b",
|
51182 |
+
"judge": "arena_user_10.16.34.60",
|
51183 |
+
"anony": true,
|
51184 |
+
"tstamp": 1723779401.1412
|
51185 |
+
},
|
51186 |
+
{
|
51187 |
+
"model_a": "PixArtAlpha",
|
51188 |
+
"model_b": "PlayGround V2.5",
|
51189 |
+
"winner": "model_b",
|
51190 |
+
"judge": "arena_user_10.16.34.60",
|
51191 |
+
"anony": true,
|
51192 |
+
"tstamp": 1723787634.5486
|
51193 |
+
},
|
51194 |
+
{
|
51195 |
+
"model_a": "FluxTimestep",
|
51196 |
+
"model_b": "SDXL",
|
51197 |
+
"winner": "model_a",
|
51198 |
+
"judge": "arena_user_10.16.1.165",
|
51199 |
+
"anony": true,
|
51200 |
+
"tstamp": 1723787653.1336
|
51201 |
+
},
|
51202 |
+
{
|
51203 |
+
"model_a": "StableCascade",
|
51204 |
+
"model_b": "OpenJourney",
|
51205 |
+
"winner": "tie (bothbad)",
|
51206 |
+
"judge": "arena_user_10.16.34.60",
|
51207 |
+
"anony": true,
|
51208 |
+
"tstamp": 1723787680.268
|
51209 |
+
},
|
51210 |
+
{
|
51211 |
+
"model_a": "SDXL",
|
51212 |
+
"model_b": "FluxTimestep",
|
51213 |
+
"winner": "model_b",
|
51214 |
+
"judge": "arena_user_10.16.34.60",
|
51215 |
+
"anony": true,
|
51216 |
+
"tstamp": 1723787701.4239
|
51217 |
+
},
|
51218 |
+
{
|
51219 |
+
"model_a": "PlayGround V2.5",
|
51220 |
+
"model_b": "OpenJourney",
|
51221 |
+
"winner": "model_a",
|
51222 |
+
"judge": "arena_user_10.16.34.60",
|
51223 |
+
"anony": true,
|
51224 |
+
"tstamp": 1723814629.9803
|
51225 |
}
|
51226 |
]
|
arena_elo/results/latest/clean_battle_video_generation.json
CHANGED
@@ -14142,5 +14142,285 @@
|
|
14142 |
"judge": "arena_user_10.16.3.140",
|
14143 |
"anony": true,
|
14144 |
"tstamp": 1723688186.8235
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
14145 |
}
|
14146 |
]
|
|
|
14142 |
"judge": "arena_user_10.16.3.140",
|
14143 |
"anony": true,
|
14144 |
"tstamp": 1723688186.8235
|
14145 |
+
},
|
14146 |
+
{
|
14147 |
+
"model_a": "AnimateDiff",
|
14148 |
+
"model_b": "StableVideoDiffusion",
|
14149 |
+
"winner": "model_b",
|
14150 |
+
"judge": "arena_user_10.16.18.75",
|
14151 |
+
"anony": true,
|
14152 |
+
"tstamp": 1723750292.9806
|
14153 |
+
},
|
14154 |
+
{
|
14155 |
+
"model_a": "AnimateDiff",
|
14156 |
+
"model_b": "CogVideoX",
|
14157 |
+
"winner": "tie",
|
14158 |
+
"judge": "arena_user_10.16.18.75",
|
14159 |
+
"anony": true,
|
14160 |
+
"tstamp": 1723750310.0111
|
14161 |
+
},
|
14162 |
+
{
|
14163 |
+
"model_a": "ModelScope",
|
14164 |
+
"model_b": "AnimateDiffTurbo",
|
14165 |
+
"winner": "model_a",
|
14166 |
+
"judge": "arena_user_10.16.1.165",
|
14167 |
+
"anony": true,
|
14168 |
+
"tstamp": 1723750319.0043
|
14169 |
+
},
|
14170 |
+
{
|
14171 |
+
"model_a": "OpenSora",
|
14172 |
+
"model_b": "ModelScope",
|
14173 |
+
"winner": "tie (bothbad)",
|
14174 |
+
"judge": "arena_user_10.16.18.75",
|
14175 |
+
"anony": true,
|
14176 |
+
"tstamp": 1723750327.1228
|
14177 |
+
},
|
14178 |
+
{
|
14179 |
+
"model_a": "OpenSora12",
|
14180 |
+
"model_b": "StableVideoDiffusion",
|
14181 |
+
"winner": "model_b",
|
14182 |
+
"judge": "arena_user_10.16.18.162",
|
14183 |
+
"anony": true,
|
14184 |
+
"tstamp": 1723750335.3945
|
14185 |
+
},
|
14186 |
+
{
|
14187 |
+
"model_a": "CogVideoX",
|
14188 |
+
"model_b": "OpenSora",
|
14189 |
+
"winner": "tie (bothbad)",
|
14190 |
+
"judge": "arena_user_10.16.18.162",
|
14191 |
+
"anony": true,
|
14192 |
+
"tstamp": 1723750350.6602
|
14193 |
+
},
|
14194 |
+
{
|
14195 |
+
"model_a": "StableVideoDiffusion",
|
14196 |
+
"model_b": "T2VTurbo",
|
14197 |
+
"winner": "model_a",
|
14198 |
+
"judge": "arena_user_10.16.18.162",
|
14199 |
+
"anony": true,
|
14200 |
+
"tstamp": 1723750358.1749
|
14201 |
+
},
|
14202 |
+
{
|
14203 |
+
"model_a": "AnimateDiffTurbo",
|
14204 |
+
"model_b": "ModelScope",
|
14205 |
+
"winner": "model_a",
|
14206 |
+
"judge": "arena_user_10.16.1.165",
|
14207 |
+
"anony": true,
|
14208 |
+
"tstamp": 1723750364.7878
|
14209 |
+
},
|
14210 |
+
{
|
14211 |
+
"model_a": "StableVideoDiffusion",
|
14212 |
+
"model_b": "VideoCrafter2",
|
14213 |
+
"winner": "model_a",
|
14214 |
+
"judge": "arena_user_10.16.1.165",
|
14215 |
+
"anony": true,
|
14216 |
+
"tstamp": 1723750381.2843
|
14217 |
+
},
|
14218 |
+
{
|
14219 |
+
"model_a": "AnimateDiff",
|
14220 |
+
"model_b": "CogVideoX",
|
14221 |
+
"winner": "model_a",
|
14222 |
+
"judge": "arena_user_10.16.1.165",
|
14223 |
+
"anony": true,
|
14224 |
+
"tstamp": 1723750391.4264
|
14225 |
+
},
|
14226 |
+
{
|
14227 |
+
"model_a": "StableVideoDiffusion",
|
14228 |
+
"model_b": "AnimateDiff",
|
14229 |
+
"winner": "model_a",
|
14230 |
+
"judge": "arena_user_10.16.18.162",
|
14231 |
+
"anony": true,
|
14232 |
+
"tstamp": 1723750397.441
|
14233 |
+
},
|
14234 |
+
{
|
14235 |
+
"model_a": "LaVie",
|
14236 |
+
"model_b": "OpenSora12",
|
14237 |
+
"winner": "tie (bothbad)",
|
14238 |
+
"judge": "arena_user_10.16.18.75",
|
14239 |
+
"anony": true,
|
14240 |
+
"tstamp": 1723750420.9776
|
14241 |
+
},
|
14242 |
+
{
|
14243 |
+
"model_a": "T2VTurbo",
|
14244 |
+
"model_b": "LaVie",
|
14245 |
+
"winner": "model_a",
|
14246 |
+
"judge": "arena_user_10.16.18.162",
|
14247 |
+
"anony": true,
|
14248 |
+
"tstamp": 1723750432.0635
|
14249 |
+
},
|
14250 |
+
{
|
14251 |
+
"model_a": "T2VTurbo",
|
14252 |
+
"model_b": "VideoCrafter2",
|
14253 |
+
"winner": "model_b",
|
14254 |
+
"judge": "arena_user_10.16.18.75",
|
14255 |
+
"anony": true,
|
14256 |
+
"tstamp": 1723750440.7966
|
14257 |
+
},
|
14258 |
+
{
|
14259 |
+
"model_a": "OpenSora",
|
14260 |
+
"model_b": "AnimateDiffTurbo",
|
14261 |
+
"winner": "model_a",
|
14262 |
+
"judge": "arena_user_10.16.18.162",
|
14263 |
+
"anony": true,
|
14264 |
+
"tstamp": 1723750447.106
|
14265 |
+
},
|
14266 |
+
{
|
14267 |
+
"model_a": "OpenSora",
|
14268 |
+
"model_b": "OpenSora12",
|
14269 |
+
"winner": "model_b",
|
14270 |
+
"judge": "arena_user_10.16.18.162",
|
14271 |
+
"anony": true,
|
14272 |
+
"tstamp": 1723750454.9814
|
14273 |
+
},
|
14274 |
+
{
|
14275 |
+
"model_a": "ModelScope",
|
14276 |
+
"model_b": "AnimateDiffTurbo",
|
14277 |
+
"winner": "tie (bothbad)",
|
14278 |
+
"judge": "arena_user_10.16.18.162",
|
14279 |
+
"anony": true,
|
14280 |
+
"tstamp": 1723750460.9919
|
14281 |
+
},
|
14282 |
+
{
|
14283 |
+
"model_a": "AnimateDiff",
|
14284 |
+
"model_b": "LaVie",
|
14285 |
+
"winner": "tie",
|
14286 |
+
"judge": "arena_user_10.16.18.162",
|
14287 |
+
"anony": true,
|
14288 |
+
"tstamp": 1723750468.2122
|
14289 |
+
},
|
14290 |
+
{
|
14291 |
+
"model_a": "CogVideoX",
|
14292 |
+
"model_b": "AnimateDiff",
|
14293 |
+
"winner": "model_a",
|
14294 |
+
"judge": "arena_user_10.16.18.162",
|
14295 |
+
"anony": true,
|
14296 |
+
"tstamp": 1723750529.9932
|
14297 |
+
},
|
14298 |
+
{
|
14299 |
+
"model_a": "AnimateDiff",
|
14300 |
+
"model_b": "CogVideoX",
|
14301 |
+
"winner": "tie (bothbad)",
|
14302 |
+
"judge": "arena_user_10.16.34.60",
|
14303 |
+
"anony": true,
|
14304 |
+
"tstamp": 1723750547.1862
|
14305 |
+
},
|
14306 |
+
{
|
14307 |
+
"model_a": "AnimateDiff",
|
14308 |
+
"model_b": "ModelScope",
|
14309 |
+
"winner": "tie (bothbad)",
|
14310 |
+
"judge": "arena_user_10.16.1.165",
|
14311 |
+
"anony": true,
|
14312 |
+
"tstamp": 1723750560.6123
|
14313 |
+
},
|
14314 |
+
{
|
14315 |
+
"model_a": "VideoCrafter2",
|
14316 |
+
"model_b": "ModelScope",
|
14317 |
+
"winner": "tie (bothbad)",
|
14318 |
+
"judge": "arena_user_10.16.34.60",
|
14319 |
+
"anony": true,
|
14320 |
+
"tstamp": 1723750567.1339
|
14321 |
+
},
|
14322 |
+
{
|
14323 |
+
"model_a": "LaVie",
|
14324 |
+
"model_b": "CogVideoX",
|
14325 |
+
"winner": "model_a",
|
14326 |
+
"judge": "arena_user_10.16.34.60",
|
14327 |
+
"anony": false,
|
14328 |
+
"tstamp": 1723750590.9121
|
14329 |
+
},
|
14330 |
+
{
|
14331 |
+
"model_a": "LaVie",
|
14332 |
+
"model_b": "CogVideoX",
|
14333 |
+
"winner": "tie",
|
14334 |
+
"judge": "arena_user_10.16.34.60",
|
14335 |
+
"anony": false,
|
14336 |
+
"tstamp": 1723750613.9108
|
14337 |
+
},
|
14338 |
+
{
|
14339 |
+
"model_a": "OpenSora12",
|
14340 |
+
"model_b": "CogVideoX",
|
14341 |
+
"winner": "model_b",
|
14342 |
+
"judge": "arena_user_10.16.1.165",
|
14343 |
+
"anony": false,
|
14344 |
+
"tstamp": 1723750636.1965
|
14345 |
+
},
|
14346 |
+
{
|
14347 |
+
"model_a": "OpenSora12",
|
14348 |
+
"model_b": "CogVideoX",
|
14349 |
+
"winner": "model_b",
|
14350 |
+
"judge": "arena_user_10.16.1.165",
|
14351 |
+
"anony": false,
|
14352 |
+
"tstamp": 1723750648.9058
|
14353 |
+
},
|
14354 |
+
{
|
14355 |
+
"model_a": "OpenSora12",
|
14356 |
+
"model_b": "CogVideoX",
|
14357 |
+
"winner": "tie (bothbad)",
|
14358 |
+
"judge": "arena_user_10.16.1.165",
|
14359 |
+
"anony": false,
|
14360 |
+
"tstamp": 1723750657.9334
|
14361 |
+
},
|
14362 |
+
{
|
14363 |
+
"model_a": "OpenSora12",
|
14364 |
+
"model_b": "CogVideoX",
|
14365 |
+
"winner": "tie (bothbad)",
|
14366 |
+
"judge": "arena_user_10.16.1.165",
|
14367 |
+
"anony": false,
|
14368 |
+
"tstamp": 1723750663.0959
|
14369 |
+
},
|
14370 |
+
{
|
14371 |
+
"model_a": "OpenSora12",
|
14372 |
+
"model_b": "CogVideoX",
|
14373 |
+
"winner": "tie (bothbad)",
|
14374 |
+
"judge": "arena_user_10.16.1.165",
|
14375 |
+
"anony": false,
|
14376 |
+
"tstamp": 1723750668.5984
|
14377 |
+
},
|
14378 |
+
{
|
14379 |
+
"model_a": "OpenSora12",
|
14380 |
+
"model_b": "CogVideoX",
|
14381 |
+
"winner": "model_b",
|
14382 |
+
"judge": "arena_user_10.16.1.165",
|
14383 |
+
"anony": false,
|
14384 |
+
"tstamp": 1723750677.7833
|
14385 |
+
},
|
14386 |
+
{
|
14387 |
+
"model_a": "OpenSora12",
|
14388 |
+
"model_b": "CogVideoX",
|
14389 |
+
"winner": "model_b",
|
14390 |
+
"judge": "arena_user_10.16.34.60",
|
14391 |
+
"anony": false,
|
14392 |
+
"tstamp": 1723750685.9335
|
14393 |
+
},
|
14394 |
+
{
|
14395 |
+
"model_a": "StableVideoDiffusion",
|
14396 |
+
"model_b": "ModelScope",
|
14397 |
+
"winner": "model_a",
|
14398 |
+
"judge": "arena_user_10.16.34.60",
|
14399 |
+
"anony": true,
|
14400 |
+
"tstamp": 1723771039.5547
|
14401 |
+
},
|
14402 |
+
{
|
14403 |
+
"model_a": "LaVie",
|
14404 |
+
"model_b": "AnimateDiff",
|
14405 |
+
"winner": "model_a",
|
14406 |
+
"judge": "arena_user_10.16.1.247",
|
14407 |
+
"anony": true,
|
14408 |
+
"tstamp": 1723823873.9245
|
14409 |
+
},
|
14410 |
+
{
|
14411 |
+
"model_a": "OpenSora",
|
14412 |
+
"model_b": "OpenSora12",
|
14413 |
+
"winner": "tie (bothbad)",
|
14414 |
+
"judge": "arena_user_10.16.1.247",
|
14415 |
+
"anony": true,
|
14416 |
+
"tstamp": 1723823885.6647
|
14417 |
+
},
|
14418 |
+
{
|
14419 |
+
"model_a": "OpenSora12",
|
14420 |
+
"model_b": "AnimateDiffTurbo",
|
14421 |
+
"winner": "model_b",
|
14422 |
+
"judge": "arena_user_10.16.34.60",
|
14423 |
+
"anony": true,
|
14424 |
+
"tstamp": 1723823896.656
|
14425 |
}
|
14426 |
]
|
arena_elo/results/latest/elo_results_t2i_generation.pkl
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 73808
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:38986e25cfeb84a2881a48c90c0452e5621609c51b0478ed3c9eeedcd3fa14d8
|
3 |
size 73808
|
arena_elo/results/latest/elo_results_video_generation.pkl
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 59905
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a741e4702b6e8bfb6e4f99281442f35b951d536c69f95322c4595b497c5fa83b
|
3 |
size 59905
|
arena_elo/results/latest/t2i_generation_leaderboard.csv
CHANGED
@@ -1,14 +1,14 @@
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
-
PlayGround V2.5,PlayGround V2.5,
|
3 |
-
PlayGround V2,PlayGround V2,1092.
|
4 |
-
HunyuanDiT,HunyuanDiT,
|
5 |
-
StableCascade,StableCascade,1056.
|
6 |
-
SDXLLightning,SDXLLightning,
|
7 |
-
PixArtAlpha,PixArtAlpha,1040.
|
8 |
-
PixArtSigma,PixArtSigma,
|
9 |
-
SD3,SD3,
|
10 |
-
SDXL,SDXL,986.
|
11 |
-
SDXLTurbo,SDXLTurbo,
|
12 |
-
LCM(v1.5/XL),LCM(v1.5/XL),924.
|
13 |
-
OpenJourney,OpenJourney,
|
14 |
-
LCM,LCM,808.
|
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
PlayGround V2.5,PlayGround V2.5,1151.5003889911254,1153.4694745022227,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
|
3 |
+
PlayGround V2,PlayGround V2,1092.2757564506146,1091.49511668867,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
|
4 |
+
HunyuanDiT,HunyuanDiT,1064.1993233690234,1049.4501647957088,tencent-hunyuan-community,Tencent,https://huggingface.co/Tencent-Hunyuan/HunyuanDiT
|
5 |
+
StableCascade,StableCascade,1056.2582682038956,1060.3493390345488,stable-cascade-nc-community (other),Stability AI,https://huggingface.co/stabilityai/stable-cascade
|
6 |
+
SDXLLightning,SDXLLightning,1042.1171870294593,1047.1781761521615,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
|
7 |
+
PixArtAlpha,PixArtAlpha,1040.2875132238112,1030.759804128689,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
|
8 |
+
PixArtSigma,PixArtSigma,1037.878752178197,1038.1867588798452,openrail++,PixArt-alpha,https://fal.ai/models/fal-ai/pixart-sigma
|
9 |
+
SD3,SD3,1018.2716109213237,1012.9764762907159,stabilityai-nc-research-community,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-3-medium
|
10 |
+
SDXL,SDXL,986.723355299696,987.0726906842126,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
|
11 |
+
SDXLTurbo,SDXLTurbo,929.9968811688445,928.0647936396172,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
|
12 |
+
LCM(v1.5/XL),LCM(v1.5/XL),924.8395908955157,919.0173216572904,openrail++,Latent Consistency,https://fal.ai/models/fal-ai/fast-lcm-diffusion/api
|
13 |
+
OpenJourney,OpenJourney,847.0217236457364,841.9706858280956,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
|
14 |
+
LCM,LCM,808.629648622764,822.6328041447692,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
|
arena_elo/results/latest/video_generation_leaderboard.csv
CHANGED
@@ -1,9 +1,9 @@
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
-
StableVideoDiffusion,StableVideoDiffusion,
|
3 |
-
T2VTurbo,T2VTurbo,
|
4 |
-
VideoCrafter2,VideoCrafter2,1076.
|
5 |
-
AnimateDiff,AnimateDiff,
|
6 |
-
LaVie,LaVie,994.
|
7 |
-
OpenSora,OpenSora,912.
|
8 |
-
ModelScope,ModelScope,
|
9 |
-
AnimateDiffTurbo,AnimateDiffTurbo,
|
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
StableVideoDiffusion,StableVideoDiffusion,1128.5556341994472,1131.1226712368302,stable-video-diffusion-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
|
3 |
+
T2VTurbo,T2VTurbo,1104.2114319074628,1102.5509654047792,cc-by-nc-4.0,"University of California, Santa Barbara",https://huggingface.co/jiachenli-ucsb/T2V-Turbo-VC2
|
4 |
+
VideoCrafter2,VideoCrafter2,1076.4651982985179,1076.7711382593716,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
|
5 |
+
AnimateDiff,AnimateDiff,1067.3275823442182,1065.8895802273453,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
|
6 |
+
LaVie,LaVie,994.6797361277218,993.743578293222,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
|
7 |
+
OpenSora,OpenSora,912.9431526392987,912.6820481082565,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
8 |
+
ModelScope,ModelScope,863.3588113010672,864.6159871119833,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
|
9 |
+
AnimateDiffTurbo,AnimateDiffTurbo,852.4584531822653,852.6240313582127,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
|