Papers
arxiv:2408.02629

VidGen-1M: A Large-Scale Dataset for Text-to-video Generation

Published on Aug 5
· Submitted by akhaliq on Aug 6
Authors:
,
,

Abstract

The quality of video-text pairs fundamentally determines the upper bound of text-to-video models. Currently, the datasets used for training these models suffer from significant shortcomings, including low temporal consistency, poor-quality captions, substandard video quality, and imbalanced data distribution. The prevailing video curation process, which depends on image models for tagging and manual rule-based curation, leads to a high computational load and leaves behind unclean data. As a result, there is a lack of appropriate training datasets for text-to-video models. To address this problem, we present VidGen-1M, a superior training dataset for text-to-video models. Produced through a coarse-to-fine curation strategy, this dataset guarantees high-quality videos and detailed captions with excellent temporal consistency. When used to train the video generation model, this dataset has led to experimental results that surpass those obtained with other models.

Community

Paper submitter

The video shows a highway winding through a lush green landscape. The road is surrounded by dense trees and vegetation both sides. The sky is overcast, and the mountains in the distance are partially obscured by clouds. The highway appears to be in good condition, with clear lane markings. There are several vehicles traveling on the road, including cars and trucks. The colors in the video are predominantly green from the trees and grey from the road and sky.
curving-road-through-lush-green-forest.jpg

This is an automated message from the Librarian Bot. I found the following papers similar to this paper.

The following papers were recommended by the Semantic Scholar API

Please give a thumbs up to this comment if you found it helpful!

If you want recommendations for any Paper on Hugging Face checkout this Space

You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend

Sign up or log in to comment

Models citing this paper 1

Datasets citing this paper 1

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2408.02629 in a Space README.md to link it from this page.

Collections including this paper 6