@inproceedings{
tao2024lcgen,
title={{LCG}en: Mining in Low-Certainty Generation for View-consistent Text-to-3D},
author={Zeng Tao and Tong Yang and Junxiong Lin and Xinji Mai and Haoran Wang and Beining Wang and Enyu Zhou and Yan Wang and Wenqiang Zhang},
booktitle={The Thirty-eighth Annual Conference on Neural Information Processing Systems},
year={2024},
url={https://openreview.net/forum?id=4wgzkAyi2D}
}
The Janus Problem is a common issue in SDS-based text-to-3D methods. Due to view encoding approach and 2D diffusion prior guidance, the 3D representation model tends to learn content with higher certainty from each perspective, leading to view inconsistency. In this work, we first model and analyze the problem, visualizing the specific causes of the Janus Problem, which are associated with discrete view encoding and shared priors in 2D lifting. Based on this, we further propose the LCGen method, which guides text-to-3D to obtain different priors with different certainty from various viewpoints, aiding in view-consistent generation. Experiments have proven that our LCGen method can be directly applied to different SDS-based text-to-3D methods, alleviating the Janus Problem without introducing additional information, increasing excessive training burden, or compromising the generation effect.
LCGen: Mining in Low-Certainty Generation for View-consistent Text-to-3D
Zeng Tao Tong Yang Junxiong Lin Xinji Mai Haoran Wang Beining Wang Enyu Zhou Yan Wang Wenqiang Zhang