@inproceedings{
yang2024semantic,
title={Semantic Aware Just Noticeable Differences for {VVC} compressed Text Screen Content Images},
author={Kaifang Yang and Xinrong Zhao and Yanchao Gong},
booktitle={ACM Multimedia 2024},
year={2024},
url={https://openreview.net/forum?id=5kcnAHZXIC}
}
With the rapid development of multimedia applications such as online education, remote conferences, and telemedicine, an emerging type of image known as text screen content images (TSCI) has gained widespread utilization. Distinguishing from  natural images captured by cameras, TSCI is generally generated or rendered by computers and exhibits significant differences in content characteristics. Notably, TSCI primarily comprises text,, a symbol system uniquely defined by humans with specific semantics. As an important carrier for transmitting semantic information, the quality of text in TSCI significantly affects the subjective perception experience of multimedia system users. Just noticeable difference (JND) is a widely studied image quality measure that is theoretically closest to human perception. However, the traditional JND (T-JND) tests fail to distinguish text from other image contents, ignoring the significant impact of semantic readability of text on image quality. This paper focuses for the first time on the impact of text semantics on the quality of TSCI, and JND experiments for TSCI compressed by the state-of-the-art versatile video coding (VVC) standard are explored and discussed. Specifically, a matching TSCI database is first established. Using the database, image subjective observation comparison experiments are further designed and carried out to construct the traditional JND (T-JND) as well as the semantic aware JND (S-JND). By comparing the experimental results, crucial conclusions are reached, including the fact that the S-JND provides a more precise description of the quality of TSCI compared to the T-JND. These conclusions have important guiding significance for the subsequent development of efficient JND models suitable for TSCI compressed by VVC.
Semantic Aware Just Noticeable Differences for VVC compressed Text Screen Content Images
Kaifang Yang Xinrong Zhao Yanchao Gong