@inproceedings{zhang-etal-2024-correcting,
    title = "Correcting Pronoun Homophones with Subtle Semantics in {C}hinese Speech Recognition",
    author = "Zhang, Zhaobo  and
      Gan, Rui  and
      Yuan, Pingpeng  and
      Jin, Hai",
    editor = "Calzolari, Nicoletta  and
      Kan, Min-Yen  and
      Hoste, Veronique  and
      Lenci, Alessandro  and
      Sakti, Sakriani  and
      Xue, Nianwen",
    booktitle = "Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)",
    month = may,
    year = "2024",
    address = "Torino, Italia",
    publisher = "ELRA and ICCL",
    url = "https://aclanthology.org/2024.lrec-main.360",
    pages = "4047--4058",
    abstract = "Speech recognition is becoming prevalent in daily life. However, due to the similar semantic context of the entities and the overlap of Chinese pronunciation, the pronoun homophone, especially {``}ä»/å¥¹/å® (he/she/it){''}, (their pronunciation is {``}T{\=a}{''}) is usually recognized incorrectly. It poses a challenge to automatically correct them during the post-processing of Chinese speech recognition. In this paper, we propose three models to address the common confusion issues in this domain, tailored to various application scenarios. We implement the language model, the LSTM model with semantic features, and the rule-based assisted Ngram model, enabling our models to adapt to a wide range of requirements, from high-precision to low-resource offline devices. The extensive experiments show that our models achieve the highest recognition rate for {``}T{\=a}{''} correction with improvements from 70{\%} in the popular voice input methods up to 90{\%}. Further ablation analysis underscores the effectiveness of our models in enhancing recognition accuracy. Therefore, our models improve the overall experience of Chinese speech recognition of {``}T{\=a}{''} and reduce the burden of manual transcription corrections.",
}

Speech recognition is becoming prevalent in daily life. However, due to the similar semantic context of the entities and the overlap of Chinese pronunciation, the pronoun homophone, especially {``}ä»/å¥¹/å® (he/she/it){''}, (their pronunciation is {``}T{\=a}{''}) is usually recognized incorrectly. It poses a challenge to automatically correct them during the post-processing of Chinese speech recognition. In this paper, we propose three models to address the common confusion issues in this domain, tailored to various application scenarios. We implement the language model, the LSTM model with semantic features, and the rule-based assisted Ngram model, enabling our models to adapt to a wide range of requirements, from high-precision to low-resource offline devices. The extensive experiments show that our models achieve the highest recognition rate for {``}T{\=a}{''} correction with improvements from 70{\%} in the popular voice input methods up to 90{\%}. Further ablation analysis underscores the effectiveness of our models in enhancing recognition accuracy. Therefore, our models improve the overall experience of Chinese speech recognition of {``}T{\=a}{''} and reduce the burden of manual transcription corrections.
Zhang, Zhaobo Gan, Rui Yuan, Pingpeng Jin, Hai
Correcting Pronoun Homophones with Subtle Semantics in Chinese Speech Recognition