Human communication on the Internet is increasing as a substitute to direct human interaction in a physical space. This trend is expanding particularly with the COVID-19 pandemic. Furthermore, presenting the face expressed in 3D graphics to the communication partner is preferred owing to the discomfort felt in showing the actual face of the communicating person. However, showing emotional expressions with a 3D graphic face is difficult. To overcome this problem, we design and implement Voice to Face Expression (VFep) that analyzes the speaker's voice signal, recognizes the emotion of the speaker, and reflects it in the 3D model of the face in real time. In this paper, the design and implementation of VFep and the preliminary evaluation results are described. © 2021 IEEE.
VFep: 3D Graphic Face Representation Based on Voice-based Emotion Recognition