BACKGROUND

Embodiments of the invention generally relate to data privacy protection, and more specifically, to a method and system for speaker identity and content de-identification under data privacy guarantees.

SUMMARY

One embodiment of the invention provides a method for speaker identity and content de-identification under data privacy guarantees. The method comprises receiving input indicative of at least one level of privacy protection the speaker identity and content re-identification is required to enforce, and extracting features corresponding to a first speaker from a first speech delivered by the first speaker and recorded in a first voice recording. The method further comprises recognizing and extracting textual content from the first speech, parsing the textual content to recognize privacy-sensitive personal information corresponding to a first individual, and generating de-identified textual content by performing utility-preserving content de-identification on the textual content to anonymize the privacy-sensitive personal information to an extent that satisfies the at least one level of privacy protection. The de-identified textual content conceals a personal identity of the first individual. The method further comprises mapping the de-identified textual content to the first speaker, generating a synthetic speaker identity corresponding to the first speaker based on other features corresponding to at least one other speaker, and synthesizing a new speech waveform based on the synthetic speaker identity to deliver the de-identified textual content. The other features corresponding to the at least one other speaker are dissimilar from the features corresponding to the first speaker to an extent that satisfies the at least one level of privacy protection. The new speech waveform is different from a speech waveform of the first speech, and the new speech waveform conceals a personal identity of the first speaker.

Another embodiment of the invention provides a system for speaker identity and content de-identification under data privacy guarantees. The system comprises at least one processor and a non-transitory processor-readable memory device storing instructions that when executed by the at least one processor causes the at least one processor to perform operations. The operations include receiving input indicative of at least one level of privacy protection the speaker identity and content re-identification is required to enforce, and extracting features corresponding to a first speaker from a first speech delivered by the first speaker and recorded in a first voice recording. The operations further include recognizing and extracting textual content from the first speech, parsing the textual content to recognize privacy-sensitive personal information corresponding to a first individual, and generating de-identified textual content by performing utility-preserving content de-identification on the textual content to anonymize the privacy-sensitive personal information to an extent that satisfies the at least one level of privacy protection. The de-identified textual content conceals a personal identity of the first individual. The operations further include mapping the de-identified textual content to the first speaker, generating a synthetic speaker identity corresponding to the first speaker based on other features corresponding to at least one other speaker, and synthesizing a new speech waveform based on the synthetic speaker identity to deliver the de-identified textual content. The other features corresponding to the at least one other speaker are dissimilar from the features corresponding to the first speaker to an extent that satisfies the at least one level of privacy protection. The new speech waveform is different from a speech waveform of the first speech, and the new speech waveform conceals a personal identity of the first speaker.

One embodiment of the invention provides a computer program product for speaker identity and content de-identification under data privacy guarantees. The computer program product comprises a computer readable storage medium having program instructions embodied therewith. The program instructions are executable by a processor to cause the processor to receive input indicative of at least one level of privacy protection the speaker identity and content re-identification is required to enforce, and extract features corresponding to a first speaker from a first speech delivered by the first speaker and recorded in a first voice recording. The program instructions further cause the processor to recognize and extract textual content from the first speech, parse the textual content to recognize privacy-sensitive personal information corresponding to a first individual, and generate de-identified textual content by performing utility-preserving content de-identification on the textual content to anonymize the privacy-sensitive personal information to an extent that satisfies the at least one level of privacy protection. The de-identified textual content conceals a personal identity of the first individual. The program instructions further cause the processor to map the de-identified textual content to the first speaker, generate a synthetic speaker identity corresponding to the first speaker based on other features corresponding to at least one other speaker, and synthesize a new speech waveform based on the synthetic speaker identity to deliver the de-identified textual content. The other features corresponding to the at least one other speaker are dissimilar from the features corresponding to the first speaker to an extent that satisfies the at least one level of privacy protection. The new speech waveform is different from a speech waveform of the first speech, and the new speech waveform conceals a personal identity of the first speaker.

These and other aspects, features and advantages of embodiments of the invention will be understood with reference to the drawing figures, and detailed description herein, and will be realized by means of the various elements and combinations particularly pointed out in the appended claims. It is to be understood that both the foregoing general description and the following brief description of the drawings and detailed description of embodiments of the invention are exemplary and explanatory of preferred embodiments of the invention, and are not restrictive of embodiments of the invention, as claimed.

