1. A method executed by one or more electronic devices in a computer system to convolve sounds in a telephone call to different locations for a listener, the method comprising: determining, by the one or more electronic devices in the computer system, the telephone call as a source of an audio input; segmenting, by an audio diarization system, the audio input of the telephone call into a speech segment that is a voice and a non-speech segment that is music; analyzing, by the one or more electronic devices in the computer system, sound localization point (SLP) locations in prior telephone calls where voices in the prior telephone calls localized to the listener; determining, by the one or more electronic devices in the computer system and based on analysis of the SLP locations in the prior telephone calls, preferred SLP locations where the listener previously localized the voices in the prior telephone calls; storing, in the user preferences of the listener, the preferred SLP locations where the listener desires to localize the voices in the telephone calls; convolving, by the one or more electronic devices in the computer system and with a first pair of head related transfer functions (HRTFs), the speech segment so the voice externally localizes to a first SLP that is external to the listener; convolving, by the one or more electronic devices in the computer system and with a second pair of HRTFs, the non-speech segment so the music externally localizes to a second SLP that is external to the listener and at a different location than the first SLP; and providing, by the one or more electronic devices in the computer system, the speech segment to the listener so the voice externally localizes to the first SLP, and the non-speech segment to the listener so the music externally localizes to the second SLP.