However, this is not usually the case. Most deaf people have conductive hearing loss due to damage in the middle ear structures. Neural hearing loss due to auditory nerve damage is much less common than conductive hearing loss and is usually irreversible.owever, this is not usually the case. Most deaf people have conductive hearing loss due to damage in the middle ear structures. Neural hearing loss due to auditory nerve damage is much less common than conductive hearing loss and is usually irreversible.