Yiziphi izinzuzo zokusebenzisa umsebenzi wokusebenzisa i-ReLU ngaphezu komsebenzi we-sigmoid wakudala kumanethiwekhi we-neural?
1. Izinkomo Inkinga yokunyamalala kwe-gradient: Inani eliphakeme le-derivative ye-sigmoid function ngu-0.25, okungaholela ekutheni ama-gradients aphelele abe mancane kakhulu ngesikhathi sokusabalalisa emuva. Ngokuphambene nalokho iReLU ine-gradient engaguquki engu-1 yokungeniswa okuhle. 2. Izingelosi Ukusebenza kahle: I-ReLU ingabalwa kusetshenziswa i-max ((0, x), esebenza kangcono kunokusebenza kwe-exponential ku-sigmoid function. 3. Izindaba Ezinhle Ijubane lokuhlangana: kubuye kubikwe ukuthi ukusebenzisa i-ReLU njengomsebenzi wokusebenza kumanethiwekhi we-neural kuhlangana ngokushesha kunokusebenzisa umsebenzi we-sigmoid.