Warren McCulloch, who was n American neurophysiologist, first described ANN in 1943 that led to the development of neural networks with electrical circuits by Walter Pitts [1]}. Later in 1949, Donald Hebb also supported the idea of neurons in his book [2]} and pointed out that neural trails are reinforced each time they are used. Following the growing interest in ANN, Nathanial Rochester from the IBM research laboratories simulated the first neural network in the 1950s [3]}. In 1960, Frank Rosenblatt, a neuro-biologist of Cornell, invented the first perceptron inspired by the neural working of a human brain by doing some simulations [4]}. Then, Frank Rosenblatt invented the perceptron at the Cornell Aeronautical Laboratory to cognize human memory, learning, and cognitive processes. He revealed the Mark I Perceptron, the first machine that could "learn" to distinguish and identify optical patterns [5]}. Since the invention of the first perceptron in the 1960s, a very long gap has occurred in the advancement of neural networks. However, in 1982, John Hopfield re-motivated the scientific community by presenting a new perspective of building devices using neural networks.
