BACKGROUND

Artificial neural networks are computing systems with an architecture based on biological neural networks. Artificial neural networks can be trained, using training data, to learn about how to perform a certain computing task.

A neural network may include a set of processing nodes. Each processing node can process a piece of the input data to generate an output, and the final decision can be generated based on a combination of the outputs of the set of processing nodes. As part of the processing, each processing node can perform a set of arithmetic operations such as, for example, floating-point multiplications and additions, etc. The arithmetic operations of the processing nodes may be performed by graphical processing units (GPU), which typically include circuitries and data paths optimized for high speed arithmetic operations.

