@inproceedings{
momeni2023phyff,
title={Phy{FF}: Physical forward forward algorithm for in-hardware training and inference},
author={Ali Momeni and Babak Rahmani and Matthieu Mall{\'e}jac and Philipp del Hougne and Romain Fleury},
booktitle={Machine Learning with New Compute Paradigms},
year={2023},
url={https://openreview.net/forum?id=aqsFLVg0tY}
}
Training of digital deep learning models primarily relies on backpropagation, which poses challenges for physical implementation due to its dependency on precise knowledge of computations performed in the forward pass of the neural network. To address this issue, we propose a physical forward forward training algorithm (phyFF) that is inspired by the original forward forward algorithm. This novel approach facilitates direct training of deep physical neural networks comprising layers of diverse physical nonlinear systems, without the need for the complete knowledge of the underlying physics. We demonstrate the superiority of this method over current hardware-aware training techniques. The proposed method achieves faster training speeds, reduces digital computational requirements, and lowers training's power consumption in physical systems.
PhyFF: Physical forward forward algorithm for in-hardware training and inference
Ali Momeni Babak Rahmani Matthieu Malléjac Philipp del Hougne Romain Fleury