OSA Publishing > Photonics Research > Volume 8 > Issue 1 > Page 46
Lan Yang, Editor-in-Chief
Neuromorphic metasurface
Zhicheng Wu, Ming Zhou, Erfan Khoram, Boyuan Liu, and Zongfu Yu
Zhicheng Wu, Ming Zhou, Erfan Khoram, Boyuan Liu, and Zongfu Yu*
Department of Electrical and Computer Engineering, University of Wisconsin, Madison, Wisconsin 53706, USA
*Corresponding author: zyu54@wisc.edu
Zhicheng Wu https://orcid.org/0000-0002-2659-4172
Ming Zhou https://orcid.org/0000-0003-2368-8883
Z Wu
M Zhou
E Khoram
B Liu
Z Yu
Vol. 8,
•https://doi.org/10.1364/PRJ.8.000046
Zhicheng Wu, Ming Zhou, Erfan Khoram, Boyuan Liu, and Zongfu Yu, "Neuromorphic metasurface," Photon. Res. 8, 46-50 (2020)
Nanophotonics and Photonic Crystals
Beam steering
In field scattering
Light propagation
Phase compensation
Revised Manuscript: October 31, 2019
Manuscript Accepted: November 9, 2019
Metasurfaces have been used to realize optical functions such as focusing and beam steering. They use subwavelength nanostructures to control the local amplitude and phase of light. Here we show that such control could also enable a new function of artificial neural inference. We demonstrate that metasurfaces can directly recognize objects by focusing light from an object to different spatial locations that correspond to the class of the object.
© 2019 Chinese Laser Press
Neuromorphic photonics with electro-absorption modulators
Jonathan K. George, Armin Mehrabian, Rubab Amin, Jiawei Meng, Thomas Ferreira de Lima, Alexander N. Tait, Bhavin J. Shastri, Tarek El-Ghazawi, Paul R. Prucnal, and Volker J. Sorger
Optoelectronic neuromorphic system using the neural engineering framework
Rui Wang, Cheng Qian, Quansheng Ren, and Jianye Zhao
Appl. Opt. 56(5) 1517-1525 (2017)
Shaping light with nonlinear metasurfaces
Shay Keren-Zur, Lior Michaeli, Haim Suchowski, and Tal Ellenbogen
Adv. Opt. Photon. 10(1) 309-353 (2018)
Computational inverse design for cascaded systems of metasurface optics
Adam S. Backer
Phenomenological modeling of nonlinear holograms based on metallic geometric metasurfaces
Weimin Ye, Xin Li, Juan Liu, and Shuang Zhang
Y. Shen, N. C. Harris, S. Skirlo, M. Prabhu, T. Baehr-Jones, M. Hochberg, X. Sun, S. Zhao, H. Larochelle, D. Englund, and M. Soljačić, "Deep learning with coherent nanophotonic circuits," Nat. Photonics 11, 441–446 (2017).
X. Lin, Y. Rivenson, N. T. Yardimci, M. Veli, Y. Luo, M. Jarrahi, and A. Ozcan, "All-optical machine learning using diffractive deep neural networks," Science 361, 1004–1008 (2018).
E. Khoram, A. Chen, D. Liu, L. Ying, Q. Wang, M. Yuan, and Z. Yu, "Nanophotonic media for artificial neural inference," Photon. Res. 7, 823–827 (2019).
N. Yu, P. Genevet, M. A. Kats, F. Aieta, J.-P. Tetienne, F. Capasso, and Z. Gaburro, "Light propagation with phase discontinuities: generalized laws of reflection and refraction," Science 334, 333–337 (2011).
N. Yu and F. Capasso, "Flat optics with designer metasurfaces," Nat. Mater. 13, 139–150 (2014).
C. C. Yann, MNIST handwritten digit database, Yann LeCun, Corinna Cortes and Chris Burges (2015).
R. Pestourie, C. Pérez-Arancibia, Z. Lin, W. Shin, F. Capasso, and S. G. Johnson, "Inverse design of large-area metasurfaces," Opt. Express 26, 33732–33747 (2018).
F. Aieta, P. Genevet, M. A. Kats, N. Yu, R. Blanchard, Z. Gaburro, and F. Capasso, "Aberration-free ultrathin flat lenses and axicons at telecom wavelengths based on plasmonic metasurfaces," Nano Lett. 12, 4932–4936 (2012).
A. Arbabi, E. Arbabi, Y. Horie, S. M. Kamali, and A. Faraon, "Planar metasurface retroreflector," Nat. Photonics 11, 415–420 (2017).
M. Khorasaninejad, W. T. Chen, A. Y. Zhu, J. Oh, R. C. Devlin, C. Roques-Carmes, I. Mishra, and F. Capasso, "Visible wavelength planar metalenses based on titanium dioxide," IEEE J. Sel. Top. Quantum Electron. 23, 43–58 (2017).
F. Aieta, M. A. Kats, P. Genevet, and F. Capasso, "Multiwavelength achromatic metasurfaces by dispersive phase compensation," Science 347, 1342–1345 (2015).
M. Khorasaninejad, F. Aieta, P. Kanhaiya, M. A. Kats, P. Genevet, D. Rousso, and F. Capasso, "Achromatic metasurface lens at telecommunication wavelengths," Nano Lett. 15, 5358–5362 (2015).
M. Khorasaninejad, Z. Shi, A. Y. Zhu, W. T. Chen, V. Sanjeev, A. Zaidi, and F. Capasso, "Achromatic metalens over 60 nm bandwidth in the visible and metalens with reverse chromatic dispersion," Nano Lett. 17, 1819–1824 (2017).
E. Arbabi, A. Arbabi, S. M. Kamali, Y. Horie, and A. Faraon, "Controlling the sign of chromatic dispersion in diffractive optics with dielectric metasurfaces," Optica 4, 625–632 (2017).
V.-C. Su, C. H. Chu, G. Sun, and D. P. Tsai, "Advances in optical metasurfaces: fabrication and applications [Invited]," Opt. Express 26, 13148–13182 (2018).
B. Groever, C. Roques-Carmes, S. J. Byrnes, and F. Capasso, "Substrate aberration and correction for meta-lens imaging: an analytical approach," Appl. Opt. 57, 2973–2980 (2018).
A. Y. Piggott, J. Lu, K. G. Lagoudakis, J. Petykiewicz, T. M. Babinec, and J. Vučković, "Inverse design and demonstration of a compact and broadband on-chip wavelength demultiplexer," Nat. Photonics 9, 374–377 (2015).
D. P. Kingma and J. Ba, "Adam: a method for stochastic optimization," arXiv:1412.6980 (2017).
A. Taflove and S. C. Hagness, Computational Electrodynamics: The Finite-Difference Time-Domain Method, 3rd ed., Artech House Antennas and Propagation Library (Artech House, 2005).
Aieta, F.
Arbabi, A.
Arbabi, E.
Ba, J.
Babinec, T. M.
Baehr-Jones, T.
Blanchard, R.
Byrnes, S. J.
Capasso, F.
Chen, A.
Chen, W. T.
Chu, C. H.
Devlin, R. C.
Englund, D.
Faraon, A.
Gaburro, Z.
Genevet, P.
Groever, B.
Hagness, S. C.
Harris, N. C.
Hochberg, M.
Horie, Y.
Jarrahi, M.
Johnson, S. G.
Kamali, S. M.
Kanhaiya, P.
Kats, M. A.
Khoram, E.
Khorasaninejad, M.
Kingma, D. P.
Lagoudakis, K. G.
Larochelle, H.
Lin, X.
Lin, Z.
Liu, D.
Lu, J.
Luo, Y.
Mishra, I.
Oh, J.
Ozcan, A.
Pérez-Arancibia, C.
Pestourie, R.
Petykiewicz, J.
Piggott, A. Y.
Prabhu, M.
Rivenson, Y.
Roques-Carmes, C.
Rousso, D.
Sanjeev, V.
Shen, Y.
Shi, Z.
Shin, W.
Skirlo, S.
Soljacic, M.
Su, V.-C.
Sun, G.
Sun, X.
Taflove, A.
Tetienne, J.-P.
Tsai, D. P.
Veli, M.
Vuckovic, J.
Wang, Q.
Yann, C. C.
Yardimci, N. T.
Ying, L.
Yu, N.
Yu, Z.
Zaidi, A.
Zhao, S.
Zhu, A. Y.
IEEE J. Sel. Top. Quantum Electron. (1)
Nat. Mater. (1)
Photon. Res. (1)
Fig. 1. (a) Schematic of the neuromorphic metasurface. The neuromorphic metasurface consists of multiple layers of nanostructures, which are composed of an array of nanoribbons on top of a dielectric substrate. A handwritten digit is illuminated by a plane wave, and the scattered light then is processed by the neuromorphic metasurface. By changing the sizes of ribbons, the phase and amplitude of the transmitted light after each layer can be modified. After multiple layers, the transmitted field can be focused on specific photodetectors, which are labeled by the values of the handwritten digits, i.e., 0 to 9. (b) Intensity distribution of the transmitted light after each layer in a three-layer neuromorphic metasurface. Handwritten digits of 7 and 2 with different writing styles are used as examples. Despite the different writing styles, the transmitted light is always focused on the spot corresponding to the value of the handwritten digit. Here, we normalize the intensity of the transmitted light after each layer to its maximum for clarity.
Fig. 2. (a) Schematic of locally periodic approximation. The metasurface consists of an array of TiO2 pillars on top of a SiO2 substrate. For plane wave incidence from the bottom side of the substrate, we set up a periodic boundary condition around each pillar. The local field of the transmitted light above each pillar then is approximated by that of the corresponding periodic array. (b) The phase (blue) and amplitude (red) of transmitted light as a function of the width of the pillar under normal plane wave incidence. The results are obtained from a full-wave simulation of a periodic array of pillars, which only takes a few minutes.
Fig. 3. (a) Amplitude and (b) phase of the transmitted field as a function of the width of the pillar for the different incident angle α. The incident wavelength is 700 nm. When the incident angle is small, the phase response curve shifts horizontally as we increase the incident angle, while the amplitude response does not vary significantly with the incident angle. When the incident angle continues to increase, some resonances appear. The inset shows the shift of the phase response as a function of the incident angle. The shift increases nonlinearly with increasing incident angle.
Fig. 4. (a) Forward propagation in a neuromorphic metasurface that has L layers. At the lth layer, the pillars take the far-field from the (l−1)th layer Efl−1 as input and process it. The output near-field Enl is obtained by using locally periodic approximation. The corresponding far-field Efl at the lth layer then is obtained by using near-to-far-field transformation. The final output of the neuromorphic metasurface is the intensity of light |EfL|2. (b) The training loss of a five-layer neuromorphic metasurface as a function of training steps. Each step, we use one training sample to update widths of the pillars. The training dataset is reshuffled every 50,000 steps.
Fig. 5. Comparison of light propagation (a) before and (b) after training for a five-layer neuromorphic metasurface. The input object is a handwritten digit of 2. Before training, the widths of the pillars are randomly initialized, and the transmitted light is randomly distributed at the detector. After training, the transmitted light is directed to detector 2, which corresponds to the input handwritten digit. Here, the intensity distribution of the transmitted light after each layer is also normalized by its maximum for clarity.