-
A Laser Spiking Neuron in a Photonic Integrated Circuit
Authors:
Mitchell A. Nahmias,
Hsuan-Tung Peng,
Thomas Ferreira de Lima,
Chaoran Huang,
Alexander N. Tait,
Bhavin J. Shastri,
Paul R. Prucnal
Abstract:
There has been a recent surge of interest in the implementation of linear operations such as matrix multipications using photonic integrated circuit technology. However, these approaches require an efficient and flexible way to perform nonlinear operations in the photonic domain. We have fabricated an optoelectronic nonlinear device--a laser neuron--that uses excitable laser dynamics to achieve bi…
▽ More
There has been a recent surge of interest in the implementation of linear operations such as matrix multipications using photonic integrated circuit technology. However, these approaches require an efficient and flexible way to perform nonlinear operations in the photonic domain. We have fabricated an optoelectronic nonlinear device--a laser neuron--that uses excitable laser dynamics to achieve biologically-inspired spiking behavior. We demonstrate functionality with simultaneous excitation, inhibition, and summation across multiple wavelengths. We also demonstrate cascadability and compatibility with a wavelength multiplexing protocol, both essential for larger scale system integration. Laser neurons represent an important class of optoelectronic nonlinear processors that can complement both the enormous bandwidth density and energy efficiency of photonic computing operations.
△ Less
Submitted 15 December, 2020;
originally announced December 2020.
-
Noise Analysis of Photonic Modulator Neurons
Authors:
Thomas Ferreira de Lima,
Alexander N. Tait,
Hooman Saeidi,
Mitchell A. Nahmias,
Hsuan-Tung Peng,
Siamak Abbaslou,
Bhavin J. Shastri,
Paul R. Prucnal
Abstract:
Neuromorphic photonics relies on efficiently emulating analog neural networks at high speeds. Prior work showed that transducing signals from the optical to the electrical domain and back with transimpedance gain was an efficient approach to implementing analog photonic neurons and scalable networks. Here, we examine modulator-based photonic neuron circuits with passive and active transimpedance g…
▽ More
Neuromorphic photonics relies on efficiently emulating analog neural networks at high speeds. Prior work showed that transducing signals from the optical to the electrical domain and back with transimpedance gain was an efficient approach to implementing analog photonic neurons and scalable networks. Here, we examine modulator-based photonic neuron circuits with passive and active transimpedance gains, with special attention to the sources of noise propagation. We find that a modulator nonlinear transfer function can suppress noise, which is necessary to avoid noise propagation in hardware neural networks. In addition, while efficient modulators can reduce power for an individual neuron, signal-to-noise ratios must be traded off with power consumption at a system level. Active transimpedance amplifiers may help relax this tradeoff for conventional p-n junction silicon photonic modulators, but a passive transimpedance circuit is sufficient when very efficient modulators (i.e. low C and low V-pi) are employed.
△ Less
Submitted 17 July, 2019;
originally announced July 2019.
-
Digital Electronics and Analog Photonics for Convolutional Neural Networks (DEAP-CNNs)
Authors:
Viraj Bangari,
Bicky A. Marquez,
Heidi B. Miller,
Alexander N. Tait,
Mitchell A. Nahmias,
Thomas Ferreira de Lima,
Hsuan-Tung Peng,
Paul R. Prucnal,
Bhavin J. Shastri
Abstract:
Convolutional Neural Networks (CNNs) are powerful and highly ubiquitous tools for extracting features from large datasets for applications such as computer vision and natural language processing. However, a convolution is a computationally expensive operation in digital electronics. In contrast, neuromorphic photonic systems, which have experienced a recent surge of interest over the last few year…
▽ More
Convolutional Neural Networks (CNNs) are powerful and highly ubiquitous tools for extracting features from large datasets for applications such as computer vision and natural language processing. However, a convolution is a computationally expensive operation in digital electronics. In contrast, neuromorphic photonic systems, which have experienced a recent surge of interest over the last few years, propose higher bandwidth and energy efficiencies for neural network training and inference. Neuromorphic photonics exploits the advantages of optical electronics, including the ease of analog processing, and busing multiple signals on a single waveguide at the speed of light. Here, we propose a Digital Electronic and Analog Photonic (DEAP) CNN hardware architecture that has potential to be 2.8 to 14 times faster while maintaining the same power usage of current state-of-the-art GPUs.
△ Less
Submitted 22 April, 2019;
originally announced July 2019.
-
Demonstration of multivariate photonics: blind dimensionality reduction with analog integrated photonics
Authors:
Alexander N. Tait,
Philip Y. Ma,
Thomas Ferreira de Lima,
Eric C. Blow,
Matthew P. Chang,
Mitchell A. Nahmias,
Bhavin J. Shastri,
Paul R. Prucnal
Abstract:
Multi-antenna radio front-ends generate a multi-dimensional flood of information, most of which is partially redundant. Redundancy is eliminated by dimensionality reduction, but contemporary digital processing techniques face harsh fundamental tradeoffs when implementing this class of functions. These tradeoffs can be broken in the analog domain, in which the performance of optical technologies gr…
▽ More
Multi-antenna radio front-ends generate a multi-dimensional flood of information, most of which is partially redundant. Redundancy is eliminated by dimensionality reduction, but contemporary digital processing techniques face harsh fundamental tradeoffs when implementing this class of functions. These tradeoffs can be broken in the analog domain, in which the performance of optical technologies greatly exceeds that of electronic counterparts. Here, we present concepts, methods, and a first demonstration of multivariate photonics: a combination of integrated photonic hardware, analog dimensionality reduction, and blind algorithmic techniques. We experimentally demonstrate 2-channel, 1.0 GHz principal component analysis in a photonic weight bank using recently proposed algorithms for synthesizing the multivariate properties of signals to which the receiver is blind. Novel methods are introduced for controlling blindness conditions in a laboratory context. This work provides a foundation for further research in multivariate photonic information processing, which is poised to play a role in future generations of wireless technology.
△ Less
Submitted 10 February, 2019;
originally announced March 2019.
-
A silicon photonic modulator neuron
Authors:
Alexander N. Tait,
Thomas Ferreira de Lima,
Mitchell A. Nahmias,
Heidi B. Miller,
Hsuan-Tung Peng,
Bhavin J. Shastri,
Paul R. Prucnal
Abstract:
There has been a recently renewed interest in neuromorphic photonics, a field promising to access pivotal and unexplored regimes of machine intelligence. Progress has been made on isolated neurons and analog interconnects; nevertheless, this renewal has yet to produce a demonstration of a silicon photonic neuron capable of interacting with other like neurons. We report a modulator-class photonic n…
▽ More
There has been a recently renewed interest in neuromorphic photonics, a field promising to access pivotal and unexplored regimes of machine intelligence. Progress has been made on isolated neurons and analog interconnects; nevertheless, this renewal has yet to produce a demonstration of a silicon photonic neuron capable of interacting with other like neurons. We report a modulator-class photonic neuron fabricated in a conventional silicon photonic process line. We demonstrate behaviors of transfer function configurability, fan-in, inhibition, time-resolved processing, and, crucially, autaptic cascadability -- a sufficient set of behaviors for a device to act as a neuron participating in a network of like neurons. The silicon photonic modulator neuron constitutes the final piece needed to make photonic neural networks fully integrated on currently available silicon photonic platforms.
△ Less
Submitted 9 December, 2018;
originally announced December 2018.
-
Principles of Neuromorphic Photonics
Authors:
Bhavin J. Shastri,
Alexander N. Tait,
Thomas Ferreira de Lima,
Mitchell A. Nahmias,
Hsuan-Tung Peng,
Paul R. Prucnal
Abstract:
In an age overrun with information, the ability to process reams of data has become crucial. The demand for data will continue to grow as smart gadgets multiply and become increasingly integrated into our daily lives. Next-generation industries in artificial intelligence services and high-performance computing are so far supported by microelectronic platforms. These data-intensive enterprises rely…
▽ More
In an age overrun with information, the ability to process reams of data has become crucial. The demand for data will continue to grow as smart gadgets multiply and become increasingly integrated into our daily lives. Next-generation industries in artificial intelligence services and high-performance computing are so far supported by microelectronic platforms. These data-intensive enterprises rely on continual improvements in hardware. Their prospects are running up against a stark reality: conventional one-size-fits-all solutions offered by digital electronics can no longer satisfy this need, as Moore's law (exponential hardware scaling), interconnection density, and the von Neumann architecture reach their limits.
With its superior speed and reconfigurability, analog photonics can provide some relief to these problems; however, complex applications of analog photonics have remained largely unexplored due to the absence of a robust photonic integration industry. Recently, the landscape for commercially-manufacturable photonic chips has been changing rapidly and now promises to achieve economies of scale previously enjoyed solely by microelectronics.
The scientific community has set out to build bridges between the domains of photonic device physics and neural networks, giving rise to the field of \emph{neuromorphic photonics}. This article reviews the recent progress in integrated neuromorphic photonics. We provide an overview of neuromorphic computing, discuss the associated technology (microelectronic and photonic) platforms and compare their metric performance. We discuss photonic neural network approaches and challenges for integrated neuromorphic photonic processors while providing an in-depth description of photonic neurons and a candidate interconnection architecture. We conclude with a future outlook of neuro-inspired photonic processing.
△ Less
Submitted 29 December, 2017;
originally announced January 2018.
-
Neuromorphic Silicon Photonic Networks
Authors:
Alexander N. Tait,
Thomas Ferreira de Lima,
Ellen Zhou,
Allie X. Wu,
Mitchell A. Nahmias,
Bhavin J. Shastri,
Paul R. Prucnal
Abstract:
Photonic systems for high-performance information processing have attracted renewed interest. Neuromorphic silicon photonics has the potential to integrate processing functions that vastly exceed the capabilities of electronics. We report first observations of a recurrent silicon photonic neural network, in which connections are configured by microring weight banks. A mathematical isomorphism betw…
▽ More
Photonic systems for high-performance information processing have attracted renewed interest. Neuromorphic silicon photonics has the potential to integrate processing functions that vastly exceed the capabilities of electronics. We report first observations of a recurrent silicon photonic neural network, in which connections are configured by microring weight banks. A mathematical isomorphism between the silicon photonic circuit and a continuous neural network model is demonstrated through dynamical bifurcation analysis. Exploiting this isomorphism, a simulated 24-node silicon photonic neural network is programmed using "neural compiler" to solve a differential system emulation task. A 294-fold acceleration against a conventional benchmark is predicted. We also propose and derive power consumption analysis for modulator-class neurons that, as opposed to laser-class neurons, are compatible with silicon photonic platforms. At increased scale, Neuromorphic silicon photonics could access new regimes of ultrafast information processing for radio, control, and scientific computing.
△ Less
Submitted 12 June, 2017; v1 submitted 4 November, 2016;
originally announced November 2016.
-
Dynamical laser spike processing
Authors:
Bhavin J. Shastri,
Mitchell A. Nahmias,
Alexander N. Tait,
Alejandro W. Rodriguez,
Ben Wu,
Paul R. Prucnal
Abstract:
Novel materials and devices in photonics have the potential to revolutionize optical information processing, beyond conventional binary-logic approaches. Laser systems offer a rich repertoire of useful dynamical behaviors, including the excitable dynamics also found in the time-resolved "spiking" of neurons. Spiking reconciles the expressiveness and efficiency of analog processing with the robustn…
▽ More
Novel materials and devices in photonics have the potential to revolutionize optical information processing, beyond conventional binary-logic approaches. Laser systems offer a rich repertoire of useful dynamical behaviors, including the excitable dynamics also found in the time-resolved "spiking" of neurons. Spiking reconciles the expressiveness and efficiency of analog processing with the robustness and scalability of digital processing. We demonstrate that graphene-coupled laser systems offer a unified low-level spike optical processing paradigm that goes well beyond previously studied laser dynamics. We show that this platform can simultaneously exhibit logic-level restoration, cascadability and input-output isolation---fundamental challenges in optical information processing. We also implement low-level spike-processing tasks that are critical for higher level processing: temporal pattern detection and stable recurrent memory. We study these properties in the context of a fiber laser system, but the addition of graphene leads to a number of advantages which stem from its unique properties, including high absorption and fast carrier relaxation. These could lead to significant speed and efficiency improvements in unconventional laser processing devices, and ongoing research on graphene microfabrication promises compatibility with integrated laser platforms.
△ Less
Submitted 23 July, 2015;
originally announced July 2015.
-
SIMPEL: Circuit model for photonic spike processing laser neurons
Authors:
Bhavin J. Shastri,
Mitchell A. Nahmias,
Alexander N. Tait,
Ben Wu,
Paul R. Prucnal
Abstract:
We propose an equivalent circuit model for photonic spike processing laser neurons with an embedded saturable absorber---a simulation model for photonic excitable lasers (SIMPEL). We show that by map** the laser neuron rate equations into a circuit model, SPICE analysis can be used as an efficient and accurate engine for numerical calculations, capable of generalization to a variety of different…
▽ More
We propose an equivalent circuit model for photonic spike processing laser neurons with an embedded saturable absorber---a simulation model for photonic excitable lasers (SIMPEL). We show that by map** the laser neuron rate equations into a circuit model, SPICE analysis can be used as an efficient and accurate engine for numerical calculations, capable of generalization to a variety of different laser neuron types found in literature. The development of this model parallels the Hodgkin--Huxley model of neuron biophysics, a circuit framework which brought efficiency, modularity, and generalizability to the study of neural dynamics. We employ the model to study various signal-processing effects such as excitability with excitatory and inhibitory pulses, binary all-or-nothing response, and bistable dynamics.
△ Less
Submitted 24 September, 2014;
originally announced September 2014.
-
Photonic spike processing: ultrafast laser neurons and an integrated photonic network
Authors:
Bhavin J. Shastri,
Alexander N. Tait,
Mitchell A. Nahmias,
Paul R. Prucnal
Abstract:
The marriage of two vibrant fields---photonics and neuromorphic processing---is fundamentally enabled by the strong analogies within the underlying physics between the dynamics of biological neurons and lasers, both of which can be understood within the framework of nonlinear dynamical systems theory. Whereas neuromorphic engineering exploits the biophysics of neuronal computation algorithms to pr…
▽ More
The marriage of two vibrant fields---photonics and neuromorphic processing---is fundamentally enabled by the strong analogies within the underlying physics between the dynamics of biological neurons and lasers, both of which can be understood within the framework of nonlinear dynamical systems theory. Whereas neuromorphic engineering exploits the biophysics of neuronal computation algorithms to provide a wide range of computing and signal processing applications, photonics offer an alternative approach to neuromorphic systems by exploiting the high speed, high bandwidth, and low crosstalk available to photonic interconnects which potentially grants the capacity for complex, ultrafast categorization and decision-making. Here we highlight some recent progress on this exciting field.
△ Less
Submitted 8 July, 2014;
originally announced July 2014.
