Showing 1–41 of 41 results for author: Jarrahi, M

Multiplane Quantitative Phase Imaging Using a Wavelength-Multiplexed Diffractive Optical Processor

Authors: Che-Yung Shen, **gxi Li, Tianyi Gan, Yuhang Li, Langxing Bai, Mona Jarrahi, Aydogan Ozcan

Abstract: Quantitative phase imaging (QPI) is a label-free technique that provides optical path length information for transparent specimens, finding utility in biology, materials science, and engineering. Here, we present quantitative phase imaging of a 3D stack of phase-only objects using a wavelength-multiplexed diffractive optical processor. Utilizing multiple spatially engineered diffractive layers tra… ▽ More Quantitative phase imaging (QPI) is a label-free technique that provides optical path length information for transparent specimens, finding utility in biology, materials science, and engineering. Here, we present quantitative phase imaging of a 3D stack of phase-only objects using a wavelength-multiplexed diffractive optical processor. Utilizing multiple spatially engineered diffractive layers trained through deep learning, this diffractive processor can transform the phase distributions of multiple 2D objects at various axial positions into intensity patterns, each encoded at a unique wavelength channel. These wavelength-multiplexed patterns are projected onto a single field-of-view (FOV) at the output plane of the diffractive processor, enabling the capture of quantitative phase distributions of input objects located at different axial planes using an intensity-only image sensor. Based on numerical simulations, we show that our diffractive processor could simultaneously achieve all-optical quantitative phase imaging across several distinct axial planes at the input by scanning the illumination wavelength. A proof-of-concept experiment with a 3D-fabricated diffractive processor further validated our approach, showcasing successful imaging of two distinct phase objects at different axial positions by scanning the illumination wavelength in the terahertz spectrum. Diffractive network-based multiplane QPI designs can open up new avenues for compact on-chip phase imaging and sensing devices. △ Less

Submitted 16 March, 2024; originally announced March 2024.

Comments: 27 Pages, 9 Figures

Joint Source-Channel Coding for Wireless Image Transmission: A Deep Compressed-Sensing Based Method

Authors: Mohammad Amin Jarrahi, Eirina Bourtsoulatze, Vahid Abolghasemi

Abstract: Nowadays, the demand for image transmission over wireless networks has surged significantly. To meet the need for swift delivery of high-quality images through time-varying channels with limited bandwidth, the development of efficient transmission strategies and techniques for preserving image quality is of importance. This paper introduces an innovative approach to Joint Source-Channel Coding (JS… ▽ More Nowadays, the demand for image transmission over wireless networks has surged significantly. To meet the need for swift delivery of high-quality images through time-varying channels with limited bandwidth, the development of efficient transmission strategies and techniques for preserving image quality is of importance. This paper introduces an innovative approach to Joint Source-Channel Coding (JSCC) tailored for wireless image transmission. It capitalizes on the power of Compressed Sensing (CS) to achieve superior compression and resilience to channel noise. In this method, the process begins with the compression of images using a block-based CS technique implemented through a Convolutional Neural Network (CNN) structure. Subsequently, the images are encoded by directly map** image blocks to complex-valued channel input symbols. Upon reception, the data is decoded to recover the channel-encoded information, effectively removing the noise introduced during transmission. To finalize the process, a novel CNN-based reconstruction network is employed to restore the original image from the channel-decoded data. The performance of the proposed method is assessed using the CIFAR-10 and Kodak datasets. The results illustrate a substantial improvement over existing JSCC frameworks when assessed in terms of metrics such as Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index (SSIM) across various channel Signal-to-Noise Ratios (SNRs) and channel bandwidth values. These findings underscore the potential of harnessing CNN-based CS for the development of deep JSCC algorithms tailored for wireless image transmission. △ Less

Submitted 11 February, 2024; originally announced February 2024.

Multiplexed all-optical permutation operations using a reconfigurable diffractive optical network

Authors: Guangdong Ma, Xilin Yang, Bijie Bai, **gxi Li, Yuhang Li, Tianyi Gan, Che-Yung Shen, Yijie Zhang, Yuzhu Li, Mona Jarrahi, Aydogan Ozcan

Abstract: Large-scale and high-dimensional permutation operations are important for various applications in e.g., telecommunications and encryption. Here, we demonstrate the use of all-optical diffractive computing to execute a set of high-dimensional permutation operations between an input and output field-of-view through layer rotations in a diffractive optical network. In this reconfigurable multiplexed… ▽ More Large-scale and high-dimensional permutation operations are important for various applications in e.g., telecommunications and encryption. Here, we demonstrate the use of all-optical diffractive computing to execute a set of high-dimensional permutation operations between an input and output field-of-view through layer rotations in a diffractive optical network. In this reconfigurable multiplexed material designed by deep learning, every diffractive layer has four orientations: 0, 90, 180, and 270 degrees. Each unique combination of these rotatable layers represents a distinct rotation state of the diffractive design tailored for a specific permutation operation. Therefore, a K-layer rotatable diffractive material is capable of all-optically performing up to 4^K independent permutation operations. The original input information can be decrypted by applying the specific inverse permutation matrix to output patterns, while applying other inverse operations will lead to loss of information. We demonstrated the feasibility of this reconfigurable multiplexed diffractive design by approximating 256 randomly selected permutation matrices using K=4 rotatable diffractive layers. We also experimentally validated this reconfigurable diffractive network using terahertz radiation and 3D-printed diffractive layers, providing a decent match to our numerical results. The presented rotation-multiplexed diffractive processor design is particularly useful due to its mechanical reconfigurability, offering multifunctional representation through a single fabrication process. △ Less

Submitted 4 February, 2024; originally announced February 2024.

Comments: 37 Pages, 10 Figures

All-optical complex field imaging using diffractive processors

Authors: **gxi Li, Yuhang Li, Tianyi Gan, Che-Yung Shen, Mona Jarrahi, Aydogan Ozcan

Abstract: Complex field imaging, which captures both the amplitude and phase information of input optical fields or objects, can offer rich structural insights into samples, such as their absorption and refractive index distributions. However, conventional image sensors are intensity-based and inherently lack the capability to directly measure the phase distribution of a field. This limitation can be overco… ▽ More Complex field imaging, which captures both the amplitude and phase information of input optical fields or objects, can offer rich structural insights into samples, such as their absorption and refractive index distributions. However, conventional image sensors are intensity-based and inherently lack the capability to directly measure the phase distribution of a field. This limitation can be overcome using interferometric or holographic methods, often supplemented by iterative phase retrieval algorithms, leading to a considerable increase in hardware complexity and computational demand. Here, we present a complex field imager design that enables snapshot imaging of both the amplitude and quantitative phase information of input fields using an intensity-based sensor array without any digital processing. Our design utilizes successive deep learning-optimized diffractive surfaces that are structured to collectively modulate the input complex field, forming two independent imaging channels that perform amplitude-to-amplitude and phase-to-intensity transformations between the input and output planes within a compact optical design, axially spanning ~100 wavelengths. The intensity distributions of the output fields at these two channels on the sensor plane directly correspond to the amplitude and quantitative phase profiles of the input complex field, eliminating the need for any digital image reconstruction algorithms. We experimentally validated the efficacy of our complex field diffractive imager designs through 3D-printed prototypes operating at the terahertz spectrum, with the output amplitude and phase channel images closely aligning with our numerical simulations. We envision that this complex field imager will have various applications in security, biomedical imaging, sensing and material science, among others. △ Less

Submitted 30 January, 2024; originally announced January 2024.

Comments: 25 Pages, 6 Figures

Journal ref: Light: Science & Applications (2024)

Subwavelength Imaging using a Solid-Immersion Diffractive Optical Processor

Authors: **gtian Hu, Kun Liao, Niyazi Ulas Dinc, Carlo Gigli, Bijie Bai, Tianyi Gan, Xurong Li, Hanlong Chen, Xilin Yang, Yuhang Li, Cagatay Isil, Md Sadman Sakib Rahman, **gxi Li, Xiaoyong Hu, Mona Jarrahi, Demetri Psaltis, Aydogan Ozcan

Abstract: Phase imaging is widely used in biomedical imaging, sensing, and material characterization, among other fields. However, direct imaging of phase objects with subwavelength resolution remains a challenge. Here, we demonstrate subwavelength imaging of phase and amplitude objects based on all-optical diffractive encoding and decoding. To resolve subwavelength features of an object, the diffractive im… ▽ More Phase imaging is widely used in biomedical imaging, sensing, and material characterization, among other fields. However, direct imaging of phase objects with subwavelength resolution remains a challenge. Here, we demonstrate subwavelength imaging of phase and amplitude objects based on all-optical diffractive encoding and decoding. To resolve subwavelength features of an object, the diffractive imager uses a thin, high-index solid-immersion layer to transmit high-frequency information of the object to a spatially-optimized diffractive encoder, which converts/encodes high-frequency information of the input into low-frequency spatial modes for transmission through air. The subsequent diffractive decoder layers (in air) are jointly designed with the encoder using deep-learning-based optimization, and communicate with the encoder layer to create magnified images of input objects at its output, revealing subwavelength features that would otherwise be washed away due to diffraction limit. We demonstrate that this all-optical collaboration between a diffractive solid-immersion encoder and the following decoder layers in air can resolve subwavelength phase and amplitude features of input objects in a highly compact design. To experimentally demonstrate its proof-of-concept, we used terahertz radiation and developed a fabrication method for creating monolithic multi-layer diffractive processors. Through these monolithically fabricated diffractive encoder-decoder pairs, we demonstrated phase-to-intensity transformations and all-optically reconstructed subwavelength phase features of input objects by directly transforming them into magnified intensity features at the output. This solid-immersion-based diffractive imager, with its compact and cost-effective design, can find wide-ranging applications in bioimaging, endoscopy, sensing and materials characterization. △ Less

Submitted 16 January, 2024; originally announced January 2024.

Comments: 32 Pages, 9 Figures

Journal ref: eLight (2024)

Information hiding cameras: optical concealment of object information into ordinary images

Authors: Bijie Bai, Ryan Lee, Yuhang Li, Tianyi Gan, Yuntian Wang, Mona Jarrahi, Aydogan Ozcan

Abstract: Data protection methods like cryptography, despite being effective, inadvertently signal the presence of secret communication, thereby drawing undue attention. Here, we introduce an optical information hiding camera integrated with an electronic decoder, optimized jointly through deep learning. This information hiding-decoding system employs a diffractive optical processor as its front-end, which… ▽ More Data protection methods like cryptography, despite being effective, inadvertently signal the presence of secret communication, thereby drawing undue attention. Here, we introduce an optical information hiding camera integrated with an electronic decoder, optimized jointly through deep learning. This information hiding-decoding system employs a diffractive optical processor as its front-end, which transforms and hides input images in the form of ordinary-looking patterns that deceive/mislead human observers. This information hiding transformation is valid for infinitely many combinations of secret messages, all of which are transformed into ordinary-looking output patterns, achieved all-optically through passive light-matter interactions within the optical processor. By processing these ordinary-looking output images, a jointly-trained electronic decoder neural network accurately reconstructs the original information hidden within the deceptive output pattern. We numerically demonstrated our approach by designing an information hiding diffractive camera along with a jointly-optimized convolutional decoder neural network. The efficacy of this system was demonstrated under various lighting conditions and noise levels, showing its robustness. We further extended this information hiding camera to multi-spectral operation, allowing the concealment and decoding of multiple images at different wavelengths, all performed simultaneously in a single feed-forward operation. The feasibility of our framework was also demonstrated experimentally using THz radiation. This optical encoder-electronic decoder-based co-design provides a novel information hiding camera interface that is both high-speed and energy-efficient, offering an intriguing solution for visual information security. △ Less

Submitted 15 January, 2024; originally announced January 2024.

Comments: 26 Pages, 8 Figures

Journal ref: Science Advances (2024)

Short-term memory effects in the phototactic behavior of microalgae

Authors: Taha Laroussi, Mojtaba Jarrahi, Gabriel Amselem

Abstract: Phototaxis, the directed motion in response to a light stimulus, is crucial for motile microorganisms that rely on photosynthesis, such as the unicellular microalga Chlamydomonas reinhardtii. It is well known that microalgae adapt to ambient light stimuli. On time scales of several dozen minutes, when stimulated long enough, the response of the microalga evolves as if the light intensity were decr… ▽ More Phototaxis, the directed motion in response to a light stimulus, is crucial for motile microorganisms that rely on photosynthesis, such as the unicellular microalga Chlamydomonas reinhardtii. It is well known that microalgae adapt to ambient light stimuli. On time scales of several dozen minutes, when stimulated long enough, the response of the microalga evolves as if the light intensity were decreasing (Mayer, Nature 1968). Here, we show experimentally that microalgae also have a short-term memory, on the time scale of a couple of minutes, which is the opposite of adaptation. At these short time scales, when stimulated consecutively, the response of C. reinhardtii evolves as if the light intensity were increasing. Our experimental results are rationalized by the introduction of a simplified model of phototaxis. Memory comes from the interplay between an internal biochemical time scale and the time scale of the stimulus; as such, these memory effects are likely to be widespread in phototactic microorganisms. △ Less

Submitted 20 March, 2024; v1 submitted 18 December, 2023; originally announced December 2023.

Comments: 22 pages, 23 figures

All-Optical Phase Conjugation Using Diffractive Wavefront Processing

Authors: Che-Yung Shen, **gxi Li, Tianyi Gan, Mona Jarrahi, Aydogan Ozcan

Abstract: Optical phase conjugation (OPC) is a nonlinear technique used for counteracting wavefront distortions, with various applications ranging from imaging to beam focusing. Here, we present the design of a diffractive wavefront processor to approximate all-optical phase conjugation operation for input fields with phase aberrations. Leveraging deep learning, a set of passive diffractive layers was optim… ▽ More Optical phase conjugation (OPC) is a nonlinear technique used for counteracting wavefront distortions, with various applications ranging from imaging to beam focusing. Here, we present the design of a diffractive wavefront processor to approximate all-optical phase conjugation operation for input fields with phase aberrations. Leveraging deep learning, a set of passive diffractive layers was optimized to all-optically process an arbitrary phase-aberrated coherent field from an input aperture, producing an output field with a phase distribution that is the conjugate of the input wave. We experimentally validated the efficacy of this wavefront processor by 3D fabricating diffractive layers trained using deep learning and performing OPC on phase distortions never seen by the diffractive processor during its training. Employing terahertz radiation, our physical diffractive processor successfully performed the OPC task through a shallow spatially-engineered volume that axially spans tens of wavelengths. In addition to this transmissive OPC configuration, we also created a diffractive phase-conjugate mirror by combining deep learning-optimized diffractive layers with a standard mirror. Given its compact, passive and scalable nature, our diffractive wavefront processor can be used for diverse OPC-related applications, e.g., turbidity suppression and aberration correction, and is also adaptable to different parts of the electromagnetic spectrum, especially those where cost-effective wavefront engineering solutions do not exist. △ Less

Submitted 8 November, 2023; originally announced November 2023.

Comments: 34 Pages, 9 Figures

Journal ref: Nature Communications (2024)

All-optical image denoising using a diffractive visual processor

Authors: Cagatay Isıl, Tianyi Gan, F. Onuralp Ardic, Koray Mentesoglu, Jagrit Digani, Huseyin Karaca, Hanlong Chen, **gxi Li, Deniz Mengu, Mona Jarrahi, Kaan Akşit, Aydogan Ozcan

Abstract: Image denoising, one of the essential inverse problems, targets to remove noise/artifacts from input images. In general, digital image denoising algorithms, executed on computers, present latency due to several iterations implemented in, e.g., graphics processing units (GPUs). While deep learning-enabled methods can operate non-iteratively, they also introduce latency and impose a significant comp… ▽ More Image denoising, one of the essential inverse problems, targets to remove noise/artifacts from input images. In general, digital image denoising algorithms, executed on computers, present latency due to several iterations implemented in, e.g., graphics processing units (GPUs). While deep learning-enabled methods can operate non-iteratively, they also introduce latency and impose a significant computational burden, leading to increased power consumption. Here, we introduce an analog diffractive image denoiser to all-optically and non-iteratively clean various forms of noise and artifacts from input images - implemented at the speed of light propagation within a thin diffractive visual processor. This all-optical image denoiser comprises passive transmissive layers optimized using deep learning to physically scatter the optical modes that represent various noise features, causing them to miss the output image Field-of-View (FoV) while retaining the object features of interest. Our results show that these diffractive denoisers can efficiently remove salt and pepper noise and image rendering-related spatial artifacts from input phase or intensity images while achieving an output power efficiency of ~30-40%. We experimentally demonstrated the effectiveness of this analog denoiser architecture using a 3D-printed diffractive visual processor operating at the terahertz spectrum. Owing to their speed, power-efficiency, and minimal computational overhead, all-optical diffractive denoisers can be transformative for various image display and projection systems, including, e.g., holographic displays. △ Less

Submitted 17 September, 2023; originally announced September 2023.

Comments: 21 Pages, 7 Figures

Journal ref: Light: Science & Applications (2024)

Pyramid diffractive optical networks for unidirectional magnification and demagnification

Authors: Bijie Bai, Xilin Yang, Tianyi Gan, **gxi Li, Deniz Mengu, Mona Jarrahi, Aydogan Ozcan

Abstract: Diffractive deep neural networks (D2NNs) are composed of successive transmissive layers optimized using supervised deep learning to all-optically implement various computational tasks between an input and output field-of-view (FOV). Here, we present a pyramid-structured diffractive optical network design (which we term P-D2NN), optimized specifically for unidirectional image magnification and dema… ▽ More Diffractive deep neural networks (D2NNs) are composed of successive transmissive layers optimized using supervised deep learning to all-optically implement various computational tasks between an input and output field-of-view (FOV). Here, we present a pyramid-structured diffractive optical network design (which we term P-D2NN), optimized specifically for unidirectional image magnification and demagnification. In this P-D2NN design, the diffractive layers are pyramidally scaled in alignment with the direction of the image magnification or demagnification. Our analyses revealed the efficacy of this P-D2NN design in unidirectional image magnification and demagnification tasks, producing high-fidelity magnified or demagnified images in only one direction, while inhibiting the image formation in the opposite direction - confirming the desired unidirectional imaging operation. Compared to the conventional D2NN designs with uniform-sized successive diffractive layers, P-D2NN design achieves similar performance in unidirectional magnification tasks using only half of the diffractive degrees of freedom within the optical processor volume. Furthermore, it maintains its unidirectional image magnification/demagnification functionality across a large band of illumination wavelengths despite being trained with a single illumination wavelength. With this pyramidal architecture, we also designed a wavelength-multiplexed diffractive network, where a unidirectional magnifier and a unidirectional demagnifier operate simultaneously in opposite directions, at two distinct illumination wavelengths. The efficacy of the P-D2NN architecture was also validated experimentally using monochromatic terahertz illumination, successfully matching our numerical simulations. P-D2NN offers a physics-inspired strategy for designing task-specific visual processors. △ Less

Submitted 29 August, 2023; originally announced August 2023.

Comments: 26 Pages, 7 Figures

Plasmonic photoconductive terahertz focal-plane array with pixel super-resolution

Authors: Xurong Li, Deniz Mengu, Aydogan Ozcan, Mona Jarrahi

Abstract: Imaging systems operating in the terahertz part of the electromagnetic spectrum are in great demand because of the distinct characteristics of terahertz waves in penetrating many optically-opaque materials and providing unique spectral signatures of various chemicals. However, the use of terahertz imagers in real-world applications has been limited by the slow speed, large size, high cost, and com… ▽ More Imaging systems operating in the terahertz part of the electromagnetic spectrum are in great demand because of the distinct characteristics of terahertz waves in penetrating many optically-opaque materials and providing unique spectral signatures of various chemicals. However, the use of terahertz imagers in real-world applications has been limited by the slow speed, large size, high cost, and complexity of the existing imaging systems. These limitations are mainly imposed due to the lack of terahertz focal-plane arrays (THz-FPAs) that can directly provide the frequency-resolved and/or time-resolved spatial information of the imaged objects. Here, we report the first THz-FPA that can directly provide the spatial amplitude and phase distributions, along with the ultrafast temporal and spectral information of an imaged object. It consists of a two-dimensional array of ~0.3 million plasmonic photoconductive nanoantennas optimized to rapidly detect broadband terahertz radiation with a high signal-to-noise ratio. As the first proof-of-concept, we utilized the multispectral nature of the amplitude and phase data captured by these plasmonic nanoantennas to realize pixel super-resolution imaging of objects. We successfully imaged and super-resolved etched patterns in a silicon substrate and reconstructed both the shape and depth of these structures with an effective number of pixels that exceeds 1-kilo pixels. By eliminating the need for raster scanning and spatial terahertz modulation, our THz-FPA offers more than a 1000-fold increase in the imaging speed compared to the state-of-the-art. Beyond this proof-of-concept super-resolution demonstration, the unique capabilities enabled by our plasmonic photoconductive THz-FPA offer transformative advances in a broad range of applications that use hyperspectral and three-dimensional terahertz images of objects for a wide range of applications. △ Less

Submitted 16 May, 2023; originally announced May 2023.

Comments: 62 pages

Journal ref: Nature Photonics (2024)

Broadband nonlinear modulation of incoherent light using a transparent optoelectronic neuron array

Authors: Dehui Zhang, Dong Xu, Yuhang Li, Yi Luo, **gtian Hu, **gxuan Zhou, Yucheng Zhang, Boxuan Zhou, Peiqi Wang, Xurong Li, Bijie Bai, Huaying Ren, Laiyuan Wang, Mona Jarrahi, Yu Huang, Aydogan Ozcan, Xiangfeng Duan

Abstract: Nonlinear optical processing of ambient natural light is highly desired in computational imaging and sensing applications. A strong optical nonlinear response that can work under weak broadband incoherent light is essential for this purpose. Here we introduce an optoelectronic nonlinear filter array that can address this emerging need. By merging 2D transparent phototransistors (TPTs) with liquid… ▽ More Nonlinear optical processing of ambient natural light is highly desired in computational imaging and sensing applications. A strong optical nonlinear response that can work under weak broadband incoherent light is essential for this purpose. Here we introduce an optoelectronic nonlinear filter array that can address this emerging need. By merging 2D transparent phototransistors (TPTs) with liquid crystal (LC) modulators, we create an optoelectronic neuron array that allows self-amplitude modulation of spatially incoherent light, achieving a large nonlinear contrast over a broad spectrum at orders-of-magnitude lower intensity than what is achievable in most optical nonlinear materials. For a proof-of-concept demonstration, we fabricated a 10,000-pixel array of optoelectronic neurons, each serving as a nonlinear filter, and experimentally demonstrated an intelligent imaging system that uses the nonlinear response to instantly reduce input glares while retaining the weaker-intensity objects within the field of view of a cellphone camera. This intelligent glare-reduction capability is important for various imaging applications, including autonomous driving, machine vision, and security cameras. Beyond imaging and sensing, this optoelectronic neuron array, with its rapid nonlinear modulation for processing incoherent broadband light, might also find applications in optical computing, where nonlinear activation functions that can work under ambient light conditions are highly sought. △ Less

Submitted 26 April, 2023; originally announced April 2023.

Comments: 20 Pages, 5 Figures

Journal ref: Nature Communications (2024)

Learning Diffractive Optical Communication Around Arbitrary Opaque Occlusions

Authors: Md Sadman Sakib Rahman, Tianyi Gan, Emir Arda Deger, Cagatay Isil, Mona Jarrahi, Aydogan Ozcan

Abstract: Free-space optical systems are emerging for high data rate communication and transfer of information in indoor and outdoor settings. However, free-space optical communication becomes challenging when an occlusion blocks the light path. Here, we demonstrate, for the first time, a direct communication scheme, passing optical information around a fully opaque, arbitrarily shaped obstacle that partial… ▽ More Free-space optical systems are emerging for high data rate communication and transfer of information in indoor and outdoor settings. However, free-space optical communication becomes challenging when an occlusion blocks the light path. Here, we demonstrate, for the first time, a direct communication scheme, passing optical information around a fully opaque, arbitrarily shaped obstacle that partially or entirely occludes the transmitter's field-of-view. In this scheme, an electronic neural network encoder and a diffractive optical network decoder are jointly trained using deep learning to transfer the optical information or message of interest around the opaque occlusion of an arbitrary shape. The diffractive decoder comprises successive spatially-engineered passive surfaces that process optical information through light-matter interactions. Following its training, the encoder-decoder pair can communicate any arbitrary optical information around opaque occlusions, where information decoding occurs at the speed of light propagation. For occlusions that change their size and/or shape as a function of time, the encoder neural network can be retrained to successfully communicate with the existing diffractive decoder, without changing the physical layer(s) already deployed. We also validate this framework experimentally in the terahertz spectrum using a 3D-printed diffractive decoder to communicate around a fully opaque occlusion. Scalable for operation in any wavelength regime, this scheme could be particularly useful in emerging high data-rate free-space communication systems. △ Less

Submitted 20 April, 2023; originally announced April 2023.

Comments: 23 Pages, 9 Figures

Journal ref: Nature Communications (2023)

Universal Polarization Transformations: Spatial programming of polarization scattering matrices using a deep learning-designed diffractive polarization transformer

Authors: Yuhang Li, **gxi Li, Yifan Zhao, Tianyi Gan, **gtian Hu, Mona Jarrahi, Aydogan Ozcan

Abstract: We demonstrate universal polarization transformers based on an engineered diffractive volume, which can synthesize a large set of arbitrarily-selected, complex-valued polarization scattering matrices between the polarization states at different positions within its input and output field-of-views (FOVs). This framework comprises 2D arrays of linear polarizers with diverse angles, which are positio… ▽ More We demonstrate universal polarization transformers based on an engineered diffractive volume, which can synthesize a large set of arbitrarily-selected, complex-valued polarization scattering matrices between the polarization states at different positions within its input and output field-of-views (FOVs). This framework comprises 2D arrays of linear polarizers with diverse angles, which are positioned between isotropic diffractive layers, each containing tens of thousands of diffractive features with optimizable transmission coefficients. We demonstrate that, after its deep learning-based training, this diffractive polarization transformer could successfully implement N_i x N_o = 10,000 different spatially-encoded polarization scattering matrices with negligible error within a single diffractive volume, where N_i and N_o represent the number of pixels in the input and output FOVs, respectively. We experimentally validated this universal polarization transformation framework in the terahertz part of the spectrum by fabricating wire-grid polarizers and integrating them with 3D-printed diffractive layers to form a physical polarization transformer operating at 0.75 mm wavelength. Through this set-up, we demonstrated an all-optical polarization permutation operation of spatially-varying polarization fields, and simultaneously implemented distinct spatially-encoded polarization scattering matrices between the input and output FOVs of a compact diffractive processor that axially spans 200 wavelengths. This framework opens up new avenues for develo** novel optical devices for universal polarization control, and may find various applications in, e.g., remote sensing, medical imaging, security, material inspection and machine vision. △ Less

Submitted 12 April, 2023; originally announced April 2023.

Comments: 33 Pages, 7 Figures

Journal ref: Advanced Materials (2023)

Optical information transfer through random unknown diffusers using electronic encoding and diffractive decoding

Authors: Yuhang Li, Tianyi Gan, Bijie Bai, Cagatay Isil, Mona Jarrahi, Aydogan Ozcan

Abstract: Free-space optical information transfer through diffusive media is critical in many applications, such as biomedical devices and optical communication, but remains challenging due to random, unknown perturbations in the optical path. In this work, we demonstrate an optical diffractive decoder with electronic encoding to accurately transfer the optical information of interest, corresponding to, e.g… ▽ More Free-space optical information transfer through diffusive media is critical in many applications, such as biomedical devices and optical communication, but remains challenging due to random, unknown perturbations in the optical path. In this work, we demonstrate an optical diffractive decoder with electronic encoding to accurately transfer the optical information of interest, corresponding to, e.g., any arbitrary input object or message, through unknown random phase diffusers along the optical path. This hybrid electronic-optical model, trained using supervised learning, comprises a convolutional neural network (CNN) based electronic encoder and successive passive diffractive layers that are jointly optimized. After their joint training using deep learning, our hybrid model can transfer optical information through unknown phase diffusers, demonstrating generalization to new random diffusers never seen before. The resulting electronic-encoder and the optical-decoder model were experimentally validated using a 3D-printed diffractive network that axially spans less than 70 x lambda, where lambda = 0.75 mm is the illumination wavelength in the terahertz spectrum, carrying the desired optical information through random unknown diffusers. The presented framework can be physically scaled to operate at different parts of the electromagnetic spectrum, without retraining its components, and would offer low-power and compact solutions for optical information transfer in free space through unknown random diffusive media. △ Less

Submitted 30 March, 2023; originally announced March 2023.

Comments: 32 Pages, 9 Figures

Journal ref: Advanced Photonics (2023)

Rapid Sensing of Hidden Objects and Defects using a Single-Pixel Diffractive Terahertz Processor

Authors: **gxi Li, Xurong Li, Nezih T. Yardimci, **gtian Hu, Yuhang Li, Junjie Chen, Yi-Chun Hung, Mona Jarrahi, Aydogan Ozcan

Abstract: Terahertz waves offer numerous advantages for the nondestructive detection of hidden objects/defects in materials, as they can penetrate through most optically-opaque materials. However, existing terahertz inspection systems are restricted in their throughput and accuracy (especially for detecting small features) due to their limited speed and resolution. Furthermore, machine vision-based continuo… ▽ More Terahertz waves offer numerous advantages for the nondestructive detection of hidden objects/defects in materials, as they can penetrate through most optically-opaque materials. However, existing terahertz inspection systems are restricted in their throughput and accuracy (especially for detecting small features) due to their limited speed and resolution. Furthermore, machine vision-based continuous sensing systems that use large-pixel-count imaging are generally bottlenecked due to their digital storage, data transmission and image processing requirements. Here, we report a diffractive processor that rapidly detects hidden defects/objects within a target sample using a single-pixel spectroscopic terahertz detector, without scanning the sample or forming/processing its image. This terahertz processor consists of passive diffractive layers that are optimized using deep learning to modify the spectrum of the terahertz radiation according to the absence/presence of hidden structures or defects. After its fabrication, the resulting diffractive processor all-optically probes the structural information of the sample volume and outputs a spectrum that directly indicates the presence or absence of hidden structures, not visible from outside. As a proof-of-concept, we trained a diffractive terahertz processor to sense hidden defects (including subwavelength features) inside test samples, and evaluated its performance by analyzing the detection sensitivity as a function of the size and position of the unknown defects. We validated its feasibility using a single-pixel terahertz time-domain spectroscopy setup and 3D-printed diffractive layers, successfully detecting hidden defects using pulsed terahertz illumination. This technique will be valuable for various applications, e.g., security screening, biomedical sensing, quality control, anti-counterfeiting measures and cultural heritage protection. △ Less

Submitted 17 March, 2023; originally announced March 2023.

Comments: 23 Pages, 5 Figures

Journal ref: Nature Communications (2023)

Snapshot Multispectral Imaging Using a Diffractive Optical Network

Authors: Deniz Mengu, Anika Tabassum, Mona Jarrahi, Aydogan Ozcan

Abstract: Multispectral imaging has been used for numerous applications in e.g., environmental monitoring, aerospace, defense, and biomedicine. Here, we present a diffractive optical network-based multispectral imaging system trained using deep learning to create a virtual spectral filter array at the output image field-of-view. This diffractive multispectral imager performs spatially-coherent imaging over… ▽ More Multispectral imaging has been used for numerous applications in e.g., environmental monitoring, aerospace, defense, and biomedicine. Here, we present a diffractive optical network-based multispectral imaging system trained using deep learning to create a virtual spectral filter array at the output image field-of-view. This diffractive multispectral imager performs spatially-coherent imaging over a large spectrum, and at the same time, routes a pre-determined set of spectral channels onto an array of pixels at the output plane, converting a monochrome focal plane array or image sensor into a multispectral imaging device without any spectral filters or image recovery algorithms. Furthermore, the spectral responsivity of this diffractive multispectral imager is not sensitive to input polarization states. Through numerical simulations, we present different diffractive network designs that achieve snapshot multispectral imaging with 4, 9 and 16 unique spectral bands within the visible spectrum, based on passive spatially-structured diffractive surfaces, with a compact design that axially spans ~72 times the mean wavelength of the spectral band of interest. Moreover, we experimentally demonstrate a diffractive multispectral imager based on a 3D-printed diffractive network that creates at its output image plane a spatially-repeating virtual spectral filter array with 2x2=4 unique bands at terahertz spectrum. Due to their compact form factor and computation-free, power-efficient and polarization-insensitive forward operation, diffractive multispectral imagers can be transformative for various imaging and sensing applications and be used at different parts of the electromagnetic spectrum where high-density and wide-area multispectral pixel arrays are not widely available. △ Less

Submitted 10 December, 2022; originally announced December 2022.

Comments: 24 Pages, 9 Figures

Journal ref: Light: Science & Applications (2023)

Unidirectional Imaging using Deep Learning-Designed Materials

Authors: **gxi Li, Tianyi Gan, Yifan Zhao, Bijie Bai, Che-Yung Shen, Songyu Sun, Mona Jarrahi, Aydogan Ozcan

Abstract: A unidirectional imager would only permit image formation along one direction, from an input field-of-view (FOV) A to an output FOV B, and in the reverse path, the image formation would be blocked. Here, we report the first demonstration of unidirectional imagers, presenting polarization-insensitive and broadband unidirectional imaging based on successive diffractive layers that are linear and iso… ▽ More A unidirectional imager would only permit image formation along one direction, from an input field-of-view (FOV) A to an output FOV B, and in the reverse path, the image formation would be blocked. Here, we report the first demonstration of unidirectional imagers, presenting polarization-insensitive and broadband unidirectional imaging based on successive diffractive layers that are linear and isotropic. These diffractive layers are optimized using deep learning and consist of hundreds of thousands of diffractive phase features, which collectively modulate the incoming fields and project an intensity image of the input onto an output FOV, while blocking the image formation in the reverse direction. After their deep learning-based training, the resulting diffractive layers are fabricated to form a unidirectional imager. As a reciprocal device, the diffractive unidirectional imager has asymmetric mode processing capabilities in the forward and backward directions, where the optical modes from B to A are selectively guided/scattered to miss the output FOV, whereas for the forward direction such modal losses are minimized, yielding an ideal imaging system between the input and output FOVs. Although trained using monochromatic illumination, the diffractive unidirectional imager maintains its functionality over a large spectral band and works under broadband illumination. We experimentally validated this unidirectional imager using terahertz radiation, very well matching our numerical results. Using the same deep learning-based design strategy, we also created a wavelength-selective unidirectional imager, where two unidirectional imaging operations, in reverse directions, are multiplexed through different illumination wavelengths. Diffractive unidirectional imaging using structured materials will have numerous applications in e.g., security, defense, telecommunications and privacy protection. △ Less

Submitted 4 December, 2022; originally announced December 2022.

Comments: 27 Pages, 10 Figures

Journal ref: Science Advances (2023)

The Principles of Data-Centric AI (DCAI)

Authors: Mohammad Hossein Jarrahi, Ali Memariani, Shion Guha

Abstract: Data is a crucial infrastructure to how artificial intelligence (AI) systems learn. However, these systems to date have been largely model-centric, putting a premium on the model at the expense of the data quality. Data quality issues beset the performance of AI systems, particularly in downstream deployments and in real-world applications. Data-centric AI (DCAI) as an emerging concept brings data… ▽ More Data is a crucial infrastructure to how artificial intelligence (AI) systems learn. However, these systems to date have been largely model-centric, putting a premium on the model at the expense of the data quality. Data quality issues beset the performance of AI systems, particularly in downstream deployments and in real-world applications. Data-centric AI (DCAI) as an emerging concept brings data, its quality and its dynamism to the forefront in considerations of AI systems through an iterative and systematic approach. As one of the first overviews, this article brings together data-centric perspectives and concepts to outline the foundations of DCAI. It specifically formulates six guiding principles for researchers and practitioners and gives direction for future advancement of DCAI. △ Less

Submitted 12 March, 2024; v1 submitted 26 November, 2022; originally announced November 2022.

ACM Class: E.0; I.2

Journal ref: Communications of the ACM (2023)

Coherent terahertz radiation with 2.8-octave tunability through chip-scale photomixed microresonator optical parametric oscillation

Authors: Wenting Wang, **-Keng Lu, Abhinav Kumar Vinod, Deniz Turan, James McMillan, Hao Liu, Mingbin Yu, Dim-Lee Kwong, Mona Jarrahi, Chee Wei Wong

Abstract: High spectral purity frequency agile room temperature sources in the terahertz spectrum are foundational elements for imaging, sensing, metrology, and communications. Here we present a chip scale optical parametric oscillator based on an integrated nonlinear microresonator that provides broadly tunable single frequency and multi frequency oscillators in the terahertz regime. Through optical to ter… ▽ More High spectral purity frequency agile room temperature sources in the terahertz spectrum are foundational elements for imaging, sensing, metrology, and communications. Here we present a chip scale optical parametric oscillator based on an integrated nonlinear microresonator that provides broadly tunable single frequency and multi frequency oscillators in the terahertz regime. Through optical to terahertz down conversion using a plasmonic nanoantenna array, coherent terahertz radiation spanning 2.8 octaves is achieved from 330 GHz to 2.3 THz, with 20 GHz cavity mode limited frequency tuning step and 10 MHz intracavity mode continuous frequency tuning range at each step. By controlling the microresonator intracavity power and pump resonance detuning, tunable multi frequency terahertz oscillators are also realized. Furthermore, by stabilizing the microresonator pump power and wavelength, sub 100 Hz linewidth of the terahertz radiation with 10-15 residual frequency instability is demonstrated. The room temperature generation of both single frequency, frequency agile terahertz radiation and multi frequency terahertz oscillators in the chip scale platform offers unique capabilities in metrology, sensing, imaging and communications. △ Less

Submitted 15 August, 2022; originally announced August 2022.

Diffractive Interconnects: All-Optical Permutation Operation Using Diffractive Networks

Authors: Deniz Mengu, Yifan Zhao, Anika Tabassum, Mona Jarrahi, Aydogan Ozcan

Abstract: Permutation matrices form an important computational building block frequently used in various fields including e.g., communications, information security and data processing. Optical implementation of permutation operators with relatively large number of input-output interconnections based on power-efficient, fast, and compact platforms is highly desirable. Here, we present diffractive optical ne… ▽ More Permutation matrices form an important computational building block frequently used in various fields including e.g., communications, information security and data processing. Optical implementation of permutation operators with relatively large number of input-output interconnections based on power-efficient, fast, and compact platforms is highly desirable. Here, we present diffractive optical networks engineered through deep learning to all-optically perform permutation operations that can scale to hundreds of thousands of interconnections between an input and an output field-of-view using passive transmissive layers that are individually structured at the wavelength scale. Our findings indicate that the capacity of the diffractive optical network in approximating a given permutation operation increases proportional to the number of diffractive layers and trainable transmission elements in the system. Such deeper diffractive network designs can pose practical challenges in terms of physical alignment and output diffraction efficiency of the system. We addressed these challenges by designing misalignment tolerant diffractive designs that can all-optically perform arbitrarily-selected permutation operations, and experimentally demonstrated, for the first time, a diffractive permutation network that operates at THz part of the spectrum. Diffractive permutation networks might find various applications in e.g., security, image encryption and data processing, along with telecommunications; especially with the carrier frequencies in wireless communications approaching THz-bands, the presented diffractive permutation networks can potentially serve as channel routing and interconnection panels in wireless networks. △ Less

Submitted 21 June, 2022; originally announced June 2022.

Comments: 22 Pages, 6 Figures

Journal ref: Nanophotonics (2022)

Super-resolution image display using diffractive decoders

Authors: Cagatay Isil, Deniz Mengu, Yifan Zhao, Anika Tabassum, **gxi Li, Yi Luo, Mona Jarrahi, Aydogan Ozcan

Abstract: High-resolution synthesis/projection of images over a large field-of-view (FOV) is hindered by the restricted space-bandwidth-product (SBP) of wavefront modulators. We report a deep learning-enabled diffractive display design that is based on a jointly-trained pair of an electronic encoder and a diffractive optical decoder to synthesize/project super-resolved images using low-resolution wavefront… ▽ More High-resolution synthesis/projection of images over a large field-of-view (FOV) is hindered by the restricted space-bandwidth-product (SBP) of wavefront modulators. We report a deep learning-enabled diffractive display design that is based on a jointly-trained pair of an electronic encoder and a diffractive optical decoder to synthesize/project super-resolved images using low-resolution wavefront modulators. The digital encoder, composed of a trained convolutional neural network (CNN), rapidly pre-processes the high-resolution images of interest so that their spatial information is encoded into low-resolution (LR) modulation patterns, projected via a low SBP wavefront modulator. The diffractive decoder processes this LR encoded information using thin transmissive layers that are structured using deep learning to all-optically synthesize and project super-resolved images at its output FOV. Our results indicate that this diffractive image display can achieve a super-resolution factor of ~4, demonstrating a ~16-fold increase in SBP. We also experimentally validate the success of this diffractive super-resolution display using 3D-printed diffractive decoders that operate at the THz spectrum. This diffractive image decoder can be scaled to operate at visible wavelengths and inspire the design of large FOV and high-resolution displays that are compact, low-power, and computationally efficient. △ Less

Submitted 14 June, 2022; originally announced June 2022.

Comments: 26 Pages, 9 Figures

Journal ref: Science Advances (2022)

To image, or not to image: Class-specific diffractive cameras with all-optical erasure of undesired objects

Authors: Bijie Bai, Yi Luo, Tianyi Gan, **gtian Hu, Yuhang Li, Yifan Zhao, Deniz Mengu, Mona Jarrahi, Aydogan Ozcan

Abstract: Privacy protection is a growing concern in the digital era, with machine vision techniques widely used throughout public and private settings. Existing methods address this growing problem by, e.g., encrypting camera images or obscuring/blurring the imaged information through digital algorithms. Here, we demonstrate a camera design that performs class-specific imaging of target objects with instan… ▽ More Privacy protection is a growing concern in the digital era, with machine vision techniques widely used throughout public and private settings. Existing methods address this growing problem by, e.g., encrypting camera images or obscuring/blurring the imaged information through digital algorithms. Here, we demonstrate a camera design that performs class-specific imaging of target objects with instantaneous all-optical erasure of other classes of objects. This diffractive camera consists of transmissive surfaces structured using deep learning to perform selective imaging of target classes of objects positioned at its input field-of-view. After their fabrication, the thin diffractive layers collectively perform optical mode filtering to accurately form images of the objects that belong to a target data class or group of classes, while instantaneously erasing objects of the other data classes at the output field-of-view. Using the same framework, we also demonstrate the design of class-specific permutation cameras, where the objects of a target data class are pixel-wise permuted for all-optical class-specific encryption, while the other objects are irreversibly erased from the output image. The success of class-specific diffractive cameras was experimentally demonstrated using terahertz (THz) waves and 3D-printed diffractive layers that selectively imaged only one class of the MNIST handwritten digit dataset, all-optically erasing the other handwritten digits. This diffractive camera design can be scaled to different parts of the electromagnetic spectrum, including, e.g., the visible and infrared wavelengths, to provide transformative opportunities for privacy-preserving digital cameras and task-specific data-efficient imaging. △ Less

Submitted 25 May, 2022; originally announced May 2022.

Comments: 31 Pages, 7 Figures

Journal ref: eLight (2022)

Computational Imaging Without a Computer: Seeing Through Random Diffusers at the Speed of Light

Authors: Yi Luo, Yifan Zhao, **gxi Li, Ege Cetintas, Yair Rivenson, Mona Jarrahi, Aydogan Ozcan

Abstract: Imaging through diffusers presents a challenging problem with various digital image reconstruction solutions demonstrated to date using computers. We present a computer-free, all-optical image reconstruction method to see through random diffusers at the speed of light. Using deep learning, a set of diffractive surfaces are designed/trained to all-optically reconstruct images of objects that are co… ▽ More Imaging through diffusers presents a challenging problem with various digital image reconstruction solutions demonstrated to date using computers. We present a computer-free, all-optical image reconstruction method to see through random diffusers at the speed of light. Using deep learning, a set of diffractive surfaces are designed/trained to all-optically reconstruct images of objects that are covered by random phase diffusers. We experimentally demonstrated this concept using coherent THz illumination and all-optically reconstructed objects distorted by unknown, random diffusers, never used during training. Unlike digital methods, all-optical diffractive reconstructions do not require power except for the illumination light. This diffractive solution to see through diffusers can be extended to other wavelengths, and might fuel various applications in biomedical imaging, astronomy, atmospheric sciences, oceanography, security, robotics, among others. △ Less

Submitted 14 July, 2021; originally announced July 2021.

Comments: 35 Pages, 7 Figures

Journal ref: eLight (2022)

Wavelength conversion through plasmon-coupled surface states

Authors: Deniz Turan, ** Keng Lu, Nezih T. Yardimci, Zhaoyu Liu, Liang Luo, Joong-Mok Park, Uttam Nandi, Jigang Wang, Sascha Preu, Mona Jarrahi

Abstract: Surface states generally degrade semiconductor device performance by raising the charge injection barrier height, introducing localized trap states, inducing surface leakage current, and altering the electric potential. Therefore, there has been an endless effort to use various surface passivation treatments to suppress the undesirable impacts of the surface states. We show that the giant built-in… ▽ More Surface states generally degrade semiconductor device performance by raising the charge injection barrier height, introducing localized trap states, inducing surface leakage current, and altering the electric potential. Therefore, there has been an endless effort to use various surface passivation treatments to suppress the undesirable impacts of the surface states. We show that the giant built-in electric field created by the surface states can be harnessed to enable passive wavelength conversion without utilizing any nonlinear optical phenomena. Photo-excited surface plasmons are coupled to the surface states to generate an electron gas, which is routed to a nanoantenna array through the giant electric field created by the surface states. The induced current on the nanoantennas, which contains mixing product of different optical frequency components, generates radiation at the beat frequencies of the incident photons. We utilize the unprecedented functionalities of plasmon-coupled surface states to demonstrate passive wavelength conversion of nanojoule optical pulses at a 1550 nm center wavelength to terahertz regime with record-high efficiencies that exceed nonlinear optical methods by 4-orders of magnitude. The presented scheme can be used for optical wavelength conversion to different parts of the electromagnetic spectrum ranging from microwave to infrared regimes by using appropriate optical beat frequencies. △ Less

Submitted 5 December, 2020; originally announced December 2020.

Comments: Manuscript: 8 pages, 4 figures Supplementary materials: 21 pages, 11 figures

Terahertz Pulse Sha** Using Diffractive Surfaces

Authors: Muhammed Veli, Deniz Mengu, Nezih T. Yardimci, Yi Luo, **gxi Li, Yair Rivenson, Mona Jarrahi, Aydogan Ozcan

Abstract: Recent advances in deep learning have been providing non-intuitive solutions to various inverse problems in optics. At the intersection of machine learning and optics, diffractive networks merge wave-optics with deep learning to design task-specific elements to all-optically perform various tasks such as object classification and machine vision. Here, we present a diffractive network, which is use… ▽ More Recent advances in deep learning have been providing non-intuitive solutions to various inverse problems in optics. At the intersection of machine learning and optics, diffractive networks merge wave-optics with deep learning to design task-specific elements to all-optically perform various tasks such as object classification and machine vision. Here, we present a diffractive network, which is used to shape an arbitrary broadband pulse into a desired optical waveform, forming a compact pulse engineering system. We experimentally demonstrate the synthesis of square pulses with different temporal-widths by manufacturing passive diffractive layers that collectively control both the spectral amplitude and the phase of an input terahertz pulse. Our results constitute the first demonstration of direct pulse sha** in terahertz spectrum, where a complex-valued spectral modulation function directly acts on terahertz frequencies. Furthermore, a Lego-like physical transfer learning approach is presented to illustrate pulse-width tunability by replacing part of an existing network with newly trained diffractive layers, demonstrating its modularity. This learning-based diffractive pulse engineering framework can find broad applications in e.g., communications, ultra-fast imaging and spectroscopy. △ Less

Submitted 20 November, 2020; v1 submitted 30 June, 2020; originally announced June 2020.

Comments: 27 pages, 6 figures

Journal ref: Nature Communications (2021)

Misalignment Resilient Diffractive Optical Networks

Authors: Deniz Mengu, Yifan Zhao, Nezih T. Yardimci, Yair Rivenson, Mona Jarrahi, Aydogan Ozcan

Abstract: As an optical machine learning framework, Diffractive Deep Neural Networks (D2NN) take advantage of data-driven training methods used in deep learning to devise light-matter interaction in 3D for performing a desired statistical inference task. Multi-layer optical object recognition platforms designed with this diffractive framework have been shown to generalize to unseen image data achieving e.g.… ▽ More As an optical machine learning framework, Diffractive Deep Neural Networks (D2NN) take advantage of data-driven training methods used in deep learning to devise light-matter interaction in 3D for performing a desired statistical inference task. Multi-layer optical object recognition platforms designed with this diffractive framework have been shown to generalize to unseen image data achieving e.g., >98% blind inference accuracy for hand-written digit classification. The multi-layer structure of diffractive networks offers significant advantages in terms of their diffraction efficiency, inference capability and optical signal contrast. However, the use of multiple diffractive layers also brings practical challenges for the fabrication and alignment of these diffractive systems for accurate optical inference. Here, we introduce and experimentally demonstrate a new training scheme that significantly increases the robustness of diffractive networks against 3D misalignments and fabrication tolerances in the physical implementation of a trained diffractive network. By modeling the undesired layer-to-layer misalignments in 3D as continuous random variables in the optical forward model, diffractive networks are trained to maintain their inference accuracy over a large range of misalignments; we term this diffractive network design as vaccinated D2NN (v-D2NN). We further extend this vaccination strategy to the training of diffractive networks that use differential detectors at the output plane as well as to jointly-trained hybrid (optical-electronic) networks to reveal that all of these diffractive designs improve their resilience to misalignments by taking into account possible 3D fabrication variations and displacements during their training phase. △ Less

Submitted 23 May, 2020; originally announced May 2020.

Comments: 15 Pages, 6 Figures

Journal ref: Nanophotonics (2020)

Spectrally-Encoded Single-Pixel Machine Vision Using Diffractive Networks

Authors: **gxi Li, Deniz Mengu, Nezih T. Yardimci, Yi Luo, Xurong Li, Muhammed Veli, Yair Rivenson, Mona Jarrahi, Aydogan Ozcan

Abstract: 3D engineering of matter has opened up new avenues for designing systems that can perform various computational tasks through light-matter interaction. Here, we demonstrate the design of optical networks in the form of multiple diffractive layers that are trained using deep learning to transform and encode the spatial information of objects into the power spectrum of the diffracted light, which ar… ▽ More 3D engineering of matter has opened up new avenues for designing systems that can perform various computational tasks through light-matter interaction. Here, we demonstrate the design of optical networks in the form of multiple diffractive layers that are trained using deep learning to transform and encode the spatial information of objects into the power spectrum of the diffracted light, which are used to perform optical classification of objects with a single-pixel spectroscopic detector. Using a time-domain spectroscopy setup with a plasmonic nanoantenna-based detector, we experimentally validated this machine vision framework at terahertz spectrum to optically classify the images of handwritten digits by detecting the spectral power of the diffracted light at ten distinct wavelengths, each representing one class/digit. We also report the coupling of this spectral encoding achieved through a diffractive optical network with a shallow electronic neural network, separately trained to reconstruct the images of handwritten digits based on solely the spectral information encoded in these ten distinct wavelengths within the diffracted light. These reconstructed images demonstrate task-specific image decompression and can also be cycled back as new inputs to the same diffractive network to improve its optical object classification. This unique machine vision framework merges the power of deep learning with the spatial and spectral processing capabilities of diffractive networks, and can also be extended to other spectral-domain measurement systems to enable new 3D imaging and sensing modalities integrated with spectrally encoded classification tasks performed through diffractive optical networks. △ Less

Submitted 26 March, 2021; v1 submitted 15 May, 2020; originally announced May 2020.

Comments: 21 pages, 5 figures, 1 table

Journal ref: Science Advances (2021)

Picosecond spin-orbit torque switching of ferrimagnets

Authors: Hao Wu, Deniz Turan, Quanjun Pan, Guanjie Wu, Seyed Armin Razavi, Nezih Tolga Yardimci, Zongzhi Zhang, Mona Jarrahi, Kang L. Wang

Abstract: Spintronics provides an efficient platform for realizing non-volatile memory and logic devices. In these systems, data is stored in the magnetization of magnetic materials, and magnetization is switched in the writing process. In conventional spintronic devices, ferromagnetic materials are used which have a magnetization dynamics timescale of around the nanoseconds, setting a limit for the switchi… ▽ More Spintronics provides an efficient platform for realizing non-volatile memory and logic devices. In these systems, data is stored in the magnetization of magnetic materials, and magnetization is switched in the writing process. In conventional spintronic devices, ferromagnetic materials are used which have a magnetization dynamics timescale of around the nanoseconds, setting a limit for the switching speed. Increasing the magnetization switching speed has been one of the challenges in spintronic research. In this work we take advantage of the ultrafast magnetization dynamics in ferrimagnetic materials instead of ferromagnets, and we use femtosecond laser pulses and a photoconductive Auston switch to create picosecond current pulses for switching the ferrimagnet. By anomalous Hall and magneto-optic Kerr (MOKE) measurement, we demonstrate the robust picosecond SOT driven magnetization switching of ferrimagnetic GdFeCo. The time-resolved MOKE shows more than 50 GHz magnetic resonance frequency of GdFeCo, indicating faster than 20 ps spin dynamics and tens of picosecond SOT switching speed. Our work provides a promising route to realize picosecond operation speed for non-volatile magnetic memory and logic applications. △ Less

Submitted 20 December, 2019; originally announced December 2019.

Design of Task-Specific Optical Systems Using Broadband Diffractive Neural Networks

Authors: Yi Luo, Deniz Mengu, Nezih T. Yardimci, Yair Rivenson, Muhammed Veli, Mona Jarrahi, Aydogan Ozcan

Abstract: We report a broadband diffractive optical neural network design that simultaneously processes a continuum of wavelengths generated by a temporally-incoherent broadband source to all-optically perform a specific task learned using deep learning. We experimentally validated the success of this broadband diffractive neural network architecture by designing, fabricating and testing seven different mul… ▽ More We report a broadband diffractive optical neural network design that simultaneously processes a continuum of wavelengths generated by a temporally-incoherent broadband source to all-optically perform a specific task learned using deep learning. We experimentally validated the success of this broadband diffractive neural network architecture by designing, fabricating and testing seven different multi-layer, diffractive optical systems that transform the optical wavefront generated by a broadband THz pulse to realize (1) a series of tunable, single passband as well as dual passband spectral filters, and (2) spatially-controlled wavelength de-multiplexing. Merging the native or engineered dispersion of various material systems with a deep learning-based design strategy, broadband diffractive neural networks help us engineer light-matter interaction in 3D, diverging from intuitive and analytical design methods to create task-specific optical components that can all-optically perform deterministic tasks or statistical inference for optical machine learning. △ Less

Submitted 14 September, 2019; originally announced September 2019.

Comments: 36 pages, 5 figures

Journal ref: Light: Science & Applications (2019)

Response to 'Room Temperature, Quantum-Limited THz Heterodyne Detection? Not Yet'

Authors: Mona Jarrahi, Yen-Ju Lin

Abstract: This commentary is written in response to arXiv:1907.13198. In this article, Zmuidzinas et al. raise questions about the results reported by our group in Nature Astronomy (DOI: 10.1038/s41550-019-0828-6) regarding our experimental methodology and our device performance metrics. As described in this Response, Zmuidzinas et al. have unfortunately missed some basic principles on impedance matching an… ▽ More This commentary is written in response to arXiv:1907.13198. In this article, Zmuidzinas et al. raise questions about the results reported by our group in Nature Astronomy (DOI: 10.1038/s41550-019-0828-6) regarding our experimental methodology and our device performance metrics. As described in this Response, Zmuidzinas et al. have unfortunately missed some basic principles on impedance matching and the physics of photomixers and plasmonics that are at the heart of their categorical conclusions. Here, we correct these misunderstandings and discharge all of their flawed conclusions. Therefore, all of the results and conclusions reported in our Nature Astronomy manuscript remain correct, as before. △ Less

Submitted 10 September, 2019; v1 submitted 13 August, 2019; originally announced August 2019.

Comments: 7 pages, 3 figures. arXiv admin note: text overlap with arXiv:1907.13198

Plasmonic Heterodyne Spectrometry for Resolving the Spectral Signatures of Ammonia over a 1-5 THz Frequency Range

Authors: Yen-Ju Lin, Semih Cakmakyapan, Ning Wang, Daniel Lee, Mitchell Spearrin, Mona Jarrahi

Abstract: We present a heterodyne terahertz spectrometry platform based on plasmonic photomixing, which enables the resolution of narrow spectral signatures of gases over a broad terahertz frequency range. This plasmonic heterodyne spectrometer replaces the terahertz mixer and local oscillator of conventional heterodyne spectrometers with a plasmonic photomixer and a heterodyning optical pump beam, respecti… ▽ More We present a heterodyne terahertz spectrometry platform based on plasmonic photomixing, which enables the resolution of narrow spectral signatures of gases over a broad terahertz frequency range. This plasmonic heterodyne spectrometer replaces the terahertz mixer and local oscillator of conventional heterodyne spectrometers with a plasmonic photomixer and a heterodyning optical pump beam, respectively. The heterodyning optical pump beam is formed by two continuous-wave, wavelength-tunable lasers with a broadly tunable terahertz beat frequency. This broadly tunable terahertz beat frequency enables spectrometry over a broad bandwidth, which is not restricted by the bandwidth limitations of conventional terahertz mixers and local oscillators. We use this plasmonic heterodyne spectrometry platform to resolve the spectral signatures of ammonia over a 1-5 THz frequency range. △ Less

Submitted 12 August, 2019; originally announced August 2019.

Comments: 9 pages, 5 figures

Room Temperature Terahertz Spectrometer with Quantum-Level Sensitivity

Authors: Ning Wang, Semih Cakmakyapan, Yen-Ju Lin, Hamid Javadi, Mona Jarrahi

Abstract: Photon detection with quantum-level sensitivity is particularly challenging in the terahertz regime (0.1-10 THz), which contains ~98% of all the photons existing in the universe. Near-quantum-limited terahertz spectrometry has so far only been possible through the use of cryogenically cooled superconducting mixers as frequency downconverters. Here we introduce a spectrometry scheme that uses plasm… ▽ More Photon detection with quantum-level sensitivity is particularly challenging in the terahertz regime (0.1-10 THz), which contains ~98% of all the photons existing in the universe. Near-quantum-limited terahertz spectrometry has so far only been possible through the use of cryogenically cooled superconducting mixers as frequency downconverters. Here we introduce a spectrometry scheme that uses plasmonic photomixing for frequency downconversion to offer quantum-level sensitivities at room temperature for the first time. Frequency downconversion is achieved by mixing terahertz radiation and a heterodyning optical beam with a terahertz beat frequency in a plasmonics-enhanced semiconductor active region. We demonstrate spectrometer sensitivities down to 3 times the quantum-limit at room temperature. With a versatile design capable of broadband spectrometry, this plasmonic photomixer has broad applicability to quantum optics, chemical sensing, biological studies, medical diagnosis, high data-rate communication, as well as astronomy and atmospheric studies. △ Less

Submitted 10 June, 2018; originally announced June 2018.

Comments: 17 pages, 7 figures

All-Optical Machine Learning Using Diffractive Deep Neural Networks

Authors: Xing Lin, Yair Rivenson, Nezih T. Yardimci, Muhammed Veli, Mona Jarrahi, Aydogan Ozcan

Abstract: We introduce an all-optical Diffractive Deep Neural Network (D2NN) architecture that can learn to implement various functions after deep learning-based design of passive diffractive layers that work collectively. We experimentally demonstrated the success of this framework by creating 3D-printed D2NNs that learned to implement handwritten digit classification and the function of an imaging lens at… ▽ More We introduce an all-optical Diffractive Deep Neural Network (D2NN) architecture that can learn to implement various functions after deep learning-based design of passive diffractive layers that work collectively. We experimentally demonstrated the success of this framework by creating 3D-printed D2NNs that learned to implement handwritten digit classification and the function of an imaging lens at terahertz spectrum. With the existing plethora of 3D-printing and other lithographic fabrication methods as well as spatial-light-modulators, this all-optical deep learning framework can perform, at the speed of light, various complex functions that computer-based neural networks can implement, and will find applications in all-optical image analysis, feature detection and object classification, also enabling new camera designs and optical components that can learn to perform unique tasks using D2NNs. △ Less

Submitted 26 July, 2018; v1 submitted 14 April, 2018; originally announced April 2018.

Comments: 20 pages, 4 figures

Gold-Patched Graphene Nanoribbons for High-Responsivity and Ultrafast Photodetection from Visible to Infrared Regimes

Authors: Semih Cakmakyapan, ** Keng Lu, Aryan Navabi, Mona Jarrahi

Abstract: Graphene is a very attractive material for broadband photodetection in hyperspectral imaging and sensing systems. However, its potential use has been hindered by tradeoffs between the responsivity, bandwidth, and operation speed of existing graphene photodetectors. Here, we present engineered photoconductive nanostructures based on gold-patched graphene nanoribbons, which enable simultaneous broad… ▽ More Graphene is a very attractive material for broadband photodetection in hyperspectral imaging and sensing systems. However, its potential use has been hindered by tradeoffs between the responsivity, bandwidth, and operation speed of existing graphene photodetectors. Here, we present engineered photoconductive nanostructures based on gold-patched graphene nanoribbons, which enable simultaneous broadband and ultrafast photodetection with high responsivity. These nanostructures merge the advantages of broadband optical absorption, ultrafast photocarrier transport, and carrier multiplication in graphene nanoribbons with the ultrafast transport of photocarriers to the gold patches before recombination. Through this approach, high-responsivity operation is achieved without the use of bandwidth- and speed-limiting quantum dots, defect states, or tunneling barriers. We demonstrate high-responsivity photodetection from the visible to the infrared regime (0.6 A/W at 0.8 μm and 11.5 A/W at 20 μm) with operation speeds exceeding 50 GHz. Our results demonstrate an improvement of the response times by more than seven orders of magnitude and an increase in bandwidths of one order of magnitude compared to those of higher-responsivity graphene photodetectors based on quantum dots and tunneling barriers. △ Less

Submitted 28 September, 2017; originally announced October 2017.

Comments: 33 pages

High Sensitivity Terahertz Detection through Large-Area Plasmonic Nano-Antenna Arrays

Authors: Nezih Tolga Yardimci, Mona Jarrahi

Abstract: Plasmonic photoconductive antennas have great promise for increasing responsivity and detection sensitivity of conventional photoconductive detectors in time-domain terahertz imaging and spectroscopy systems. However, operation bandwidth of previously demonstrated plasmonic photoconductive antennas has been limited by bandwidth constraints of their antennas and photoconductor parasitics. Here, we… ▽ More Plasmonic photoconductive antennas have great promise for increasing responsivity and detection sensitivity of conventional photoconductive detectors in time-domain terahertz imaging and spectroscopy systems. However, operation bandwidth of previously demonstrated plasmonic photoconductive antennas has been limited by bandwidth constraints of their antennas and photoconductor parasitics. Here, we present a powerful technique for realizing broadband terahertz detectors through large-area plasmonic photoconductive nano-antenna arrays. A key novelty that makes the presented terahertz detector superior to the state-of-the art is a specific large-area device geometry that offers a strong interaction between the incident terahertz beam and optical pump at the nanoscale, while maintaining a broad operation bandwidth. The large device active area allows robust operation against optical and terahertz beam misalignments. We demonstrate broadband terahertz detection with signal-to-noise ratio levels as high as 107 dB. △ Less

Submitted 24 December, 2016; originally announced December 2016.

Globally stable microresonator Turing pattern formation for coherent high-power THz radiation on-chip

Authors: Shu-Wei Huang, **ghui Yang, Shang-Hua Yang, Mingbin Yu, Dim-Lee Kwong, Tanya Zelevinsky, Mona Jarrahi, Chee Wei Wong

Abstract: In nonlinear microresonators driven by continuous-wave (cw) lasers, Turing patterns have been studied in the formalism of Lugiato-Lefever equation with emphasis on its high coherence and exceptional robustness against perturbations. Destabilization of Turing pattern and transition to spatio-temporal chaos, however, limits the available energy carried in the Turing rolls and prevents further harves… ▽ More In nonlinear microresonators driven by continuous-wave (cw) lasers, Turing patterns have been studied in the formalism of Lugiato-Lefever equation with emphasis on its high coherence and exceptional robustness against perturbations. Destabilization of Turing pattern and transition to spatio-temporal chaos, however, limits the available energy carried in the Turing rolls and prevents further harvest of their high coherence and robustness to noise. Here we report a novel scheme to circumvent such destabilization, by incorporating the effect of local mode hybridizations, and attain globally stable Turing pattern formation in chip-scale nonlinear oscillators, achieving a record high power conversion efficiency of 45% and an elevated peak-to-valley contrast of 100. The stationary Turing pattern is discretely tunable across 430 GHz on a THz carrier, with a fractional frequency sideband non-uniformity measured at 7.3x10^-14. We demonstrate the simultaneous microwave and optical coherence of the Turing rolls at different evolution stages through ultrafast optical correlation techniques. The free running Turing roll coherence, 9 kHz in 200 ms and 160 kHz in 20 minutes, is transferred onto a plasmonic photomixer for one of the highest power THz coherent generation at room-temperature, with 1.1% optical-to-THz power conversion. Its long-term stability can be further improved by more than two orders of magnitude, reaching an Allan deviation of 6x10^-10 at 100 s, with a simple computer-aided slow feedback control. The demonstrated on-chip coherent high-power Turing-THz system is promising to find applications in astrophysics, medical imaging, and wireless communications. △ Less

Submitted 25 April, 2017; v1 submitted 2 March, 2016; originally announced March 2016.

Journal ref: Phys. Rev. X 7, 041002 (2017)

Responsivity Calibration of Pyroelectric Terahertz Detectors

Authors: Christopher W. Berry, Nezih. T. Yardimci, Mona Jarrahi

Abstract: There has been a significant advancement in terahertz radiation sources in the past decade, making milliwatt terahertz power levels accessible in both continuous-wave and pulsed operation. Such high-power terahertz radiation sources circumvent the need for cryogenic-cooled terahertz detectors such as semiconductor bolometers and necessitate the need for new types of calibrated, room-temperature te… ▽ More There has been a significant advancement in terahertz radiation sources in the past decade, making milliwatt terahertz power levels accessible in both continuous-wave and pulsed operation. Such high-power terahertz radiation sources circumvent the need for cryogenic-cooled terahertz detectors such as semiconductor bolometers and necessitate the need for new types of calibrated, room-temperature terahertz detectors. Among various types of room-temperature terahertz detectors, pyroelectric detectors are one of the most widely used detectors, which can offer wide dynamic range, broad detection bandwidth, and high sensitivity levels. In this article, we describe the calibration process of a commercially available pyroelectric detector (Spectrum Detector, Inc, SPI-A-65 THz), which incorporates a 5 mm diameter LiTaO3 detector with an organic terahertz absorber coating. △ Less

Submitted 22 December, 2014; originally announced December 2014.

Broadband Terahertz Modulators based on MEMS-Reconfigurable Mesh Filters

Authors: Mehmet Unlu, Mohammad R. Hashemi, Christopher W. Berry, Shenglin Li, Shang-Hua Yang, Mona Jarrahi

Abstract: Active tuning and switching of electromagnetic properties of materials is of great importance for controlling their interaction with electromagnetic waves. Superconductors are the only natural materials that exhibit diamagnetic switching at their critical temperatures. Here, we demonstrate a new class of meta-surfaces with electrically-induced diamagnetic switching capability at room temperature.… ▽ More Active tuning and switching of electromagnetic properties of materials is of great importance for controlling their interaction with electromagnetic waves. Superconductors are the only natural materials that exhibit diamagnetic switching at their critical temperatures. Here, we demonstrate a new class of meta-surfaces with electrically-induced diamagnetic switching capability at room temperature. Structural configuration of the subwavelength meta-molecules determines their magnetic response to an external electromagnetic radiation. By reconfiguration of the meta-molecule structure, the strength of the induced magnetic field in the opposite direction to the external magnetic field is varied and the diamagnetic state of the meta-surface is altered, consequently. We demonstrate a significant change in the relative permeability and permittivity of a custom-designed meta-surface with diamagnetic switching capability at terahertz frequencies, enabling terahertz intensity modulation with record high modulation depths and modulation bandwidths through a fully integrated device platform at room temperature. △ Less

Submitted 24 April, 2013; v1 submitted 28 December, 2012; originally announced December 2012.

Significant Radiation Enhancement in Photoconductive Terahertz Emitters by Incorporating Plasmonic Contact Electrodes

Authors: Christopher W. Berry, Mohammad R. Hashemi, Mehmet Unlu, Mona Jarrahi

Abstract: Even though the terahertz spectrum is well suited for chemical identification, material characterization, biological sensing and medical imaging, practical development of these applications has been hindered by the attributes of terahertz sources, namely low output power and poor efficiency. Here, we demonstrate that use of plasmonic contact electrodes can significantly enhance the optical-to-tera… ▽ More Even though the terahertz spectrum is well suited for chemical identification, material characterization, biological sensing and medical imaging, practical development of these applications has been hindered by the attributes of terahertz sources, namely low output power and poor efficiency. Here, we demonstrate that use of plasmonic contact electrodes can significantly enhance the optical-to-terahertz conversion efficiency in a photoconductive terahertz emitter. The use of plasmonic contact electrodes offers nanoscale carrier transport path lengths for the photocarriers, enabling efficient collection of the majority of carriers in a sub-picosecond time-scale. It also allows increasing photoconductor active area without a considerable increase in the capacitive loading to the antenna, boosting the maximum terahertz radiation power by preventing the carrier screening effect and thermal breakdown at high optical pump powers. We experimentally demonstrated 50 times higher terahertz radiation power from a plasmonic photoconductive emitter in comparison with a similar photoconductive emitter with non-plasmonic contact electrodes. △ Less

Submitted 7 September, 2012; originally announced September 2012.

Continuous-wave Cascaded-Harmonic Generation and Multi-Photon Raman Lasing in Lithium Niobate Whispering-Gallery Resonators

Authors: Jeremy Moore, Matthew Tomes, Tal Carmon, Mona Jarrahi

Abstract: We report experimental demonstration of continuous-wave cascaded-harmonic generation and Raman lasing in a millimeter-scale lithium niobate whispering-gallery resonator pumped at a telecommunication-compatible infrared wavelength. Intensity enhancement through multiple recirculations in the whispering-gallery resonator and quasi phase-matching through a nonuniform crystal poling enable simultaneou… ▽ More We report experimental demonstration of continuous-wave cascaded-harmonic generation and Raman lasing in a millimeter-scale lithium niobate whispering-gallery resonator pumped at a telecommunication-compatible infrared wavelength. Intensity enhancement through multiple recirculations in the whispering-gallery resonator and quasi phase-matching through a nonuniform crystal poling enable simultaneous cascaded-harmonic generation up to the fourth-harmonic accompanied by stimulated Raman, two-photon, three-photon, and four-photon Raman scattering corresponding the molecular vibrational wavenumbers 632 cm-1 and 255 cm-1 in z-cut lithium niobate at pump power levels as low as 200mW. We demonstrate simultaneous cascaded-harmonic generation and Raman lasing by observing the spectrum of the scattered light from the resonator and by capturing the image of the decoupled light from the resonator on a color CCD camera. △ Less

Submitted 19 October, 2011; originally announced October 2011.