Showing 1–11 of 11 results for author: Brady, D

Integrated Photonic Encoder for Terapixel Image Processing

Authors: Xiao Wang, Brandon Redding, Nicholas Karl, Christopher Long, Zheyuan Zhu, Shuo Pang, David Brady, Raktim Sarma

Abstract: Modern lens designs are capable of resolving >10 gigapixels, while advances in camera frame-rate and hyperspectral imaging have made Terapixel/s data acquisition a real possibility. The main bottlenecks preventing such high data-rate systems are power consumption and data storage. In this work, we show that analog photonic encoders could address this challenge, enabling high-speed image compressio… ▽ More Modern lens designs are capable of resolving >10 gigapixels, while advances in camera frame-rate and hyperspectral imaging have made Terapixel/s data acquisition a real possibility. The main bottlenecks preventing such high data-rate systems are power consumption and data storage. In this work, we show that analog photonic encoders could address this challenge, enabling high-speed image compression using orders-of-magnitude lower power than digital electronics. Our approach relies on a silicon-photonics front-end to compress raw image data, foregoing energy-intensive image conditioning and reducing data storage requirements. The compression scheme uses a passive disordered photonic structure to perform kernel-type random projections of the raw image data with minimal power consumption and low latency. A back-end neural network can then reconstruct the original images with structural similarity exceeding 90%. This scheme has the potential to process Terapixel/s data streams using less than 100 fJ/pixel, providing a path to ultra-high-resolution data and image acquisition systems. △ Less

Submitted 7 June, 2023; originally announced June 2023.

Large-scale Global Low-rank Optimization for Computational Compressed Imaging

Authors: Daoyu Li, Hanwen Xu, Miao Cao, Xin Yuan, David J. Brady, Liheng Bian

Abstract: Computational reconstruction plays a vital role in computer vision and computational photography. Most of the conventional optimization and deep learning techniques explore local information for reconstruction. Recently, nonlocal low-rank (NLR) reconstruction has achieved remarkable success in improving accuracy and generalization. However, the computational cost has inhibited NLR from seeking glo… ▽ More Computational reconstruction plays a vital role in computer vision and computational photography. Most of the conventional optimization and deep learning techniques explore local information for reconstruction. Recently, nonlocal low-rank (NLR) reconstruction has achieved remarkable success in improving accuracy and generalization. However, the computational cost has inhibited NLR from seeking global structural similarity, which consequentially keeps it trapped in the tradeoff between accuracy and efficiency and prevents it from high-dimensional large-scale tasks. To address this challenge, we report here the global low-rank (GLR) optimization technique, realizing highly-efficient large-scale reconstruction with global self-similarity. Inspired by the self-attention mechanism in deep learning, GLR extracts exemplar image patches by feature detection instead of conventional uniform selection. This directly produces key patches using structural features to avoid burdensome computational redundancy. Further, it performs patch matching across the entire image via neural-based convolution, which produces the global similarity heat map in parallel, rather than conventional sequential block-wise matching. As such, GLR improves patch grou** efficiency by more than one order of magnitude. We experimentally demonstrate GLR's effectiveness on temporal, frequency, and spectral dimensions, including different computational imaging modalities of compressive temporal imaging, magnetic resonance imaging, and multispectral filter array demosaicing. This work presents the superiority of inherent fusion of deep learning strategies and iterative optimization, and breaks the persistent dilemma of the tradeoff between accuracy and efficiency for various large-scale reconstruction tasks. △ Less

Submitted 8 January, 2023; originally announced January 2023.

Space-Time Projection Optical Tomography: Search Space and Orbit Determination

Authors: Hasan Bahcivan, David J. Brady

Abstract: In a companion article, we discussed the radiometric sensitivity and resolution of a new passive optical sensing technique, Space-Time Projection Optical Tomography (SPOT), to detect and track sub-cm and larger space debris for Space Situational Awareness. SPOT is based on the principle that long synthetic exposure can be achieved if the phase-space trajectory of a hypothetical point-source is pre… ▽ More In a companion article, we discussed the radiometric sensitivity and resolution of a new passive optical sensing technique, Space-Time Projection Optical Tomography (SPOT), to detect and track sub-cm and larger space debris for Space Situational Awareness. SPOT is based on the principle that long synthetic exposure can be achieved if the phase-space trajectory of a hypothetical point-source is precisely predictable within a very wide telescope field-of-view, which is the case for orbiting debris. This article discusses the computational search space for debris mining as well as a recursive measure-and-fit algorithm based on a generalized Hough transform for orbit determination. △ Less

Submitted 24 November, 2022; v1 submitted 23 November, 2022; originally announced November 2022.

Comments: Space Situational Awareness

Radiometric sensitivity and resolution of synthetic tracking imaging for orbital debris monitoring

Authors: Hasan Bahcivan, David J. Brady, Gordon C. Hageman

Abstract: We consider sampling and detection strategies for solar illuminated space debris. We argue that the lowest detectable debris cross section may be reduced by 10-100x by analysis of phase-space-pixels rather than single frame data. The phase-space-pixel is a weighted stacking of pixels corresponding to a test debris trajectory within the very wide camera field-of-view (FOV). To isolate debris signal… ▽ More We consider sampling and detection strategies for solar illuminated space debris. We argue that the lowest detectable debris cross section may be reduced by 10-100x by analysis of phase-space-pixels rather than single frame data. The phase-space-pixel is a weighted stacking of pixels corresponding to a test debris trajectory within the very wide camera field-of-view (FOV). To isolate debris signals from background, exposure time is set to match the time it takes a debris to transit through the instantaneous field of view. Debris signatures are detected though a generalized Hough transform of the data cube. Radiometric analysis of line integrals shows that that sub-cm objects in Low Earth Orbit can be detected and assigned full orbital parameters by this approach △ Less

Submitted 17 November, 2022; originally announced November 2022.

Towards Learning Self-Organized Criticality of Rydberg Atoms using Graph Neural Networks

Authors: Simon Ohler, Daniel Brady, Winfried Lötzsch, Michael Fleischhauer, Johannes S. Otterbach

Abstract: Self-Organized Criticality (SOC) is a ubiquitous dynamical phenomenon believed to be responsible for the emergence of universal scale-invariant behavior in many, seemingly unrelated systems, such as forest fires, virus spreading or atomic excitation dynamics. SOC describes the buildup of large-scale and long-range spatio-temporal correlations as a result of only local interactions and dissipation.… ▽ More Self-Organized Criticality (SOC) is a ubiquitous dynamical phenomenon believed to be responsible for the emergence of universal scale-invariant behavior in many, seemingly unrelated systems, such as forest fires, virus spreading or atomic excitation dynamics. SOC describes the buildup of large-scale and long-range spatio-temporal correlations as a result of only local interactions and dissipation. The simulation of SOC dynamics is typically based on Monte-Carlo (MC) methods, which are however numerically expensive and do not scale beyond certain system sizes. We investigate the use of Graph Neural Networks (GNNs) as an effective surrogate model to learn the dynamics operator for a paradigmatic SOC system, inspired by an experimentally accessible physics example: driven Rydberg atoms. To this end, we generalize existing GNN simulation approaches to predict dynamics for the internal state of the node. We show that we can accurately reproduce the MC dynamics as well as generalize along the two important axes of particle number and particle density. This paves the way to model much larger systems beyond the limits of traditional MC methods. While the exact system is inspired by the dynamics of Rydberg atoms, the approach is quite general and can readily be applied to other systems. △ Less

Submitted 5 July, 2022; originally announced July 2022.

Journal ref: 2nd AI4Science Workshop at the 39th International Conference on Machine Learning (ICML), 2022

Neuronal Growth and Formation of Neuron Networks on Directional Surfaces

Authors: Ilya Yurchenko, Matthew Farwell, Donovan D. Brady, Cristian Staii

Abstract: The formation of neuron networks is a process of fundamental importance for understanding the development of the nervous system and for creating biomimetic devices for tissue engineering and neural repair. The basic process that controls the network formation is the growth of an axon from the cell body and its extension towards target neurons. Axonal growth is directed by environmental stimuli tha… ▽ More The formation of neuron networks is a process of fundamental importance for understanding the development of the nervous system and for creating biomimetic devices for tissue engineering and neural repair. The basic process that controls the network formation is the growth of an axon from the cell body and its extension towards target neurons. Axonal growth is directed by environmental stimuli that include intercellular interactions, biochemical cues, and the mechanical and geometrical properties of the growth substrate. Despite significant recent progress, the steering of the growing axon remains poorly understood. In this paper, we develop a model of axonal motility, which incorporates substrate-geometry sensing. We combine experimental data with theoretical analysis to measure the parameters that describe axonal growth on micropatterned surfaces: diffusion (cell motility) coefficients, speed and angular distributions, and cell-substrate interactions. Experiments performed on neurons treated with inhibitors for microtubules (Taxol) and actin filaments (Y-27632) indicate that cytoskeletal dynamics play a critical role in the steering mechanism. Our results demonstrate that axons follow geometrical patterns through a contact-guidance mechanism, in which geometrical patterns impart high traction forces to the growth cone. These results have important implications for bioengineering novel substrates to guide neuronal growth and promote nerve repair. △ Less

Submitted 12 May, 2022; v1 submitted 10 May, 2022; originally announced May 2022.

Comments: 34 pages, 10 figures

Journal ref: Biomimetics 6(2), 41 (2021)

Scatter Ptychography

Authors: Qian Huang, Zhipeng Dong, Yuzuru Takashima, Timothy J. Schulz, David J. Brady

Abstract: Coherent illumination reflected by a remote target may be secondarily scattered by intermediate objects or materials. Here we show that phase retrieval on remotely observed images of such scattered fields enables imaging of the illuminated object at resolution proportional to $λR_s/A_s$, where $R_s$ is the range between the scatterer and the target and $A_s$ is the diameter of the observed scatter… ▽ More Coherent illumination reflected by a remote target may be secondarily scattered by intermediate objects or materials. Here we show that phase retrieval on remotely observed images of such scattered fields enables imaging of the illuminated object at resolution proportional to $λR_s/A_s$, where $R_s$ is the range between the scatterer and the target and $A_s$ is the diameter of the observed scatter. This resolution may exceed the resolution of directly viewing the target by the factor $R_cA_s/R_sA_c$, where $R_c$ is the range between the observer and the target and $A_c$ is the observing aperture. Here we use this technique to demonstrate $\approx 32\times$ resolution improvement relative to direct imaging. △ Less

Submitted 23 March, 2022; originally announced March 2022.

Snapshot Ptychography on Array cameras

Authors: Chengyu Wang, Minghao Hu, Yuzuru Takashima, Timothy J. Schulz, David J. Brady

Abstract: We use convolutional neural networks to recover images optically down-sampled by $6.7\times$ using coherent aperture synthesis over a 16 camera array. Where conventional ptychography relies on scanning and oversampling, here we apply decompressive neural estimation to recover full resolution image from a single snapshot, although as shown in simulation multiple snapshots can be used to improve SNR… ▽ More We use convolutional neural networks to recover images optically down-sampled by $6.7\times$ using coherent aperture synthesis over a 16 camera array. Where conventional ptychography relies on scanning and oversampling, here we apply decompressive neural estimation to recover full resolution image from a single snapshot, although as shown in simulation multiple snapshots can be used to improve SNR. In place training on experimental measurements eliminates the need to directly calibrate the measurement system. We also present simulations of diverse array camera sampling strategies to explore how snapshot compressive systems might be optimized. △ Less

Submitted 5 November, 2021; originally announced November 2021.

Thin Lenses and Thin Cameras

Authors: Wubin Pang, David J. Brady

Abstract: Cassegrain designs can be used to build thin lenses. We analyze the relationships between system thickness and aperture sizes of the two mirrors as well as FoV size. Our analysis shows that decrease in lens thickness imposes tight constraint on the aperture and FoV size. To mitigate this limitation, we propose to fill the gaps between the primary and the secondary with high index material. The Gas… ▽ More Cassegrain designs can be used to build thin lenses. We analyze the relationships between system thickness and aperture sizes of the two mirrors as well as FoV size. Our analysis shows that decrease in lens thickness imposes tight constraint on the aperture and FoV size. To mitigate this limitation, we propose to fill the gaps between the primary and the secondary with high index material. The Gassegrain optics cuts the track length into half and high index material reduces ray angle and height, consequently the incident ray angle can be increased, i.e., the FoV angle is extended. Defining telephoto ratio as the ratio of lens thickness to focal length, we achieve telephoto ratios as small as 0.43 for a visible Cassegrain thin lens and 1.20 for an infrared Cassegrain thin lens. To achieve an arbitrary FoV coverage, we present an strategy by integrating multiple thin lenses on one plane with each unit covering a different FoV region. To avoid physically tilting each unit, we propose beam steering with metasurface. By image stitching, we obtain wide FoV images. △ Less

Submitted 12 January, 2021; originally announced January 2021.

Multiscale Phase Retrieval

Authors: David J. Brady, Timothy J. Schulz, Chengyu Wang

Abstract: While characterization of coherent wavefields is essential to laser, x-ray and electron imaging, sensors measure the squared magnitude of the field, rather than the field itself. Holography or phase retrieval must be used to characterize the field. The need for a reference severely restricts the utility of holography. Phase retrieval, in contrast, is theoretically consistent with sensors that dire… ▽ More While characterization of coherent wavefields is essential to laser, x-ray and electron imaging, sensors measure the squared magnitude of the field, rather than the field itself. Holography or phase retrieval must be used to characterize the field. The need for a reference severely restricts the utility of holography. Phase retrieval, in contrast, is theoretically consistent with sensors that directly measure coherent or partially coherent fields with no prior assumptions. Unfortunately, phase retrieval has not yet been successfully implemented for large-scale fields. Here we show that both holography and phase retrieval are capable of quantum-limited coherent signal estimation and we describe phase retrieval strategies that approach the quantum limit for >1 megapixel fields. These strategies rely on group testing using networks of interferometers, such as might be constructed using emerging integrated photonic, plasmonic and/or metamaterial devices. Phase-sensitive sensor planes using such devices could eliminate the need both for lenses and reference signals, creating a path to large aperture diffraction limited laser imaging. △ Less

Submitted 9 December, 2020; originally announced December 2020.

Compressive and Adaptive Millimeter-wave SAR

Authors: Alex Mrozack, Martin Heimbeck, Daniel L. Marks, Jonathan Richard, Henry O. Everitt, David J. Brady

Abstract: We apply adaptive sensing techniques to the problem of locating sparse metallic scatterers using high-resolution, frequency modulated continuous wave W-band RADAR. Using a single detector, a frequency stepped source, and a lateral translation stage, inverse synthetic aperture RADAR reconstruction techniques are used to search for one or two wire scatterers within a specified range, while an adapti… ▽ More We apply adaptive sensing techniques to the problem of locating sparse metallic scatterers using high-resolution, frequency modulated continuous wave W-band RADAR. Using a single detector, a frequency stepped source, and a lateral translation stage, inverse synthetic aperture RADAR reconstruction techniques are used to search for one or two wire scatterers within a specified range, while an adaptive algorithm determined successive sampling locations. The two-dimensional location of each scatterer is thereby identified with sub-wavelength accuracy in as few as 1/4 the number of lateral steps required for a simple raster scan. The implications of applying this approach to more complex scattering geometries are explored in light of the various assumptions made. △ Less

Submitted 6 February, 2014; originally announced February 2014.