-
Holographic Phase Retrieval via Wirtinger Flow: Cartesian Form with Auxiliary Amplitude
Authors:
Ittetsu Uchiyama,
Chihiro Tsutake,
Keita Takahashi,
Toshiaki Fujii
Abstract:
We propose a new gradient method for holography, where a phase-only hologram is parameterized by not only the phase but also amplitude. The key idea of our approach is the formulation of a phase-only hologram using an auxiliary amplitude. We optimize the parameters using the so-called Wirtinger flow algorithm in the Cartesian domain, which is a gradient method defined on the basis of the Wirtinger…
▽ More
We propose a new gradient method for holography, where a phase-only hologram is parameterized by not only the phase but also amplitude. The key idea of our approach is the formulation of a phase-only hologram using an auxiliary amplitude. We optimize the parameters using the so-called Wirtinger flow algorithm in the Cartesian domain, which is a gradient method defined on the basis of the Wirtinger calculus. At the early stage of optimization, each element of the hologram exists inside a complex circle, and it can take a large gradient while diverging from the origin. This characteristic contributes to accelerating the gradient descent. Meanwhile, at the final stage of optimization, each element evolves along a complex circle, similar to previous state-of-the-art gradient methods. The experimental results demonstrate that our method outperforms previous methods, primarily due to the optimization of the amplitude.
△ Less
Submitted 1 May, 2024; v1 submitted 14 March, 2024;
originally announced March 2024.
-
Time-Efficient Light-Field Acquisition Using Coded Aperture and Events
Authors:
Shuji Habuchi,
Keita Takahashi,
Chihiro Tsutake,
Toshiaki Fujii,
Hajime Nagahara
Abstract:
We propose a computational imaging method for time-efficient light-field acquisition that combines a coded aperture with an event-based camera. Different from the conventional coded-aperture imaging method, our method applies a sequence of coding patterns during a single exposure for an image frame. The parallax information, which is related to the differences in coding patterns, is recorded as ev…
▽ More
We propose a computational imaging method for time-efficient light-field acquisition that combines a coded aperture with an event-based camera. Different from the conventional coded-aperture imaging method, our method applies a sequence of coding patterns during a single exposure for an image frame. The parallax information, which is related to the differences in coding patterns, is recorded as events. The image frame and events, all of which are measured in a single exposure, are jointly used to computationally reconstruct a light field. We also designed an algorithm pipeline for our method that is end-to-end trainable on the basis of deep optics and compatible with real camera hardware. We experimentally showed that our method can achieve more accurate reconstruction than several other imaging methods with a single exposure. We also developed a hardware prototype with the potential to complete the measurement on the camera within 22 msec and demonstrated that light fields from real 3-D scenes can be obtained with convincing visual quality. Our software and supplementary video are available from our project website.
△ Less
Submitted 11 March, 2024;
originally announced March 2024.
-
Reconstructing Continuous Light Field From Single Coded Image
Authors:
Yuya Ishikawa,
Keita Takahashi,
Chihiro Tsutake,
Toshiaki Fujii
Abstract:
We propose a method for reconstructing a continuous light field of a target scene from a single observed image. Our method takes the best of two worlds: joint aperture-exposure coding for compressive light-field acquisition, and a neural radiance field (NeRF) for view synthesis. Joint aperture-exposure coding implemented in a camera enables effective embedding of 3-D scene information into an obse…
▽ More
We propose a method for reconstructing a continuous light field of a target scene from a single observed image. Our method takes the best of two worlds: joint aperture-exposure coding for compressive light-field acquisition, and a neural radiance field (NeRF) for view synthesis. Joint aperture-exposure coding implemented in a camera enables effective embedding of 3-D scene information into an observed image, but in previous works, it was used only for reconstructing discretized light-field views. NeRF-based neural rendering enables high quality view synthesis of a 3-D scene from continuous viewpoints, but when only a single image is given as the input, it struggles to achieve satisfactory quality. Our method integrates these two techniques into an efficient and end-to-end trainable pipeline. Trained on a wide variety of scenes, our method can reconstruct continuous light fields accurately and efficiently without any test time optimization. To our knowledge, this is the first work to bridge two worlds: camera design for efficiently acquiring 3-D information and neural rendering.
△ Less
Submitted 16 November, 2023;
originally announced November 2023.
-
Application of reciprocity for facilitation of wave field visualization and defect detection
Authors:
Bernd Köhler,
Kanta Takahashi,
Kazuyuki Nakahata
Abstract:
The motion visualization in a structural component was studied for defect detection. Elastic motions were excited by hammer impacts at multiple points and received by an accelerometer at a fixed point. Reciprocity in elastodynamics is only valid under certain conditions. Its validity under given experimental conditions was derived from the elastodynamic reciprocity theorem. Based on this, the dyna…
▽ More
The motion visualization in a structural component was studied for defect detection. Elastic motions were excited by hammer impacts at multiple points and received by an accelerometer at a fixed point. Reciprocity in elastodynamics is only valid under certain conditions. Its validity under given experimental conditions was derived from the elastodynamic reciprocity theorem. Based on this, the dynamic motion of the structural component was obtained for fixed-point excitation from measurements performed using multipoint excitations. In the visualized eigenmodes, significant additional deformation was observed at the wall thinning inserted as an artificial defect. To prevent the dependence of defect detection on its position within the mode shape, another approach was proposed based on the extraction of guided wave modes immediately after impact excitation. It is shown that this maximum intensity projection method works well in detecting defects.
△ Less
Submitted 26 September, 2023;
originally announced September 2023.
-
Point Cloud-based Proactive Link Quality Prediction for Millimeter-wave Communications
Authors:
Shoki Ohta,
Takayuki Nishio,
Riichi Kudo,
Kahoko Takahashi,
Hisashi Nagata
Abstract:
This study demonstrates the feasibility of point cloud-based proactive link quality prediction for millimeter-wave (mmWave) communications. Previous studies have proposed machine learning-based methods to predict received signal strength for future time periods using time series of depth images to mitigate the line-of-sight (LOS) path blockage by pedestrians in mmWave communication. However, these…
▽ More
This study demonstrates the feasibility of point cloud-based proactive link quality prediction for millimeter-wave (mmWave) communications. Previous studies have proposed machine learning-based methods to predict received signal strength for future time periods using time series of depth images to mitigate the line-of-sight (LOS) path blockage by pedestrians in mmWave communication. However, these image-based methods have limited applicability due to privacy concerns as camera images may contain sensitive information. This study proposes a point cloud-based method for mmWave link quality prediction and demonstrates its feasibility through experiments. Point clouds represent three-dimensional (3D) spaces as a set of points and are sparser and less likely to contain sensitive information than camera images. Additionally, point clouds provide 3D position and motion information, which is necessary for understanding the radio propagation environment involving pedestrians. This study designs the mmWave link quality prediction method and conducts realistic indoor experiments, where the link quality fluctuates significantly due to human blockage, using commercially available IEEE 802.11ad-based 60 GHz wireless LAN devices and Kinect v2 RGB-D camera and Velodyne VLP-16 light detection and ranging (LiDAR) for point cloud acquisition. The experimental results showed that our proposed method can predict future large attenuation of mmWave received signal strength and throughput induced by the LOS path blockage by pedestrians with comparable or superior accuracy to image-based prediction methods. Hence, our point cloud-based method can serve as a viable alternative to image-based methods.
△ Less
Submitted 7 December, 2023; v1 submitted 2 January, 2023;
originally announced January 2023.
-
Compressing Sign Information in DCT-based Image Coding via Deep Sign Retrieval
Authors:
Kei Suzuki,
Chihiro Tsutake,
Keita Takahashi,
Toshiaki Fujii
Abstract:
Compressing the sign information of discrete cosine transform (DCT) coefficients is an intractable problem in image coding schemes due to the equiprobable characteristics of the signs. To overcome this difficulty, we propose an efficient compression method for the sign information called "sign retrieval." This method is inspired by phase retrieval, which is a classical signal restoration problem o…
▽ More
Compressing the sign information of discrete cosine transform (DCT) coefficients is an intractable problem in image coding schemes due to the equiprobable characteristics of the signs. To overcome this difficulty, we propose an efficient compression method for the sign information called "sign retrieval." This method is inspired by phase retrieval, which is a classical signal restoration problem of finding the phase information of discrete Fourier transform coefficients from their magnitudes. The sign information of all DCT coefficients is excluded from a bitstream at the encoder and is complemented at the decoder through our sign retrieval method. We show through experiments that our method outperforms previous ones in terms of the bit amount for the signs and computation cost. Our method, implemented in Python language, is available from https://github.com/ctsutake/dsr.
△ Less
Submitted 10 May, 2024; v1 submitted 21 September, 2022;
originally announced September 2022.
-
Acquiring a Dynamic Light Field through a Single-Shot Coded Image
Authors:
Ryoya Mizuno,
Keita Takahashi,
Michitaka Yoshida,
Chihiro Tsutake,
Toshiaki Fujii,
Hajime Nagahara
Abstract:
We propose a method for compressively acquiring a dynamic light field (a 5-D volume) through a single-shot coded image (a 2-D measurement). We designed an imaging model that synchronously applies aperture coding and pixel-wise exposure coding within a single exposure time. This coding scheme enables us to effectively embed the original information into a single observed image. The observed image i…
▽ More
We propose a method for compressively acquiring a dynamic light field (a 5-D volume) through a single-shot coded image (a 2-D measurement). We designed an imaging model that synchronously applies aperture coding and pixel-wise exposure coding within a single exposure time. This coding scheme enables us to effectively embed the original information into a single observed image. The observed image is then fed to a convolutional neural network (CNN) for light-field reconstruction, which is jointly trained with the camera-side coding patterns. We also developed a hardware prototype to capture a real 3-D scene moving over time. We succeeded in acquiring a dynamic light field with 5x5 viewpoints over 4 temporal sub-frames (100 views in total) from a single observed image. Repeating capture and reconstruction processes over time, we can acquire a dynamic light field at 4x the frame rate of the camera. To our knowledge, our method is the first to achieve a finer temporal resolution than the camera itself in compressive light-field acquisition. Our software is available from our project webpage
△ Less
Submitted 26 April, 2022;
originally announced April 2022.
-
Time-series image denoising of pressure-sensitive paint data by projected multivariate singular spectrum analysis
Authors:
Yuya Ohmichi,
Kohmi Takahashi,
Kazuyuki Nakakita
Abstract:
Time-series data, such as unsteady pressure-sensitive paint (PSP) measurement data, may contain a significant amount of random noise. Thus, in this study, we investigated a noise-reduction method that combines multivariate singular spectrum analysis (MSSA) with low-dimensional data representation. MSSA is a state-space reconstruction technique that utilizes time-delay embedding, and the low-dimens…
▽ More
Time-series data, such as unsteady pressure-sensitive paint (PSP) measurement data, may contain a significant amount of random noise. Thus, in this study, we investigated a noise-reduction method that combines multivariate singular spectrum analysis (MSSA) with low-dimensional data representation. MSSA is a state-space reconstruction technique that utilizes time-delay embedding, and the low-dimensional representation is achieved by projecting data onto the singular value decomposition (SVD) basis. The noise-reduction performance of the proposed method for unsteady PSP data, i.e., the projected MSSA, is compared with that of the truncated SVD method, one of the most employed noise-reduction methods. The result shows that the projected MSSA exhibits better performance in reducing random noise than the truncated SVD method. Additionally, in contrast to that of the truncated SVD method, the performance of the projected MSSA is less sensitive to the truncation rank. Furthermore, the projected MSSA achieves denoising effectively by extracting smooth trajectories in a state space from noisy input data. Expectedly, the projected MSSA will be effective for reducing random noise in not only PSP measurement data, but also various high-dimensional time-series data.
△ Less
Submitted 10 November, 2022; v1 submitted 14 March, 2022;
originally announced March 2022.
-
Towards mmWave V2X in 5G and Beyond to Support Automated Driving
Authors:
Kei Sakaguchi,
Ryuichi Fukatsu,
Tao Yu,
Eisuke Fukuda,
Kim Mahler,
Robert Heath,
Takeo Fujii,
Kazuaki Takahashi,
Alexey Khoryaev,
Satoshi Nagata,
Takayuki Shimizu
Abstract:
Millimeter wave provides high data rates for Vehicle-to-Everything (V2X) communications. This paper motivates millimeter wave to support automated driving and begins by explaining V2X use cases that support automated driving with references to several standardi-zation bodies. The paper gives a classification of existing V2X stand-ards: IEEE802.11p and LTE V2X, along with the status of their com-me…
▽ More
Millimeter wave provides high data rates for Vehicle-to-Everything (V2X) communications. This paper motivates millimeter wave to support automated driving and begins by explaining V2X use cases that support automated driving with references to several standardi-zation bodies. The paper gives a classification of existing V2X stand-ards: IEEE802.11p and LTE V2X, along with the status of their com-mercial deployment. Then, the paper provides a detailed assessment on how millimeter wave V2X enables the use case of cooperative perception. The explanations provide detailed rate calculations for this use case and show that millimeter wave is the only technology able to achieve the requirements. Furthermore, specific challenges related to millimeter wave for V2X are described, including cover-age enhancement and beam alignment. The paper concludes with some results from three studies, i.e. IEEE802.11ad (WiGig) based V2X, extension of 5G NR (New Radio) toward mmWave V2X, and prototypes of intelligent street with mmWave V2X.
△ Less
Submitted 18 November, 2020;
originally announced November 2020.
-
Adversarial Patch Attacks on Monocular Depth Estimation Networks
Authors:
Koichiro Yamanaka,
Ryutaroh Matsumoto,
Keita Takahashi,
Toshiaki Fujii
Abstract:
Thanks to the excellent learning capability of deep convolutional neural networks (CNN), monocular depth estimation using CNNs has achieved great success in recent years. However, depth estimation from a monocular image alone is essentially an ill-posed problem, and thus, it seems that this approach would have inherent vulnerabilities. To reveal this limitation, we propose a method of adversarial…
▽ More
Thanks to the excellent learning capability of deep convolutional neural networks (CNN), monocular depth estimation using CNNs has achieved great success in recent years. However, depth estimation from a monocular image alone is essentially an ill-posed problem, and thus, it seems that this approach would have inherent vulnerabilities. To reveal this limitation, we propose a method of adversarial patch attack on monocular depth estimation. More specifically, we generate artificial patterns (adversarial patches) that can fool the target methods into estimating an incorrect depth for the regions where the patterns are placed. Our method can be implemented in the real world by physically placing the printed patterns in real scenes. We also analyze the behavior of monocular depth estimation under attacks by visualizing the activation levels of the intermediate layers and the regions potentially affected by the adversarial attack.
△ Less
Submitted 6 October, 2020;
originally announced October 2020.
-
The Rising Sun Envelope Method: an automatic and accurate peak location technique for XANES measurements
Authors:
Rafael Monteiro,
Itsuki Miyazato,
Keisuke Takahashi
Abstract:
The lack of theoretical understanding of X-Ray Absorption Near Edge Structure (XANES) spectroscopy makes the development of analysis tools for its study a necessity. Here, an algorithm for judicious choice of local minima and maxima points of XANES spectrum (experimental or simulated) is proposed, without any loss of information on peaks location nor on peak strength. We call it the Rising Sun Env…
▽ More
The lack of theoretical understanding of X-Ray Absorption Near Edge Structure (XANES) spectroscopy makes the development of analysis tools for its study a necessity. Here, an algorithm for judicious choice of local minima and maxima points of XANES spectrum (experimental or simulated) is proposed, without any loss of information on peaks location nor on peak strength. We call it the Rising Sun Envelope Method, since it is based on successive regularizations of the spectral measurement that, according to parameter choices that are intrinsic to the measurements, keep peaks location and strength as invariants. This is the first method that finds peaks in XANES automatically, without depending on first derivative information. Nevertheless, a direct computation of Absorption-Edge is provided, where we avoid the issue inflection point computations based on the XANES second derivative, dealing instead with simpler computations of inflection points of higher quality cubic spline approximation. Besides applications of the algorithm to XANES, we illustrate further applications in Electron Energy Loss Spectroscopy (EELS) and Raman spectra.
△ Less
Submitted 13 September, 2019;
originally announced September 2019.
