Showing 1–50 of 64 results for author: Kinoshita, Y

A provable control of sensitivity of neural networks through a direct parameterization of the overall bi-Lipschitzness

Authors: Yuri Kinoshita, Taro Toyoizumi

Abstract: While neural networks can enjoy an outstanding flexibility and exhibit unprecedented performance, the mechanism behind their behavior is still not well-understood. To tackle this fundamental challenge, researchers have tried to restrict and manipulate some of their properties in order to gain new insights and better control on them. Especially, throughout the past few years, the concept of \emph{b… ▽ More While neural networks can enjoy an outstanding flexibility and exhibit unprecedented performance, the mechanism behind their behavior is still not well-understood. To tackle this fundamental challenge, researchers have tried to restrict and manipulate some of their properties in order to gain new insights and better control on them. Especially, throughout the past few years, the concept of \emph{bi-Lipschitzness} has been proved as a beneficial inductive bias in many areas. However, due to its complexity, the design and control of bi-Lipschitz architectures are falling behind, and a model that is precisely designed for bi-Lipschitzness realizing a direct and simple control of the constants along with solid theoretical analysis is lacking. In this work, we investigate and propose a novel framework for bi-Lipschitzness that can achieve such a clear and tight control based on convex neural networks and the Legendre-Fenchel duality. Its desirable properties are illustrated with concrete experiments. We also apply this framework to uncertainty estimation and monotone problem settings to illustrate its broad range of applications. △ Less

Submitted 15 April, 2024; originally announced April 2024.

Microwave Hall measurements using a circularly polarized dielectric cavity

Authors: M. Roppongi, T. Arakawa, Y. Yoshino, K. Ishihara, Y. Kinoshita, M. Tokunaga, Y. Matsuda, K. Hashimoto, T. Shibauchi

Abstract: We have developed a circularly polarized dielectric rutile (TiO$_2$) cavity with a high quality-factor that can generate circularly polarized microwaves from two orthogonal linearly polarized microwaves with a phase difference of $\pmπ/2$ using a hybrid coupler. Using this cavity, we have established a new methodology to measure the microwave Hall conductivity of a small single crystal of metals i… ▽ More We have developed a circularly polarized dielectric rutile (TiO$_2$) cavity with a high quality-factor that can generate circularly polarized microwaves from two orthogonal linearly polarized microwaves with a phase difference of $\pmπ/2$ using a hybrid coupler. Using this cavity, we have established a new methodology to measure the microwave Hall conductivity of a small single crystal of metals in the skin-depth region. Based on the cavity perturbation technique, we have shown that all components of the surface impedance tensor can be extracted under the application of a magnetic field by comparing the right- and left-handed circularly polarization modes. To verify the validity of the developed method, we performed test measurements on tiny Bi single crystals at low temperatures. As a result, we have successfully obtained the surface impedance tensor components and confirmed that the characteristic field dependence of the ac Hall angle in the microwave region is consistent with the expectation from the dc transport measurements. These results demonstrate a significant improvement in sensitivity compared to previous methods. Thus, our developed technique allows more accurate microwave Hall measurements, opening the way for new approaches to explore novel topological quantum materials, such as time-reversal symmetry-breaking superconductors. △ Less

Submitted 15 April, 2024; originally announced April 2024.

Comments: 10 pages, 6 figures

Active nematic liquid crystals under a quenched random field

Authors: Yutaka Kinoshita, Nariya Uchida

Abstract: Coupling between flow and orientation is a central issue in understanding the collective dynamics of active biofilaments and cells. Active stressess generated by motor activity destroy (quasi-)long-range orientational order and induce chaotic vortex flows. In cellular and subcellular environment, alignment is also hindered by heterogeneous filamentous structures in extracellular matrix and various… ▽ More Coupling between flow and orientation is a central issue in understanding the collective dynamics of active biofilaments and cells. Active stressess generated by motor activity destroy (quasi-)long-range orientational order and induce chaotic vortex flows. In cellular and subcellular environment, alignment is also hindered by heterogeneous filamentous structures in extracellular matrix and various organelles in a cell. Here we address the effects of a quenched random field on the flow patterns and orientational order in two-dimensional active nematic liquid crystals. We found that the director dynamics is frozen above a critical disorder strength. For sufficiently strong randomness, the orientational correlation function decays exponentially with the distance, reproducing the behavior of passive random-field nematics. In contrast, the flow velocity decreases only gradually as the randomness is increased, and develops a logarithmic spatial correlation for strong disorder. The threshold between the activity- and disorder-dominated regimes is specified and its dependence on the activity parameter is discussed. △ Less

Submitted 7 May, 2024; v1 submitted 12 April, 2024; originally announced April 2024.

Comments: 6 pages, 4 figures

Power Series Composition in Near-Linear Time

Authors: Yasunori Kinoshita, Baitian Li

Abstract: We present an algebraic algorithm that computes the composition of two power series in $\mathop{\tilde{\mathrm O}}(n)$ time complexity. The previous best algorithms are $\mathop{\mathrm O}(n^{1+o(1)})$ by Kedlaya and Umans (FOCS 2008) and an $\mathop{\mathrm O}(n^{1.43})$ algebraic algorithm by Neiger, Salvy, Schost and Villard (JACM 2023). Our algorithm builds upon the recent Graeffe iteration… ▽ More We present an algebraic algorithm that computes the composition of two power series in $\mathop{\tilde{\mathrm O}}(n)$ time complexity. The previous best algorithms are $\mathop{\mathrm O}(n^{1+o(1)})$ by Kedlaya and Umans (FOCS 2008) and an $\mathop{\mathrm O}(n^{1.43})$ algebraic algorithm by Neiger, Salvy, Schost and Villard (JACM 2023). Our algorithm builds upon the recent Graeffe iteration approach to manipulate rational power series introduced by Bostan and Mori (SOSA 2021). △ Less

Submitted 7 April, 2024; originally announced April 2024.

Comments: 12 pages

ACM Class: I.1.2

Breakdown of Kubo relation in Pt-Cu nanoparticle

Authors: Shunsaku Kitagawa, Yudai Kinoshita, Kenji Ishida, Kouhei Kusada, Hiroshi Kitagawa

Abstract: Nanoparticles were predicted to exhibit unique physical properties due to quantum size effects, but their identification remains difficult. According to Kubo's theory, the gap size is inversely correlated with both the density of states at the Fermi energy and the number of atoms in the particle. Previously, we confirmed that the particle size and magnetic field dependence of NMR anomaly temperatu… ▽ More Nanoparticles were predicted to exhibit unique physical properties due to quantum size effects, but their identification remains difficult. According to Kubo's theory, the gap size is inversely correlated with both the density of states at the Fermi energy and the number of atoms in the particle. Previously, we confirmed that the particle size and magnetic field dependence of NMR anomaly temperature is consistent with the estimated "Kubo" gap. Here, we investigated the density-of-states dependence in the Pt$_{1-x}$Cu$_{x}$ nanoparticles. While an enhancement of nuclear spin-lattice relaxation rate $1/T_1$ at low temperatures was clearly observed for the Pt-rich nanoparticles, such behavior was abruptly suppressed in the Cu-rich nanoparticles. Furthermore, the NMR anomaly temperature is nearly unchanged with varying the density of states. Our findings indicate that the quantum size effect contains more profound physics than just the ones predicted by Kubo. △ Less

Submitted 25 January, 2024; originally announced January 2024.

Comments: 4 pages, 4 figures

Journal ref: Phys. Rev. B 109, L041408 (2024)

High-field immiscibility of electrons belonging to adjacent twinned bismuth crystals

Authors: Yuhao Ye, Akiyoshi Yamada, Yuto Kinoshita, **hua Wang, Pan Nie, Liangcai Xu, Huakun Zuo, Masashi Tokunaga, Neil Harrison, Ross D. McDonald, Alexey V. Suslov, Arzhang Ardavan, Moon-Sun Nam, David LeBoeuf, Cyril Proust, Benoît Fauqué, Yuki Fuseya, Zengwei Zhu, Kamran Behnia

Abstract: Bulk bismuth has a complex Landau spectrum. The small effective masses and the large g-factors are anisotropic. The chemical potential drifts at high magnetic fields. Moreover, twin boundaries further complexify the interpretation of the data by producing extra anomalies in the extreme quantum limit. Here, we present a study of angle dependence of magnetoresistance up to 65 T in bismuth complement… ▽ More Bulk bismuth has a complex Landau spectrum. The small effective masses and the large g-factors are anisotropic. The chemical potential drifts at high magnetic fields. Moreover, twin boundaries further complexify the interpretation of the data by producing extra anomalies in the extreme quantum limit. Here, we present a study of angle dependence of magnetoresistance up to 65 T in bismuth complemented with Nernst, ultrasound, and magneto-optic data. All observed anomalies can be explained in a single-particle picture of a sample consisting of two twinned crystals tilted by 108$^{\circ}$ and with two adjacent crystals kee** their own chemical potentials despite a shift between chemical potentials as large as 68 meV at 65 T. This implies an energy barrier between adjacent twinned crystals reminiscent of a metal-semiconductor Schottky barrier or a p-n junction. We argue that this barrier is built by accumulating charge carriers of opposite signs across a twin boundary. △ Less

Submitted 15 February, 2024; v1 submitted 10 October, 2023; originally announced October 2023.

Comments: 11 pages, 7 figures

Journal ref: npj Quantum Materials 9,12 (2024)

Low-temperature hysteresis broadening emerging from domain-wall creep dynamics in a two-phase competing system

Authors: Keisuke Matsuura, Yo Nishizawa, Yuto Kinoshita, Takashi Kurumaji, Atsushi Miyake, Hiroshi Oike, Masashi Tokunaga, Yoshinori Tokura, Fumitaka Kagawa

Abstract: Hysteretic behaviour accompanies any first-order phase transition, forming a basis for many applications. However, its quantitative understanding remains challenging, and even a qualitative understanding of pronounced hysteresis broadening at low temperature, which is often observed in magnetic-field-induced first-order phase transition materials, is unclear. Here, we show that such pronounced hys… ▽ More Hysteretic behaviour accompanies any first-order phase transition, forming a basis for many applications. However, its quantitative understanding remains challenging, and even a qualitative understanding of pronounced hysteresis broadening at low temperature, which is often observed in magnetic-field-induced first-order phase transition materials, is unclear. Here, we show that such pronounced hysteresis broadening emerges if the phase-front velocity during the first-order phase transition exhibits an activated behaviour as a function of both temperature and magnetic field. This is demonstrated by using real-space magnetic imaging techniques, for the magnetic-field-induced first-order phase transition between antiferromagnetic and ferrimagnetic phases in (Fe$_{0.95}$Zn$_{0.05}$)$_{2}$Mo$_{3}$O$_{8}$. When combined with the Kolmogorov-Avrami-Ishibashi model, the observed activated temperature- and field-dependences of the growth velocity of the emerging antiferromagnetic domain quantitatively reproduce the pronounced hysteresis broadening. Furthermore, the same approach also reproduces the field-sweep-rate dependence of the transition field observed in the experiment. Our findings thus provide a quantitative and comprehensive understanding of pronounced hysteresis broadening from the microscopic perspective of domain growth. △ Less

Submitted 18 September, 2023; originally announced September 2023.

Comments: 32 pages, 8 figures

Journal ref: Communications Materials 4, 71 (2023)

Effects of strain-tunable valleys on charge transport in bismuth

Authors: Suguru Hosoi, Fumu Tachibana, Mai Sakaguchi, Kentaro Ishida, Masaaki Shimozawa, Koichi Izawa, Yuki Fuseya, Yuto Kinoshita, Masashi Tokunaga

Abstract: The manipulation of the valley degree of freedom can boost the technological development of novel functional devices based on valleytronics. The current mainstream platform for valleytronics is to produce a monolayer with inversion asymmetry, in which the strain-band engineering through the substrates can serve to improve the performance of valley-based devices. However, pinpointing the effective… ▽ More The manipulation of the valley degree of freedom can boost the technological development of novel functional devices based on valleytronics. The current mainstream platform for valleytronics is to produce a monolayer with inversion asymmetry, in which the strain-band engineering through the substrates can serve to improve the performance of valley-based devices. However, pinpointing the effective role of strain is inevitable for the precise design of the desired valley structure. Here, we demonstrate the charge transport under continuously controllable external strain for bulk bismuth crystals with three equivalent electron valleys and one hole valley. The strain response of resistance, namely elastoresistance, exhibits the evolutions in both antisymmetric and symmetric channels with decreasing temperature. The elastoresistance behaviors mainly reflect the significant changes in valley density depending on the symmetry of induced strain, evidenced by our strain-dependent quantum oscillation measurements and first-principle band calculations under strain. These facts suggest the successful tune and evaluation of the valley populations through strain-dependent charge valley transport. △ Less

Submitted 2 April, 2024; v1 submitted 11 September, 2023; originally announced September 2023.

Comments: Main text: 13 pages with 7 figures, DFT calculation results are added

Magnetic-domain-dependent pseudogap induced by Fermi surface nesting in a centrosymmetric skyrmion magnet

Authors: Yuyang Dong, Yuto Kinoshita, Masayuki Ochi, Ryu Nakachi, Ryuji Higashinaka, Satoru Hayami, Yuxuan Wan, Yosuke Arai, Soonsang Huh, Makoto Hashimoto, Donghui Lu, Masashi Tokunaga, Yuji Aoki, Tatsuma D. Matsuda, Takeshi Kondo

Abstract: Skyrmions in non-centrosymmetric materials are believed to occur due to the Dzyaloshinskii-Moriya interaction. In contrast, the skyrmion formation mechanism in centrosymmetric materials remains elusive. Among those, Gd-based compounds are the prototype compounds; however, their electronic structure is not uncovered, even though it should be the foundation for elucidating the skyrmion mechanism. He… ▽ More Skyrmions in non-centrosymmetric materials are believed to occur due to the Dzyaloshinskii-Moriya interaction. In contrast, the skyrmion formation mechanism in centrosymmetric materials remains elusive. Among those, Gd-based compounds are the prototype compounds; however, their electronic structure is not uncovered, even though it should be the foundation for elucidating the skyrmion mechanism. Here, we reveal the intrinsic electronic structure of GdRu2Si2 for the first time by magnetic domain selective measurements of angle-resolved photoemission spectroscopy (ARPES). In particular, we find the robust Fermi surface (FS) nesting, consistent with the q-vector detected by the previous resonant X-ray scattering (RXS) measurements. Most importantly, we find that the pseudogap is opened at the nested portions of FS at low temperatures. The momentum locations of the pseudogap vary for different magnetic domains, most likely having a direct relationship with the screw-type spin modulation that changes direction for each domain. Intriguingly, the anomalous pseudogap disconnects the FS to generate Fermi arcs with 2-fold symmetry. These results indicate the significance of Ruderman-Kittel-Kasuya-Yosida (RKKY) interaction, in which itinerant electrons mediate to stabilize the local magnetic moment, as the mechanism for the magnetism in the Gd-based skyrmion magnets. Our data also predict that the momentum space where the pseudogap opens is doubled (or Fermi arcs shrink) and thereby stabilizes the skyrmion phase under a magnetic field. Furthermore, we demonstrate the flexible nature of magnetism in GdRu2Si2 by manipulating magnetic domains with a magnetic field and temperature cyclings, providing a possibility of future application for data storage and processing device with centrosymmetric skyrmion magnets. △ Less

Submitted 16 July, 2023; originally announced July 2023.

Observation of nonvolatile magneto-thermal switching in superconductors

Authors: Hiroto Arima, Md. Riad Kasem, Hossein Sepehri-Amin, Fuyuki Ando, Ken-ichi Uchida, Yuto Kinoshita, Masashi Tokunaga, Yoshikazu Mizuguchi

Abstract: Applying a magnetic field to a solid changes its thermal-transport properties. Although such magneto-thermal-transport phenomena are usually small effects, giant magneto-thermal resistance has recently been observed in spintronic materials1,2 and superconductors3,4, opening up new possibilities in thermal management technologies. However, the thermal conductivity conventionally changes only when a… ▽ More Applying a magnetic field to a solid changes its thermal-transport properties. Although such magneto-thermal-transport phenomena are usually small effects, giant magneto-thermal resistance has recently been observed in spintronic materials1,2 and superconductors3,4, opening up new possibilities in thermal management technologies. However, the thermal conductivity conventionally changes only when a magnetic field is applied due to the absence of nonvolatility, which limits potential applications of thermal switching devices5,6. Here, we report the observation of nonvolatile thermal switching that changes the thermal conductivity when a magnetic field is applied and retains the value even when the field is turned off. This unconventional magneto-thermal switching, surprisingly, arises in commercial Sn-Pb solders and is realized by phase-separated superconducting states and resultant nonuniform magnetic flux distributions. This result confirms the versatility of the observed phenomenon and aids the development of active solid-state thermal management devices. △ Less

Submitted 27 September, 2023; v1 submitted 12 July, 2023; originally announced July 2023.

Comments: 33 pages, 5 figures & 9 extended data figures

Controlling Posterior Collapse by an Inverse Lipschitz Constraint on the Decoder Network

Authors: Yuri Kinoshita, Kenta Oono, Kenji Fukumizu, Yuichi Yoshida, Shin-ichi Maeda

Abstract: Variational autoencoders (VAEs) are one of the deep generative models that have experienced enormous success over the past decades. However, in practice, they suffer from a problem called posterior collapse, which occurs when the encoder coincides, or collapses, with the prior taking no information from the latent structure of the input data into consideration. In this work, we introduce an invers… ▽ More Variational autoencoders (VAEs) are one of the deep generative models that have experienced enormous success over the past decades. However, in practice, they suffer from a problem called posterior collapse, which occurs when the encoder coincides, or collapses, with the prior taking no information from the latent structure of the input data into consideration. In this work, we introduce an inverse Lipschitz neural network into the decoder and, based on this architecture, provide a new method that can control in a simple and clear manner the degree of posterior collapse for a wide range of VAE models equipped with a concrete theoretical guarantee. We also illustrate the effectiveness of our method through several numerical experiments. △ Less

Submitted 2 February, 2024; v1 submitted 25 April, 2023; originally announced April 2023.

Comments: accepted to ICML 2023, some notations adjusted from the submitted version

A field-induced reentrant insulator state of a gap-closed topological insulator (Bi_{1-x}Sb_x) in quantum-limit states

Authors: Y. Kinoshita, T. Fujita, R. Kurihara, A. Miyake, Y. Izaki, Y. Fuseya, M. Tokunaga

Abstract: In the extreme quantum limit states under high magnetic fields, enhanced electronic correlation effects can stabilize anomalous quantum states. Using band-tuning with a magnetic field, we realized a spin-polarized quantum limit state in the field-induced semimetallic phase of a topological insulator Bi_{1-x}Sb_x. Further increase in the field injects more electrons and holes to this state and resu… ▽ More In the extreme quantum limit states under high magnetic fields, enhanced electronic correlation effects can stabilize anomalous quantum states. Using band-tuning with a magnetic field, we realized a spin-polarized quantum limit state in the field-induced semimetallic phase of a topological insulator Bi_{1-x}Sb_x. Further increase in the field injects more electrons and holes to this state and results in an unexpected reentrant insulator state in this topological semimetallic state. A single-particle picture cannot explain this reentrant insulator state, reminiscent of phase transitions due to many-body effects. Estimates of the binding energy and spacing of electron-hole pairs and the thermal de Broglie wavelength indicate that Bi_{1-x}Sb_x may host the excitonic insulator phase in this extreme environment. △ Less

Submitted 27 February, 2023; originally announced February 2023.

Comments: 26pages, 6figures

Flow patterns and defect dynamics of active nematics under an electric field

Authors: Yutaka Kinoshita, Nariya Uchida

Abstract: The effects of an electric field on the flow patterns and defect dynamics of two-dimensional active nematics are numerically investigated. We found that field-induced director reorientation causes anisotropic active turbulence characterized by enhanced flow perpendicular to the electric field. The average flow speed and its anisotropy are maximized at an intermediate field strength. Topological de… ▽ More The effects of an electric field on the flow patterns and defect dynamics of two-dimensional active nematics are numerically investigated. We found that field-induced director reorientation causes anisotropic active turbulence characterized by enhanced flow perpendicular to the electric field. The average flow speed and its anisotropy are maximized at an intermediate field strength. Topological defects in the anisotropic active turbulence are localized and show characteristic dynamics {with simultaneous creation of} two pairs of defects. A laning state characterized by stripe domains with alternating flow directions is found at a larger field strength near the transition to the uniformly aligned state. We obtained periodic oscillations between the laning state and active turbulence, which resembles an experimental observation of active nematics subject to anisotropic friction. △ Less

Submitted 20 May, 2023; v1 submitted 16 February, 2023; originally announced February 2023.

Comments: 13 pages, 7 figures

Journal ref: Phys. Rev. E 108, 014605 (2023)

Template matching with white balance adjustment under multiple illuminants

Authors: Teruaki Akazawa, Yuma Kinoshita, Hitoshi Kiya

Abstract: In this paper, we propose a novel template matching method with a white balancing adjustment, called N-white balancing, which was proposed for multi-illuminant scenes. To reduce the influence of lighting effects, N-white balancing is applied to images for multi-illumination color constancy, and then a template matching method is carried out by using adjusted images. In experiments, the effectivene… ▽ More In this paper, we propose a novel template matching method with a white balancing adjustment, called N-white balancing, which was proposed for multi-illuminant scenes. To reduce the influence of lighting effects, N-white balancing is applied to images for multi-illumination color constancy, and then a template matching method is carried out by using adjusted images. In experiments, the effectiveness of the proposed method is demonstrated to be effective in object detection tasks under various illumination conditions. △ Less

Submitted 3 August, 2022; originally announced August 2022.

Comments: \c{opyright} 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

Image and Model Transformation with Secret Key for Vision Transformer

Authors: Hitoshi Kiya, Ryota Iijima, MaungMaung Aprilpyone, Yuma Kinoshita

Abstract: In this paper, we propose a combined use of transformed images and vision transformer (ViT) models transformed with a secret key. We show for the first time that models trained with plain images can be directly transformed to models trained with encrypted images on the basis of the ViT architecture, and the performance of the transformed models is the same as models trained with plain images when… ▽ More In this paper, we propose a combined use of transformed images and vision transformer (ViT) models transformed with a secret key. We show for the first time that models trained with plain images can be directly transformed to models trained with encrypted images on the basis of the ViT architecture, and the performance of the transformed models is the same as models trained with plain images when using test images encrypted with the key. In addition, the proposed scheme does not require any specially prepared data for training models or network modification, so it also allows us to easily update the secret key. In an experiment, the effectiveness of the proposed scheme is evaluated in terms of performance degradation and model protection performance in an image classification task on the CIFAR-10 dataset. △ Less

Submitted 20 July, 2022; v1 submitted 12 July, 2022; originally announced July 2022.

Comments: 10 pages, 5 figures

Privacy-Preserving Image Classification Using Vision Transformer

Authors: Zheng Qi, AprilPyone MaungMaung, Yuma Kinoshita, Hitoshi Kiya

Abstract: In this paper, we propose a privacy-preserving image classification method that is based on the combined use of encrypted images and the vision transformer (ViT). The proposed method allows us not only to apply images without visual information to ViT models for both training and testing but to also maintain a high classification accuracy. ViT utilizes patch embedding and position embedding for im… ▽ More In this paper, we propose a privacy-preserving image classification method that is based on the combined use of encrypted images and the vision transformer (ViT). The proposed method allows us not only to apply images without visual information to ViT models for both training and testing but to also maintain a high classification accuracy. ViT utilizes patch embedding and position embedding for image patches, so this architecture is shown to reduce the influence of block-wise image transformation. In an experiment, the proposed method for privacy-preserving image classification is demonstrated to outperform state-of-the-art methods in terms of classification accuracy and robustness against various attacks. △ Less

Submitted 24 May, 2022; originally announced May 2022.

Improved Convergence Rate of Stochastic Gradient Langevin Dynamics with Variance Reduction and its Application to Optimization

Authors: Yuri Kinoshita, Taiji Suzuki

Abstract: The stochastic gradient Langevin Dynamics is one of the most fundamental algorithms to solve sampling problems and non-convex optimization appearing in several machine learning applications. Especially, its variance reduced versions have nowadays gained particular attention. In this paper, we study two variants of this kind, namely, the Stochastic Variance Reduced Gradient Langevin Dynamics and th… ▽ More The stochastic gradient Langevin Dynamics is one of the most fundamental algorithms to solve sampling problems and non-convex optimization appearing in several machine learning applications. Especially, its variance reduced versions have nowadays gained particular attention. In this paper, we study two variants of this kind, namely, the Stochastic Variance Reduced Gradient Langevin Dynamics and the Stochastic Recursive Gradient Langevin Dynamics. We prove their convergence to the objective distribution in terms of KL-divergence under the sole assumptions of smoothness and Log-Sobolev inequality which are weaker conditions than those used in prior works for these algorithms. With the batch size and the inner loop length set to $\sqrt{n}$, the gradient complexity to achieve an $ε$-precision is $\tilde{O}((n+dn^{1/2}ε^{-1})γ^2 L^2α^{-2})$, which is an improvement from any previous analyses. We also show some essential applications of our result to non-convex optimization. △ Less

Submitted 18 November, 2022; v1 submitted 30 March, 2022; originally announced March 2022.

An Overview of Compressible and Learnable Image Transformation with Secret Key and Its Applications

Authors: Hitoshi Kiya, AprilPyone MaungMaung, Yuma Kinoshita, Shoko Imaizumi, Sayaka Shiota

Abstract: This article presents an overview of image transformation with a secret key and its applications. Image transformation with a secret key enables us not only to protect visual information on plain images but also to embed unique features controlled with a key into images. In addition, numerous encryption methods can generate encrypted images that are compressible and learnable for machine learning.… ▽ More This article presents an overview of image transformation with a secret key and its applications. Image transformation with a secret key enables us not only to protect visual information on plain images but also to embed unique features controlled with a key into images. In addition, numerous encryption methods can generate encrypted images that are compressible and learnable for machine learning. Various applications of such transformation have been developed by using these properties. In this paper, we focus on a class of image transformation referred to as learnable image encryption, which is applicable to privacy-preserving machine learning and adversarially robust defense. Detailed descriptions of both transformation algorithms and performances are provided. Moreover, we discuss robustness against various attacks. △ Less

Submitted 15 April, 2022; v1 submitted 26 January, 2022; originally announced January 2022.

Self-Supervised Intrinsic Image Decomposition Network Considering Reflectance Consistency

Authors: Yuma Kinoshita, Hitoshi Kiya

Abstract: We propose a novel intrinsic image decomposition network considering reflectance consistency. Intrinsic image decomposition aims to decompose an image into illumination-invariant and illumination-variant components, referred to as ``reflectance'' and ``shading,'' respectively. Although there are three consistencies that the reflectance and shading should satisfy, most conventional work does not su… ▽ More We propose a novel intrinsic image decomposition network considering reflectance consistency. Intrinsic image decomposition aims to decompose an image into illumination-invariant and illumination-variant components, referred to as ``reflectance'' and ``shading,'' respectively. Although there are three consistencies that the reflectance and shading should satisfy, most conventional work does not sufficiently account for consistency with respect to reflectance, owing to the use of a white-illuminant decomposition model and the lack of training images capturing the same objects under various illumination-brightness and -color conditions. For this reason, the three consistencies are considered in the proposed network by using a color-illuminant model and training the network with losses calculated from images taken under various illumination conditions. In addition, the proposed network can be trained in a self-supervised manner because various illumination conditions can easily be simulated. Experimental results show that our network can decompose images into reflectance and shading components. △ Less

Submitted 5 November, 2021; originally announced November 2021.

Spatially varying white balancing for mixed and non-uniform illuminants

Authors: Teruaki Akazawa, Yuma Kinoshita, Hitoshi Kiya

Abstract: In this paper, we propose a novel white balance adjustment, called "spatially varying white balancing," for single, mixed, and non-uniform illuminants. By using n diagonal matrices along with a weight, the proposed method can reduce lighting effects on all spatially varying colors in an image under such illumination conditions. In contrast, conventional white balance adjustments do not consider th… ▽ More In this paper, we propose a novel white balance adjustment, called "spatially varying white balancing," for single, mixed, and non-uniform illuminants. By using n diagonal matrices along with a weight, the proposed method can reduce lighting effects on all spatially varying colors in an image under such illumination conditions. In contrast, conventional white balance adjustments do not consider the correcting of all colors except under a single illuminant. Also, multi-color balance adjustments can map multiple colors into corresponding ground truth colors, although they may cause the rank deficiency problem to occur as a non-diagonal matrix is used, unlike white balancing. In an experiment, the effectiveness of the proposed method is shown under mixed and non-uniform illuminants, compared with conventional white and multi-color balancing. Moreover, under a single illuminant, the proposed method has almost the same performance as the conventional white balancing. △ Less

Submitted 3 September, 2021; originally announced September 2021.

Separated-Spectral-Distribution Estimation Based on Bayesian Inference with Single RGB Camera

Authors: Yuma Kinoshita, Hitoshi Kiya

Abstract: In this paper, we propose a novel method for separately estimating spectral distributions from images captured by a typical RGB camera. The proposed method allows us to separately estimate a spectral distribution of illumination, reflectance, or camera sensitivity, while recent hyperspectral cameras are limited to capturing a joint spectral distribution from a scene. In addition, the use of Bayesi… ▽ More In this paper, we propose a novel method for separately estimating spectral distributions from images captured by a typical RGB camera. The proposed method allows us to separately estimate a spectral distribution of illumination, reflectance, or camera sensitivity, while recent hyperspectral cameras are limited to capturing a joint spectral distribution from a scene. In addition, the use of Bayesian inference makes it possible to take into account prior information of both spectral distributions and image noise as probability distributions. As a result, the proposed method can estimate spectral distributions in a unified way, and it can enhance the robustness of the estimation against noise, which conventional spectral-distribution estimation methods cannot. The use of Bayesian inference also enables us to obtain the confidence of estimation results. In an experiment, the proposed method is shown not only to outperform conventional estimation methods in terms of RMSE but also to be robust against noise. △ Less

Submitted 1 June, 2021; originally announced June 2021.

Comments: to appear in IEEE ICIP 2021

Multipole polaron in the devil's staircase of CeSb

Authors: Y. Arai, Kenta Kuroda, T. Nomoto, Z. H. Tin, S. Sakuragi, C. Bareille, S. Akebi, K. Kurokawa, Y. Kinoshita, W. -L. Zhang, S. Shin, M. Tokunaga, H. Kitazawa, Y. Haga, H. S. Suzuki, S. Miyasaka, S. Tajima, K. Iwasa, R. Arita, Takeshi Kondo

Abstract: Rare-earth intermetallic compounds exhibit rich phenomena induced by the interplay between localized $f$ orbitals and conduction electrons. However, since the energy scale of the crystal-electric-field splitting is only a few millielectronvolts, the nature of the mobile electrons accompanied by collective crystal-electric-field excitations has not been unveiled. Here, we examine the low-energy ele… ▽ More Rare-earth intermetallic compounds exhibit rich phenomena induced by the interplay between localized $f$ orbitals and conduction electrons. However, since the energy scale of the crystal-electric-field splitting is only a few millielectronvolts, the nature of the mobile electrons accompanied by collective crystal-electric-field excitations has not been unveiled. Here, we examine the low-energy electronic structures of CeSb through the anomalous magnetostructural transitions below the N$é$el temperature, $\sim$17 K, termed the 'devil's staircase', using laser angle-resolved photoemission, Raman and neutron scattering spectroscopies. We report another type of electron-boson coupling between mobile electrons and quadrupole crystal-electric-field excitations of the 4$f$ orbitals, which renormalizes the Sb 5$p$ band prominently, yielding a kink at a very low energy ($\sim$7 meV). This coupling strength is strong and exhibits anomalous step-like enhancement during the devil's staircase transition, unveiling a new type of quasiparticle, named the 'multipole polaron', comprising a mobile electron dressed with a cloud of the quadrupole crystal-electric-field polarization. △ Less

Submitted 23 February, 2022; v1 submitted 25 May, 2021; originally announced May 2021.

Comments: 21 pages, 4 figures

Journal ref: Nature Materials (2022)

Multi-color balance for color constancy

Authors: Teruaki Akazawa, Yuma Kinoshita, Hitoshi Kiya

Abstract: In this paper, we propose a novel multi-color balance adjustment for color constancy. The proposed method, called "n-color balancing," allows us not only to perfectly correct n target colors on the basis of corresponding ground truth colors but also to correct colors other than the n colors. In contrast, although white-balancing can perfectly adjust white, colors other than white are not considere… ▽ More In this paper, we propose a novel multi-color balance adjustment for color constancy. The proposed method, called "n-color balancing," allows us not only to perfectly correct n target colors on the basis of corresponding ground truth colors but also to correct colors other than the n colors. In contrast, although white-balancing can perfectly adjust white, colors other than white are not considered in the framework of white-balancing in general. In an experiment, the proposed multi-color balancing is demonstrated to outperform both conventional white and multi-color balance adjustments including Bradford's model. △ Less

Submitted 21 May, 2021; originally announced May 2021.

Comments: \c{opyright} 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

Deep Retinex Network for Estimating Illumination Colors with Self-Supervised Learning

Authors: Kouki Seo, Yuma Kinoshita, Hitoshi Kiya

Abstract: We propose a novel Retinex image-decomposition network that can be trained in a self-supervised manner. The Retinex image-decomposition aims to decompose an image into illumination-invariant and illumination-variant components, referred to as "reflectance" and "shading," respectively. Although there are three consistencies that the reflectance and shading should satisfy, most conventional work con… ▽ More We propose a novel Retinex image-decomposition network that can be trained in a self-supervised manner. The Retinex image-decomposition aims to decompose an image into illumination-invariant and illumination-variant components, referred to as "reflectance" and "shading," respectively. Although there are three consistencies that the reflectance and shading should satisfy, most conventional work considers only one or two of the consistencies. For this reason, the three consistencies are considered in the proposed network. In addition, by using generated pseudo-images for training, the proposed network can be trained with self-supervised learning. Experimental results show that our network can decompose images into reflectance and shading components. Furthermore, it is shown that the proposed network can be used for white-balance adjustment. △ Less

Submitted 8 February, 2021; originally announced February 2021.

Comments: Accepted by LifeTech 2021

Multi-color balancing for correctly adjusting the intensity of target colors

Authors: Teruaki Akazawa, Yuma Kinoshita, Hitoshi Kiya

Abstract: In this paper, we propose a novel multi-color balance method for reducing color distortions caused by lighting effects. The proposed method allows us to adjust three target-colors chosen by a user in an input image so that each target color is the same as the corresponding destination (benchmark) one. In contrast, white balancing is a typical technique for reducing the color distortions, however,… ▽ More In this paper, we propose a novel multi-color balance method for reducing color distortions caused by lighting effects. The proposed method allows us to adjust three target-colors chosen by a user in an input image so that each target color is the same as the corresponding destination (benchmark) one. In contrast, white balancing is a typical technique for reducing the color distortions, however, they cannot remove lighting effects on colors other than white. In an experiment, the proposed method is demonstrated to be able to remove lighting effects on selected three colors, and is compared with existing white balance adjustments. △ Less

Submitted 21 May, 2021; v1 submitted 3 February, 2021; originally announced February 2021.

Comments: \c{opyright} 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

Journal ref: In Proc. of 2021 IEEE 3rd Global Conference on Life Sciences and Technologies (LifeTech), pp.8-12, Mar., 2021

CycleGAN without checkerboard artifacts for counter-forensics of fake-image detection

Authors: Takayuki Osakabe, Miki Tanaka, Yuma Kinoshita, Hitoshi Kiya

Abstract: In this paper, we propose a novel CycleGAN without checkerboard artifacts for counter-forensics of fake-image detection. Recent rapid advances in image manipulation tools and deep image synthesis techniques, such as Generative Adversarial Networks (GANs) have easily generated fake images, so detecting manipulated images has become an urgent issue. Most state-of-the-art forgery detection methods as… ▽ More In this paper, we propose a novel CycleGAN without checkerboard artifacts for counter-forensics of fake-image detection. Recent rapid advances in image manipulation tools and deep image synthesis techniques, such as Generative Adversarial Networks (GANs) have easily generated fake images, so detecting manipulated images has become an urgent issue. Most state-of-the-art forgery detection methods assume that images include checkerboard artifacts which are generated by using DNNs. Accordingly, we propose a novel CycleGAN without any checkerboard artifacts for counter-forensics of fake-mage detection methods for the first time, as an example of GANs without checkerboard artifacts. △ Less

Submitted 1 December, 2020; originally announced December 2020.

Checkerboard-Artifact-Free Image-Enhancement Network Considering Local and Global Features

Authors: Yuma Kinoshita, Hitoshi Kiya

Abstract: In this paper, we propose a novel convolutional neural network (CNN) that never causes checkerboard artifacts, for image enhancement. In research fields of image-to-image translation problems, it is well-known that images generated by usual CNNs are distorted by checkerboard artifacts which mainly caused in forward-propagation of upsampling layers. However, checkerboard artifacts in image enhancem… ▽ More In this paper, we propose a novel convolutional neural network (CNN) that never causes checkerboard artifacts, for image enhancement. In research fields of image-to-image translation problems, it is well-known that images generated by usual CNNs are distorted by checkerboard artifacts which mainly caused in forward-propagation of upsampling layers. However, checkerboard artifacts in image enhancement have never been discussed. In this paper, we point out that applying U-Net based CNNs to image enhancement causes checkerboard artifacts. In contrast, the proposed network that contains fixed convolutional layers can perfectly prevent the artifacts. In addition, the proposed network architecture, which can handle both local and global features, enables us to improve the performance of image enhancement. Experimental results show that the use of fixed convolutional layers can prevent checkerboard artifacts and the proposed network outperforms state-of-the-art CNN-based image-enhancement methods in terms of various objective quality metrics: PSNR, SSIM, and NIQE. △ Less

Submitted 12 October, 2020; originally announced October 2020.

Comments: to appear in APSIPA ASC 2020. arXiv admin note: text overlap with arXiv:1905.02899

Domain Control by Adjusting Anisotropic Stress in Pyrochlore Oxide Cd2Re2O7

Authors: Satoshi Tajima, Daigorou Hirai, Yuto Kinoshita, Masashi Tokunaga, Kazuto Akiba, Tatsuo C. Kobayashi, Hishiro T. Hirose, Zenji Hiroi

Abstract: The 5d pyrochlore oxide Cd2Re2O7 exhibits successive phase transitions from a cubic pyrochlore structure (phase I) to a tetragonal structure without inversion symmetry below Ts1 of ~200 K (phase II) and further to another noncentrosymmetric tetragonal structure below Ts2 of ~120 K (phase III). The two low-temperature phases may be characterized by odd-parity multipolar orders induced by the Fermi… ▽ More The 5d pyrochlore oxide Cd2Re2O7 exhibits successive phase transitions from a cubic pyrochlore structure (phase I) to a tetragonal structure without inversion symmetry below Ts1 of ~200 K (phase II) and further to another noncentrosymmetric tetragonal structure below Ts2 of ~120 K (phase III). The two low-temperature phases may be characterized by odd-parity multipolar orders induced by the Fermi liquid instability of the spin-orbit-coupled metal. To control the tetragonal domains generated by the transitions and to obtain a single-domain crystal for the measurements of anisotropic properties, we prepared single crystals with the (0 0 1) surface and applied biaxial and uniaxial stresses along the plane. Polarizing optical microscopy observations revealed that inducing a small strain of approximately 0.05% could flip the twin domains ferroelastically in a reversible fashion at low temperatures, which evidences that the tetragonal deformation switches at Ts2 between c > a for phase II and c < a for phase III. Resistivity measurements using single-domain crystals under uniaxial stress showed that the anisotropy was maximum at around Ts2 and turned over across Ts2: resistivity along the c axis is larger (smaller) than that along the a axis by ~25% for phase II (III) at around Ts2. These large anisotropies probably originate from spin-dependent scattering in the spin-split Fermi surfaces of the cluster electric toroidal quadrupolar phases of Cd2Re2O7. △ Less

Submitted 30 September, 2020; originally announced September 2020.

Comments: 16 pages, 13 figures, J. Phys. Soc. Jpn in press

Journal ref: J. Phys. Soc. Jpn., Vol.89, No.11, Article ID: 114711 (2020)

Image Transformation Network for Privacy-Preserving Deep Neural Networks and Its Security Evaluation

Authors: Hiroki Ito, Yuma Kinoshita, Hitoshi Kiya

Abstract: We propose a transformation network for generating visually-protected images for privacy-preserving DNNs. The proposed transformation network is trained by using a plain image dataset so that plain images are transformed into visually protected ones. Conventional perceptual encryption methods have a weak visual-protection performance and some accuracy degradation in image classification. In contra… ▽ More We propose a transformation network for generating visually-protected images for privacy-preserving DNNs. The proposed transformation network is trained by using a plain image dataset so that plain images are transformed into visually protected ones. Conventional perceptual encryption methods have a weak visual-protection performance and some accuracy degradation in image classification. In contrast, the proposed network enables us not only to strongly protect visual information but also to maintain the image classification accuracy that using plain images achieves. In an image classification experiment, the proposed network is demonstrated to strongly protect visual information on plain images without any performance degradation under the use of CIFAR datasets. In addition, it is shown that the visually protected images are robust against a DNN-based attack, called inverse transformation network attack (ITN-Attack) in an experiment. △ Less

Submitted 7 August, 2020; originally announced August 2020.

Comments: To appear in 2020 IEEE 9th Global Conference on Consumer Electronics (GCCE 2020)

Hue-Correction Scheme Considering Non-Linear Camera Response for Multi-Exposure Image Fusion

Authors: Kouki Seo, Chihiro Go, Yuma Kinoshita, Hitoshi Kiya

Abstract: We propose a novel hue-correction scheme for multi-exposure image fusion (MEF). Various MEF methods have so far been studied to generate higher-quality images. However, there are few MEF methods considering hue distortion unlike other fields of image processing, due to a lack of a reference image that has correct hue. In the proposed scheme, we generate an HDR image as a reference for hue correcti… ▽ More We propose a novel hue-correction scheme for multi-exposure image fusion (MEF). Various MEF methods have so far been studied to generate higher-quality images. However, there are few MEF methods considering hue distortion unlike other fields of image processing, due to a lack of a reference image that has correct hue. In the proposed scheme, we generate an HDR image as a reference for hue correction, from input multi-exposure images. After that, hue distortion in images fused by an MEF method is removed by using hue information of the HDR one, on the basis of the constant-hue plane in the RGB color space. In simulations, the proposed scheme is demonstrated to be effective to correct hue-distortion caused by conventional MEF methods. Experimental results also show that the proposed scheme can generate high-quality images, regardless of exposure conditions of input multi-exposure images. △ Less

Submitted 18 July, 2020; originally announced July 2020.

A Privacy-Preserving Machine Learning Scheme Using EtC Images

Authors: Ayana Kawamura, Yuma Kinoshita, Takayuki Nakachi, Sayaka Shiota, Hitoshi Kiya

Abstract: We propose a privacy-preserving machine learning scheme with encryption-then-compression (EtC) images, where EtC images are images encrypted by using a block-based encryption method proposed for EtC systems with JPEG compression. In this paper, a novel property of EtC images is first discussed, although EtC ones was already shown to be compressible as a property. The novel property allows us to di… ▽ More We propose a privacy-preserving machine learning scheme with encryption-then-compression (EtC) images, where EtC images are images encrypted by using a block-based encryption method proposed for EtC systems with JPEG compression. In this paper, a novel property of EtC images is first discussed, although EtC ones was already shown to be compressible as a property. The novel property allows us to directly apply EtC images to machine learning algorithms non-specialized for computing encrypted data. In addition, the proposed scheme is demonstrated to provide no degradation in the performance of some typical machine learning algorithms including the support vector machine algorithm with kernel trick and random forests under the use of z-score normalization. A number of facial recognition experiments with are carried out to confirm the effectiveness of the proposed scheme. △ Less

Submitted 17 July, 2020; originally announced July 2020.

Comments: To appear in IEICE Trans. Fundamentals

Magnetic-Field Dependence of Novel Gap Behavior Related to the Quantum-Size Effect

Authors: Tomonori Okuno, Yuta Kinoshita, Satoshi Matsuzaki, Shunsaku Kitagawa, Kenji Ishida, Michihiro Hirata, Takahiko Sasaki, Kohei Kusada, Hiroshi Kitagawa

Abstract: $^{195}$Pt-NMR measurements of Pt nanoparticles with a mean diameter of 4.0 nm were performed in a high magnetic field of approximately $μ_0 H = 23.3$ T to investigate the low-temperature electronic state of the nanoparticles. The characteristic temperature $T^*$, below which the nuclear spin-lattice relaxation rate $1/T_1$ deviates from the relaxation rate of the bulk, shows a magnetic-field depe… ▽ More $^{195}$Pt-NMR measurements of Pt nanoparticles with a mean diameter of 4.0 nm were performed in a high magnetic field of approximately $μ_0 H = 23.3$ T to investigate the low-temperature electronic state of the nanoparticles. The characteristic temperature $T^*$, below which the nuclear spin-lattice relaxation rate $1/T_1$ deviates from the relaxation rate of the bulk, shows a magnetic-field dependence. This dependence supports the theoretical prediction of the appearance of discrete energy levels. △ Less

Submitted 15 July, 2020; originally announced July 2020.

Comments: 6 pages, 2 figures, To appear in short notes of J. Phys. Soc. Jpn

Devil's staircase transition of the electronic structures in CeSb

Authors: Kenta Kuroda, Y. Arai, N. Rezaei, S. Kunisada, S. Sakuragi, M. Alaei, Y. Kinoshita, C. Bareille, R. Noguchi, M. Nakayama, S. Akebi, M. Sakano, K. Kawaguchi, M. Arita, S. Ideta, K. Tanaka, H. Kitazawa, K. Okazaki, M. Tokunaga, Y. Haga, S. Shin, H. S. Suzuki, R. Arita, Takeshi Kondo

Abstract: Solids with competing interactions often undergo complex phase transitions with a variety of long-periodic modulations. Among such transition, devil's staircase is the most complex phenomenon, and for it, CeSb is the most famous material, where a number of the distinct phases with long-periodic magnetostructures sequentially appear below the Neel temperature. An evolution of the low-energy electro… ▽ More Solids with competing interactions often undergo complex phase transitions with a variety of long-periodic modulations. Among such transition, devil's staircase is the most complex phenomenon, and for it, CeSb is the most famous material, where a number of the distinct phases with long-periodic magnetostructures sequentially appear below the Neel temperature. An evolution of the low-energy electronic structure going through the devil's staircase is of special interest, which has, however, been elusive so far despite the 40-years of intense researches. Here we use bulk-sensitive angle-resolved photoemission spectroscopy and reveal the devil's staircase transition of the electronic structures. The magnetic reconstruction dramatically alters the band dispersions at each transition. We moreover find that the well-defined band picture largely collapses around the Fermi energy under the long-periodic modulation of the transitional phase, while it recovers at the transition into the lowest-temperature ground state. Our data provide the first direct evidence for a significant reorganization of the electronic structures and spectral functions occurring during the devil's staircase. △ Less

Submitted 8 June, 2020; v1 submitted 11 May, 2020; originally announced May 2020.

Comments: 22 pages, 5 figures

Journal ref: Nature Communications 11, 2888 (2020)

Hue Correction Scheme for Multi-Exposure Image Fusion Considering Hue Distortion in Input Images

Authors: Kouki Seo, Chihiro Go, Yuma Kinoshita, Hitoshi Kiya

Abstract: We propose a novel hue-correction scheme for multi-exposure image fusion (MEF). Various MEF methods have so far been studied to generate higher-quality images. However, there are few MEF methods considering hue distortion unlike other fields of image processing, due to a lack of a reference image that has correct hue. In the proposed scheme, we generate an HDR image as a reference for hue correcti… ▽ More We propose a novel hue-correction scheme for multi-exposure image fusion (MEF). Various MEF methods have so far been studied to generate higher-quality images. However, there are few MEF methods considering hue distortion unlike other fields of image processing, due to a lack of a reference image that has correct hue. In the proposed scheme, we generate an HDR image as a reference for hue correction, from input multi-exposure images. After that, hue distortion in an image fused by an MEF method is removed by using hue information of the HDR one, on the basis of the constant-hue plane in the RGB color space. In simulations, the proposed scheme is demonstrated to be effective to correct hue-distortion caused by conventional MEF methods. Experimental results also show that the proposed scheme can generate high-quality images, regardless of exposure conditions of input multi-exposure images. △ Less

Submitted 5 May, 2020; originally announced May 2020.

Comments: 2 pages, 4 figures, accepted by 2020 IEEE ICCE-TW

Fixed smooth convolutional layer for avoiding checkerboard artifacts in CNNs

Authors: Yuma Kinoshita, Hitoshi Kiya

Abstract: In this paper, we propose a fixed convolutional layer with an order of smoothness not only for avoiding checkerboard artifacts in convolutional neural networks (CNNs) but also for enhancing the performance of CNNs, where the smoothness of its filter kernel can be controlled by a parameter. It is well-known that a number of CNNs generate checkerboard artifacts in both of two process: forward-propag… ▽ More In this paper, we propose a fixed convolutional layer with an order of smoothness not only for avoiding checkerboard artifacts in convolutional neural networks (CNNs) but also for enhancing the performance of CNNs, where the smoothness of its filter kernel can be controlled by a parameter. It is well-known that a number of CNNs generate checkerboard artifacts in both of two process: forward-propagation of upsampling layers and backward-propagation of strided convolutional layers. The proposed layer can perfectly prevent checkerboard artifacts caused by strided convolutional layers or upsampling layers including transposed convolutional layers. In an image-classification experiment with four CNNs: a simple CNN, VGG8, ResNet-18, and ResNet-101, applying the fixed layers to these CNNs is shown to improve the classification performance of all CNNs. In addition, the fixed layer are applied to generative adversarial networks (GANs), for the first time. From image-generation results, a smoother fixed convolutional layer is demonstrated to enable us to improve the quality of images generated with GANs. △ Less

Submitted 6 February, 2020; originally announced February 2020.

Comments: 5 pages, to appear in IEEE International Conference on Acoustics, Speech, and Signal Processing 2020 (ICASSP 2020)

Spintronic superconductor in a bulk layered material with natural spin-valve structure

Authors: Shunsuke Sakuragi, S. Sasaki, R. Akashi, R. Sakagami, K. Kuroda, C. Bareille, T. Hashimoto, T. Nagashima, Y. Kinoshita, Y. Hirata, M. Shimozawa, S. Asai, T. Yajima, S. Doi, N. Tsujimoto, S. Kunisada, R. Noguchi, K. Kurokawa, N. Azuma, K. Hirata, Y. Yamasaki, H. Nakao, T. K. Kim, C. Cacho, T. Masuda , et al. (7 additional authors not shown)

Abstract: Multi-layered materials provide fascinating platforms to realize various functional properties, possibly leading to future electronic devices controlled by external fields. In particular, layered magnets coupled with conducting layers have been extensively studied recently for possible control of their transport properties via the spin structure. Successful control of quantum-transport properties… ▽ More Multi-layered materials provide fascinating platforms to realize various functional properties, possibly leading to future electronic devices controlled by external fields. In particular, layered magnets coupled with conducting layers have been extensively studied recently for possible control of their transport properties via the spin structure. Successful control of quantum-transport properties in the materials with antiferromagnetic (AFM) layers, so-called natural spin-valve structure, has been reported for the Dirac Fermion and topological/axion materials. However, a bulk crystal in which magnetic and superconducting layers are alternately stacked has not been realized until now, and the search for functional properties in it is an interesting yet unexplored field in material science. Here, we discover superconductivity providing such an ideal platform in EuSn2As2 with the van der Waals stacking of magnetic Eu layers and superconducting Sn-As layers, and present the first demonstration of a natural spin-valve effect on the superconducting current. Below the superconducting transition temperature (Tc), the electrical resistivity becomes zero in the in-plane direction. In contrast, it, surprisingly, remains finite down to the lowest temperature in the out-of-plane direction, mostly due to the structure of intrinsic magnetic Josephson junctions in EuSn2As2. The magnetic order of the Eu layers (or natural spin-valve) is observed to be extremely soft, allowing one to easy control of the out-of-plane to in-plane resistivities ratio from 1 to infinity by weak external magnetic fields. The concept of multi-functional materials with stacked magnetic-superconducting layers will open a new pathway to develop novel spintronic devices with magnetically controllable superconductivity. △ Less

Submitted 22 January, 2020; originally announced January 2020.

Comments: 17 pages, 4 figures

On the Security of Pixel-Based Image Encryption for Privacy-Preserving Deep Neural Networks

Authors: Warit Sirichotedumrong, Yuma Kinoshita, Hitoshi Kiya

Abstract: This paper aims to evaluate the safety of a pixel-based image encryption method, which has been proposed to apply images with no visual information to deep neural networks (DNN), in terms of robustness against ciphertext-only attacks (COA). In addition, we propose a novel DNN-based COA that aims to reconstruct the visual information of encrypted images. The effectiveness of the proposed attack is… ▽ More This paper aims to evaluate the safety of a pixel-based image encryption method, which has been proposed to apply images with no visual information to deep neural networks (DNN), in terms of robustness against ciphertext-only attacks (COA). In addition, we propose a novel DNN-based COA that aims to reconstruct the visual information of encrypted images. The effectiveness of the proposed attack is evaluated under two encryption key conditions: same encryption key, and different encryption keys. The results show that the proposed attack can recover the visual information of the encrypted images if images are encrypted under same encryption key. Otherwise, the pixel-based image encryption method has robustness against COA. △ Less

Submitted 9 December, 2019; originally announced December 2019.

Comments: Accepted in 2019 IEEE 8th Global Conference on Consumer Electronics (GCCE 2019). arXiv admin note: substantial text overlap with arXiv:1905.01827

Dynamic Evolution of Flux Distributions in a Pulse-driven Superconductor by High-speed Magneto-optical Imaging

Authors: H. Kurokawa, Y. Kinoshita, F. Nabeshima, M. Tokunaga, A. Maeda

Abstract: The accurate understanding of flux dynamics is essential for the design and operation of superconducting circuits. The time evolution of flux-density distribution in an NbN strip by the transport current was observed using high-speed magneto-optical microscopy. It was determined that even for the dynamic penetration and exclusion of vortices under the transport current, the surface barrier is esse… ▽ More The accurate understanding of flux dynamics is essential for the design and operation of superconducting circuits. The time evolution of flux-density distribution in an NbN strip by the transport current was observed using high-speed magneto-optical microscopy. It was determined that even for the dynamic penetration and exclusion of vortices under the transport current, the surface barrier is essential. This feature is important for the correct understanding of the complex behavior of state-of-the-art superconducting devices. △ Less

Submitted 29 May, 2020; v1 submitted 28 November, 2019; originally announced November 2019.

Privacy-Preserving Machine Learning Using EtC Images

Authors: Ayana Kawamura, Yuma Kinoshita, Hitoshi Kiya

Abstract: In this paper, we propose a novel privacy-preserving machine learning scheme with encrypted images, called EtC (Encryption-then-Compression) images. Using machine learning algorithms in cloud environments has been spreading in many fields. However, there are serious issues with it for end users, due to semi-trusted cloud providers. Accordingly, we propose using EtC images, which have been proposed… ▽ More In this paper, we propose a novel privacy-preserving machine learning scheme with encrypted images, called EtC (Encryption-then-Compression) images. Using machine learning algorithms in cloud environments has been spreading in many fields. However, there are serious issues with it for end users, due to semi-trusted cloud providers. Accordingly, we propose using EtC images, which have been proposed for EtC systems with JPEG compression. In this paper, a novel property of EtC images is considered under the use of z-score normalization. It is demonstrated that the use of EtC images allows us not only to protect visual information of images, but also to preserve both the Euclidean distance and the inner product between vectors. In addition, dimensionality reduction is shown to can be applied to EtC images for fast and accurate matching. In an experiment, the proposed scheme is applied to a facial recognition algorithm with classifiers for confirming the effectiveness of the scheme under the use of support vector machine (SVM) with the kernel trick. △ Less

Submitted 1 November, 2019; originally announced November 2019.

Comments: to be presented at IWAIT2020

Penalized quasi likelihood estimation for variable selection

Authors: Yoshiki Kinoshita, Nakahiro Yoshida

Abstract: Penalized methods are applied to quasi likelihood analysis for stochastic differential equation models. In this paper, we treat the quasi likelihood function and the associated statistical random field for which a polynomial type large deviation inequality holds. Then penalty terms do not disturb a polynomial type large deviation inequality. This property ensures the convergence of moments of the… ▽ More Penalized methods are applied to quasi likelihood analysis for stochastic differential equation models. In this paper, we treat the quasi likelihood function and the associated statistical random field for which a polynomial type large deviation inequality holds. Then penalty terms do not disturb a polynomial type large deviation inequality. This property ensures the convergence of moments of the associated estimator which plays an important role to evaluate the upper bound of the probability that model selection is incorrect. △ Less

Submitted 28 October, 2019; originally announced October 2019.

Comments: 28 pages

MSC Class: 62F12 (Primary) 62J07; 62M09 (Secondary)

An Image Fusion Scheme for Single-Shot High Dynamic Range Imaging with Spatially Varying Exposures

Authors: Chihiro Go, Yuma Kinoshita, Sayaka Shiota, Hitoshi Kiya

Abstract: This paper proposes a novel multi-exposure image fusion (MEF) scheme for single-shot high dynamic range imaging with spatially varying exposures (SVE). Single-shot imaging with SVE enables us not only to produce images without color saturation regions from a single-shot image, but also to avoid ghost artifacts in the producing ones. However, the number of exposures is generally limited to two, and… ▽ More This paper proposes a novel multi-exposure image fusion (MEF) scheme for single-shot high dynamic range imaging with spatially varying exposures (SVE). Single-shot imaging with SVE enables us not only to produce images without color saturation regions from a single-shot image, but also to avoid ghost artifacts in the producing ones. However, the number of exposures is generally limited to two, and moreover it is difficult to decide the optimum exposure values before the photographing. In the proposed scheme, a scene segmentation method is applied to input multi-exposure images, and then the luminance of the input images is adjusted according to both of the number of scenes and the relationship between exposure values and pixel values. The proposed method with the luminance adjustment allows us to improve the above two issues. In this paper, we focus on dual-ISO imaging as one of single-shot imaging. In an experiment, the proposed scheme is demonstrated to be effective for single-shot high dynamic range imaging with SVE, compared with conventional MEF schemes with exposure compensation. △ Less

Submitted 22 August, 2019; originally announced August 2019.

A hue-preserving tone map** scheme based on constant-hue plane without gamut problem

Authors: Yuma Kinoshita, Kouki Seo, Artit Visavakitcharoen, Hitoshi Kiya

Abstract: We propose a novel hue-preserving tone map** scheme. Various tone map** operations have been studied so far, but there are very few works on color distortion caused in image tone map**. First, LDR images produced from HDR ones by using conventional tone map** operators (TMOs) are pointed out to have some distortion in hue values due to clip** and rounding quantization processing. Next,we… ▽ More We propose a novel hue-preserving tone map** scheme. Various tone map** operations have been studied so far, but there are very few works on color distortion caused in image tone map**. First, LDR images produced from HDR ones by using conventional tone map** operators (TMOs) are pointed out to have some distortion in hue values due to clip** and rounding quantization processing. Next,we propose a novel method which allows LDR images to have the same maximally saturated color values as those of HDR ones. Generated LDR images by the proposed method have smaller hue degradation than LDR ones generated by conventional TMOs. Moreover, the proposed method is applicable to any TMOs. In an experiment, the proposed method is demonstrated not only to produce images with small hue degradation but also to maintain well-mapped luminance, in terms of three objective metrics: TMQI, hue value in CIEDE2000, and the maximally saturated color on the constant-hue plane in the RGB color space. △ Less

Submitted 18 August, 2019; originally announced August 2019.

Single-Shot High Dynamic Range Imaging with Spatially Varying Exposures Considering Hue Distortion

Authors: Chihiro Go, Yuma Kinoshita, Sayaka Shiota, Hitoshi Kiya

Abstract: We proposes a novel single-shot high dynamic range imaging scheme with spatially varying exposures (SVE) considering hue distortion. Single-shot imaging with SVE enables us to capture multi-exposure images from a single-shot image, so high dynamic range images can be produced without ghost artifacts. However, SVE images have some pixels at which a range supported by camera sensors is exceeded. The… ▽ More We proposes a novel single-shot high dynamic range imaging scheme with spatially varying exposures (SVE) considering hue distortion. Single-shot imaging with SVE enables us to capture multi-exposure images from a single-shot image, so high dynamic range images can be produced without ghost artifacts. However, SVE images have some pixels at which a range supported by camera sensors is exceeded. Therefore, generated images have some color distortion, so that conventional imaging with SVE has never considered the influence of this range limitation. To overcome this issue, we consider estimating the correct hue of a scene from raw images, and propose a method with the estimated hue information for correcting the hue of SVE images on the constant hue plain in the RGB color space. △ Less

Submitted 31 July, 2019; originally announced August 2019.

Comments: To appear in 2019 IEEE 8th Global Conference on Consumer Electronics

A Color Compensation Method Using Inverse Camera Response Function for Multi-exposure Image Fusion

Authors: Artit Visavakitcharoen, Yuma Kinoshita, Hitoshi Kiya

Abstract: Multi-exposure image fusion is a method for producing an image with a wide dynamic range by fusing multiple images taken under various exposure values. In this paper, we discuss color distortion included in fused images, and propose a novel color compensation method for multi-exposure image fusion. In the proposed method, an inverse camera response function (CRF) is estimated by using multi-exposu… ▽ More Multi-exposure image fusion is a method for producing an image with a wide dynamic range by fusing multiple images taken under various exposure values. In this paper, we discuss color distortion included in fused images, and propose a novel color compensation method for multi-exposure image fusion. In the proposed method, an inverse camera response function (CRF) is estimated by using multi-exposure images, and then a high dynamic range (HDR) radiance map is recovered. The color information of the radiance map is applied to images fused by conventional multi-exposure imaging to correct the color distortion. The proposed method can be applied to any existing fusion approaches for improving the quality of the fused images. △ Less

Submitted 26 July, 2019; originally announced July 2019.

Convolutional Neural Networks Considering Local and Global features for Image Enhancement

Authors: Yuma Kinoshita, Hitoshi Kiya

Abstract: In this paper, we propose a novel convolutional neural network (CNN) architecture considering both local and global features for image enhancement. Most conventional image enhancement methods, including Retinex-based methods, cannot restore lost pixel values caused by clip** and quantizing. CNN-based methods have recently been proposed to solve the problem, but they still have a limited performa… ▽ More In this paper, we propose a novel convolutional neural network (CNN) architecture considering both local and global features for image enhancement. Most conventional image enhancement methods, including Retinex-based methods, cannot restore lost pixel values caused by clip** and quantizing. CNN-based methods have recently been proposed to solve the problem, but they still have a limited performance due to network architectures not handling global features. To handle both local and global features, the proposed architecture consists of three networks: a local encoder, a global encoder, and a decoder. In addition, high dynamic range (HDR) images are used for generating training data for our networks. The use of HDR images makes it possible to train CNNs with better-quality images than images directly captured with cameras. Experimental results show that the proposed method can produce higher-quality images than conventional image enhancement methods including CNN-based methods, in terms of various objective quality metrics: TMQI, entropy, NIQE, and BRISQUE. △ Less

Submitted 7 May, 2019; originally announced May 2019.

Comments: To appear in Proc. ICIP2019. arXiv admin note: text overlap with arXiv:1901.05686

Privacy-Preserving Deep Neural Networks with Pixel-based Image Encryption Considering Data Augmentation in the Encrypted Domain

Authors: Warit Sirichotedumrong, Takahiro Maekawa, Yuma Kinoshita, Hitoshi Kiya

Abstract: We present a novel privacy-preserving scheme for deep neural networks (DNNs) that enables us not to only apply images without visual information to DNNs for both training and testing but to also consider data augmentation in the encrypted domain for the first time. In this paper, a novel pixel-based image encryption method is first proposed for privacy-preserving DNNs. In addition, a novel adaptat… ▽ More We present a novel privacy-preserving scheme for deep neural networks (DNNs) that enables us not to only apply images without visual information to DNNs for both training and testing but to also consider data augmentation in the encrypted domain for the first time. In this paper, a novel pixel-based image encryption method is first proposed for privacy-preserving DNNs. In addition, a novel adaptation network is considered that reduces the influence of image encryption. In an experiment, the proposed method is applied to a well-known network, ResNet-18, for image classification. The experimental results demonstrate that conventional privacy-preserving machine learning methods including the state-of-the-arts cannot be applied to data augmentation in the encrypted domain and that the proposed method outperforms them in terms of classification accuracy. △ Less

Submitted 6 May, 2019; originally announced May 2019.

Comments: Accepted in the 26th IEEE International Conference on Image Processing (ICIP2019)

A Noise-aware Enhancement Method for Underexposed Images

Authors: Chien-Cheng Chien, Yuma Kinoshita, Hitoshi Kiya

Abstract: A novel method of contrast enhancement is proposed for underexposed images, in which heavy noise is hidden. Under low light conditions, images taken by digital cameras have low contrast in dark or bright regions. This is due to a limited dynamic range that imaging sensors have. For these reasons, various contrast enhancement methods have been proposed so far. These methods, however, have two probl… ▽ More A novel method of contrast enhancement is proposed for underexposed images, in which heavy noise is hidden. Under low light conditions, images taken by digital cameras have low contrast in dark or bright regions. This is due to a limited dynamic range that imaging sensors have. For these reasons, various contrast enhancement methods have been proposed so far. These methods, however, have two problems: (1) The loss of details in bright regions due to over-enhancement of contrast. (2) The noise is amplified in dark regions because conventional enhancement methods do not consider noise included in images. The proposed method aims to overcome these problems. In the proposed method, a shadow-up function is applied to adaptive gamma correction with weighting distribution, and a denoising filter is also used to avoid noise being amplified in dark regions. As a result, the proposed method allows us not only to enhance contrast of dark regions, but also to avoid amplifying noise, even under strong noise environments. △ Less

Submitted 24 April, 2019; originally announced April 2019.

Comments: arXiv admin note: text overlap with arXiv:1811.03280

Scene Segmentation-Based Luminance Adjustment for Multi-Exposure Image Fusion

Authors: Yuma Kinoshita, Hitoshi Kiya

Abstract: We propose a novel method for adjusting luminance for multi-exposure image fusion. For the adjustment, two novel scene segmentation approaches based on luminance distribution are also proposed. Multi-exposure image fusion is a method for producing images that are expected to be more informative and perceptually appealing than any of the input ones, by directly fusing photos taken with different ex… ▽ More We propose a novel method for adjusting luminance for multi-exposure image fusion. For the adjustment, two novel scene segmentation approaches based on luminance distribution are also proposed. Multi-exposure image fusion is a method for producing images that are expected to be more informative and perceptually appealing than any of the input ones, by directly fusing photos taken with different exposures. However, existing fusion methods often produce unclear fused images when input images do not have a sufficient number of different exposure levels. In this paper, we point out that adjusting the luminance of input images makes it possible to improve the quality of the final fused images. This insight is the basis of the proposed method. The proposed method enables us to produce high-quality images, even when undesirable inputs are given. Visual comparison results show that the proposed method can produce images that clearly represent a whole scene. In addition, multi-exposure image fusion with the proposed method outperforms state-of-the-art fusion methods in terms of MEF-SSIM, discrete entropy, tone mapped image quality index, and statistical naturalness. △ Less

Submitted 18 March, 2019; originally announced March 2019.

Comments: will be published in IEEE Transactions on Image Processing

Deep Inverse Tone Map** Using LDR Based Learning for Estimating HDR Images with Absolute Luminance

Authors: Yuma Kinoshita, Hitoshi Kiya

Abstract: In this paper, a novel inverse tone map** method using a convolutional neural network (CNN) with LDR based learning is proposed. In conventional inverse tone map** with CNNs, generated HDR images cannot have absolute luminance, although relative luminance can. Moreover, loss functions suitable for learning HDR images are problematic, so it is difficult to train CNNs by directly using HDR image… ▽ More In this paper, a novel inverse tone map** method using a convolutional neural network (CNN) with LDR based learning is proposed. In conventional inverse tone map** with CNNs, generated HDR images cannot have absolute luminance, although relative luminance can. Moreover, loss functions suitable for learning HDR images are problematic, so it is difficult to train CNNs by directly using HDR images. In contrast, the proposed method enables us not only to estimate absolute luminance, but also to train a CNN by using LDR images. The CNN used in the proposed method learns a transformation from various input LDR images to LDR images mapped by Reinhard's global operator. Experimental results show that HDR images generated by the proposed method have higher-quality than HDR ones generated by conventional inverse tone map** methods,in terms of HDR-VDP-2.2 and PU encoding + MS-SSIM. △ Less

Submitted 28 February, 2019; originally announced March 2019.

Comments: arXiv admin note: substantial text overlap with arXiv:1901.05686

Analysis of Quantum Multi-Prover Zero-Knowledge Systems: Elimination of the Honest Condition and Computational Zero-Knowledge Systems for QMIP*

Authors: Yusuke Kinoshita

Abstract: Zero-knowledge and multi-prover systems are both central notions in classical and quantum complexity theory. There is, however, little research in quantum multi-prover zero-knowledge systems. This paper studies complexity-theoretical aspects of the quantum multi-prover zero-knowledge systems. This paper has two results: 1.QMIP* systems with honest zero-knowledge can be converted into general zer… ▽ More Zero-knowledge and multi-prover systems are both central notions in classical and quantum complexity theory. There is, however, little research in quantum multi-prover zero-knowledge systems. This paper studies complexity-theoretical aspects of the quantum multi-prover zero-knowledge systems. This paper has two results: 1.QMIP* systems with honest zero-knowledge can be converted into general zero-knowledge systems without any assumptions. 2.QMIP* has computational quantum zero-knowledge systems if a natural computational conjecture holds. One of the main tools is a test (called the GHZ test) that uses GHZ states shared by the provers, which prevents the verifier's attack in the above two results. Another main tool is what we call the Local Hamiltonian based Interactive protocol (LHI protocol). The LHI protocol makes previous research for Local Hamiltonians applicable to check the history state of interactive proofs, and we then apply Broadbent et al.'s zero-knowledge protocol for QMA \cite{BJSW} to quantum multi-prover systems in order to obtain the second result. △ Less

Submitted 27 February, 2019; originally announced February 2019.

Comments: 25 pages, 10 figures