-
Test-time Adaptation Meets Image Enhancement: Improving Accuracy via Uncertainty-aware Logit Switching
Authors:
Shohei Enomoto,
Naoya Hasegawa,
Kazuki Adachi,
Taku Sasaki,
Shin'ya Yamaguchi,
Satoshi Suzuki,
Takeharu Eda
Abstract:
Deep neural networks have achieved remarkable success in a variety of computer vision applications. However, there is a problem of degrading accuracy when the data distribution shifts between training and testing. As a solution of this problem, Test-time Adaptation~(TTA) has been well studied because of its practicality. Although TTA methods increase accuracy under distribution shift by updating t…
▽ More
Deep neural networks have achieved remarkable success in a variety of computer vision applications. However, there is a problem of degrading accuracy when the data distribution shifts between training and testing. As a solution of this problem, Test-time Adaptation~(TTA) has been well studied because of its practicality. Although TTA methods increase accuracy under distribution shift by updating the model at test time, using high-uncertainty predictions is known to degrade accuracy. Since the input image is the root of the distribution shift, we incorporate a new perspective on enhancing the input image into TTA methods to reduce the prediction's uncertainty. We hypothesize that enhancing the input image reduces prediction's uncertainty and increase the accuracy of TTA methods. On the basis of our hypothesis, we propose a novel method: Test-time Enhancer and Classifier Adaptation~(TECA). In TECA, the classification model is combined with the image enhancement model that transforms input images into recognition-friendly ones, and these models are updated by existing TTA methods. Furthermore, we found that the prediction from the enhanced image does not always have lower uncertainty than the prediction from the original image. Thus, we propose logit switching, which compares the uncertainty measure of these predictions and outputs the lower one. In our experiments, we evaluate TECA with various TTA methods and show that TECA reduces prediction's uncertainty and increases accuracy of TTA methods despite having no hyperparameters and little parameter overhead.
△ Less
Submitted 26 March, 2024;
originally announced March 2024.
-
High-order alloharmonics produced by nonperiodic drivers
Authors:
M. S. Pirozhkova,
K. Ogura,
A. Sagisaka,
T. Zh. Esirkepov,
A. Ya. Faenov,
T. A. Pikuz,
H. Kotaki,
Y. Hayashi,
Y. Fukuda,
J. K. Koga,
S. V. Bulanov,
H. Daido,
N. Hasegawa,
M. Ishino,
M. Nishikino,
M. Koike,
T. Kawachi,
H. Kiriyama,
M. Kando,
D. Neely,
A. S. Pirozhkov
Abstract:
High-order harmonics are ubiquitous in nature and present in electromagnetic, acoustic, and gravitational waves. They are generated by periodic nonlinear processes or periodic high-frequency pulses. However, this periodicity is often inexact, such as that in chirped (frequency-swept) optical waveforms or interactions with nonstationary matter -- for instance, reflection from accelerating mirrors.…
▽ More
High-order harmonics are ubiquitous in nature and present in electromagnetic, acoustic, and gravitational waves. They are generated by periodic nonlinear processes or periodic high-frequency pulses. However, this periodicity is often inexact, such as that in chirped (frequency-swept) optical waveforms or interactions with nonstationary matter -- for instance, reflection from accelerating mirrors. Spectra observed in such cases contain complicated sets of harmonic-like fringes. We encountered such fringes in our experiment on coherent extreme ultraviolet generation via BISER, and could not interpret them using currently available knowledge. Here, we present a comprehensive theory based on interference of harmonics with different orders fully explaining the formation of these fringes, which we call alloharmonics. Like atomic spectra, the complex alloharmonic spectra depend on several integer numbers and bear a unique imprint of the emission process, which the theory can decipher, avoiding confusion or misinterpretation. We also demonstrate the alloharmonics in simulations of gravitational waves emitted by binary black hole mergers. Further, we predict the presence of alloharmonics in the radio spectra of pulsars and in optical frequency combs, and propose their use for measurement of extremely small accelerations necessary for testing gravity theories. The alloharmonics phenomenon generalizes classical harmonics and is critical in research fields such as laser mode locking, frequency comb generation, attosecond pulse generation, pulsar studies, and future gravitational wave spectroscopy.
△ Less
Submitted 1 June, 2023;
originally announced June 2023.
-
Exploring Weight Balancing on Long-Tailed Recognition Problem
Authors:
Naoya Hasegawa,
Issei Sato
Abstract:
Recognition problems in long-tailed data, in which the sample size per class is heavily skewed, have gained importance because the distribution of the sample size per class in a dataset is generally exponential unless the sample size is intentionally adjusted. Various methods have been devised to address these problems.Recently, weight balancing, which combines well-known classical regularization…
▽ More
Recognition problems in long-tailed data, in which the sample size per class is heavily skewed, have gained importance because the distribution of the sample size per class in a dataset is generally exponential unless the sample size is intentionally adjusted. Various methods have been devised to address these problems.Recently, weight balancing, which combines well-known classical regularization techniques with two-stage training, has been proposed. Despite its simplicity, it is known for its high performance compared with existing methods devised in various ways. However, there is a lack of understanding as to why this method is effective for long-tailed data. In this study, we analyze weight balancing by focusing on neural collapse and the cone effect at each training stage and found that it can be decomposed into an increase in Fisher's discriminant ratio of the feature extractor caused by weight decay and cross entropy loss and implicit logit adjustment caused by weight decay and class-balanced loss. Our analysis enables the training method to be further simplified by reducing the number of training stages to one while increasing accuracy. Code is available at https://github.com/HN410/Exploring-Weight-Balancing-on-Long-Tailed-Recognition-Problem.
△ Less
Submitted 28 April, 2024; v1 submitted 25 May, 2023;
originally announced May 2023.
-
Electronic phase diagram of Cr-doped VO2 epitaxial films studied by in situ photoemission spectroscopy
Authors:
D. Shiga,
X. Cheng,
T. T. Kim,
T. Kanda,
N. Hasegawa,
M. Kitamura,
K. Yoshimatsu,
H. Kumigashira
Abstract:
Through in situ photoemission spectroscopy (PES), we investigated the changes in the electronic structure of Cr-doped VO2 films coherently grown on TiO2 (001) substrates. The electronic phase diagram of CrxV1-xO2 is drawn by a combination of electric and spectroscopic measurements. The phase diagram is similar to that of bulk CrxV1-xO2, while the temperature of metal-insulator transition (TMIT) is…
▽ More
Through in situ photoemission spectroscopy (PES), we investigated the changes in the electronic structure of Cr-doped VO2 films coherently grown on TiO2 (001) substrates. The electronic phase diagram of CrxV1-xO2 is drawn by a combination of electric and spectroscopic measurements. The phase diagram is similar to that of bulk CrxV1-xO2, while the temperature of metal-insulator transition (TMIT) is significantly suppressed by the epitaxial strain effect. In the range of x = 0-0.04, where TMIT remains unchanged as a function of x, the PES spectra show dramatic change across TMIT, demonstrating the characteristic spectral changes associated with the Peierls phenomenon. In contrast, for x > 0.04, the TMIT linearly increases, and the metal-insulator transition (MIT) may disappear at x = 0.08-0.12. The PES spectra at x = 0.08 exhibit pseudogap behavior near the Fermi level, whereas the characteristic temperature-induced change remains almost intact, suggesting the existence of local V-V dimerization. The suppression of V-V dimerization with increasing x was confirmed by polarization-dependent x-ray absorption spectroscopy. These spectroscopic investigations reveal that the energy gap and V 3d states are essentially unchanged with 0 $\le$ x $\le$ 0.08 despite the suppression of V-V dimerization. The invariance of the energy gap with respect to x suggests that the MIT in CrxV1-xO2 arises primarily from the strong electron correlations, namely the Peierls-assisted Mott transition. Meanwhile, the pseudogap at x = 0.08 eventually evolves to a full gap (Mott gap) at x = 0.12, which is consistent with the disappearance of the temperature-dependent MIT in the electronic phase diagram. These results demonstrate that a Mott insulating phase without V-V dimerization is stabilized at x > 0.08 as a result of the superiority of Mott instability over the Peierls one.
△ Less
Submitted 25 November, 2022;
originally announced November 2022.
-
Electronic band structure of Ti2O3 thin films studied by angle-resolved photoemission spectroscopy
Authors:
Naoto Hasegawa,
Kohei Yoshimatsu,
Daisuke Shiga,
Tatsuhiko Kanda,
Satoru Miyazaki,
Miho Kitamura,
Koji Horiba,
Hiroshi Kumigashira
Abstract:
Ti2O3 exhibits a unique metal-insulator transition (MIT) at approximately 450 K over a wide temperature range of ~ 150 K. This broad MIT accompanied by lattice deformation differs from the sharp MITs observed in most other transition-metal oxides. A long-standing issue is determining the role of electron-electron correlation in the electronic structure and MIT of Ti2O3. However, the lack of inform…
▽ More
Ti2O3 exhibits a unique metal-insulator transition (MIT) at approximately 450 K over a wide temperature range of ~ 150 K. This broad MIT accompanied by lattice deformation differs from the sharp MITs observed in most other transition-metal oxides. A long-standing issue is determining the role of electron-electron correlation in the electronic structure and MIT of Ti2O3. However, the lack of information about the band structure of Ti2O3 has hindered investigating the origin of its unusual physical properties. Here, we report the electronic band structure of insulating Ti2O3 films with slight hole do** by angle-resolved photoemission spectroscopy (ARPES). ARPES showed clear band dispersion on the surface of single-crystalline epitaxial films. The experimentally obtained band structures were compared with band-structure calculation results based on density functional theory (DFT) with generalized gradient approximation + U correction. The obtained band structures are in good agreement with the DFT calculations at U = 2.2 eV, suggesting that electron-electron correlation plays an important role in the electronic structure of Ti2O3. Furthermore, the detailed analyses with varying U suggest that the origin of the characteristic MIT in Ti2O3 is a semimetal-semimetal or semimetal-semiconductor transition caused by changes in the Fermi surface due to lattice deformation.
△ Less
Submitted 10 May, 2022;
originally announced May 2022.
-
Comment on "Phase-space consideration on barrier transmission in a time-dependent variational approach with superposed wave packets (arXiv:2201.02966)"
Authors:
N. Hasegawa,
K. Hagino,
Y. Tanimura
Abstract:
We reply to the criticisms of our publication (N. Hasegawa, K. Hagino, and Y. Tanimura, Phys. Lett. B808, 135693 (2020)) made by A. Ono in his recent article, arXiv:2201.02966.
We reply to the criticisms of our publication (N. Hasegawa, K. Hagino, and Y. Tanimura, Phys. Lett. B808, 135693 (2020)) made by A. Ono in his recent article, arXiv:2201.02966.
△ Less
Submitted 30 January, 2022;
originally announced February 2022.
-
Nonlinear propagation effect in x-ray parametric amplification during high harmonic generation
Authors:
J. Seres,
E. Seres,
C. Serrat,
T. H. Dinh,
N. Hasegawa,
M. Ishino,
M. Nishikino,
K. Nakano,
S. Namba
Abstract:
We report the realization and characterization of parametric amplification in high harmonic generation around 100 eV using He gas in a double gas jet arrangement. The delay of the seed XUV pulse with respect to the amplifier gas jet was scanned by changing the distance between the gas jets. Experiments and numerical calculations show that parametric amplification occurs within a temporal window of…
▽ More
We report the realization and characterization of parametric amplification in high harmonic generation around 100 eV using He gas in a double gas jet arrangement. The delay of the seed XUV pulse with respect to the amplifier gas jet was scanned by changing the distance between the gas jets. Experiments and numerical calculations show that parametric amplification occurs within a temporal window of several optical cycles. Strong correlation between the seed and amplifier was observed in a shorter, few optical cycles delay range, which appeared as a modulation of the XUV intensity with an unexpected one optical cycle periodicity instead of half optical cycle. Simulations revealed that the strong correlation and also the unusual periodicity was the consequence of the nonlinear effect produced by plasma dispersion on the parametric amplification process during propagation in the amplifier jet.
△ Less
Submitted 26 January, 2022;
originally announced January 2022.
-
Electronic structure of SrTi$_{1-x}$V$_x$O$_3$ films studied by ${\it in\ situ}$ photoemission spectroscopy: Screening for a transparent electrode material
Authors:
Tatsuhiko Kanda,
Daisuke Shiga,
Ryu Yukawa,
Naoto Hasegawa,
Duy Khanh Nguyen,
Xianglin Cheng,
Ryosuke Tokunaga,
Miho Kitamura,
Koji Horiba,
Kohei Yoshimatsu,
Hiroshi Kumigashira
Abstract:
This study investigated the electronic structure of SrTi$_{1-x}$V$_x$O$_3$ (STVO) thin films, which are solid solutions of strongly correlated transparent conductive oxide (TCO) SrVO$_3$ and oxide semiconductor SrTiO$_3$, using ${in situ}$ photoemission spectroscopy. STVO is one of the most promising candidates for correlated-metal TCO because it has the capability of optimizing the performance of…
▽ More
This study investigated the electronic structure of SrTi$_{1-x}$V$_x$O$_3$ (STVO) thin films, which are solid solutions of strongly correlated transparent conductive oxide (TCO) SrVO$_3$ and oxide semiconductor SrTiO$_3$, using ${in situ}$ photoemission spectroscopy. STVO is one of the most promising candidates for correlated-metal TCO because it has the capability of optimizing the performance of transparent electrodes by varying ${x}$. Systematic and significant spectral changes were found near the Fermi level (${E_{\rm F}}$) as a function of ${x}$, while the overall electronic structure of STVO is in good agreement with the prediction of band structure calculations. As ${x}$ decreases from 1.0, spectral weight transfer occurs from the coherent band near ${E_{\rm F}}$ to the incoherent states (lower Hubbard band) around 1.0-1.5 eV. Simultaneously, a pseudogap is formed at ${E_{\rm F}}$, indicating a significant reduction in quasiparticle spectral weight within close vicinity of ${E_{\rm F}}$. This pseudogap seems to evolve into an energy gap at ${x}$ = 0.4, suggesting the occurrence of a composition-driven metal-insulator transition. From angle-resolved photoemission spectroscopic results, the carrier concentration ${n}$ changes proportionally as a function of ${x}$ in the metallic range of ${x}$ = 0.6-1.0. In contrast, the mass enhancement factor, which is proportional to the effective mass (${m^*}$), does not change significantly with varying ${x}$. These results suggest that the key factor of ${n/m^*}$ in optimizing the performance of correlated-metal TCO is tuned by ${x}$, highlighting the potential of STVO to achieve the desired TCO performance in the metallic region.
△ Less
Submitted 22 May, 2021;
originally announced May 2021.
-
Time-Dependent Generator Coordinate Method for Many-Particle Tunneling
Authors:
N. Hasegawa,
K. Hagino,
Y. Tanimura
Abstract:
It has been known that the time-dependent Hartree-Fock (TDHF) method, or the time-dependent density functional theory (TDDFT), fails to describe many-body quantum tunneling. We overcome this problem by superposing a few time-dependent Slater determinants with the time-dependent generator coordinate method (TDGCM). We apply this method to scattering of two $α$ particles in one dimension, and demons…
▽ More
It has been known that the time-dependent Hartree-Fock (TDHF) method, or the time-dependent density functional theory (TDDFT), fails to describe many-body quantum tunneling. We overcome this problem by superposing a few time-dependent Slater determinants with the time-dependent generator coordinate method (TDGCM). We apply this method to scattering of two $α$ particles in one dimension, and demonstrate that the TDGCM method yields a finite tunneling probability even at energies below the Coulomb barrier, at which the tunneling probability is exactly zero in the TDHF. This is the first case in which a many-particle tunneling is simulated with a microscopic real-time approach.
△ Less
Submitted 12 June, 2020;
originally announced June 2020.
-
Thickness dependence of electronic and crystal structures in VO$_2$ ultrathin films: suppression of the collaborative Mott-Peierls transition
Authors:
D. Shiga,
B. E. Yang,
N. Hasegawa,
T. Kanda,
R. Tokunaga,
K. Yoshimatsu,
R. Yukawa,
M. Kitamura,
K. Horiba,
H. Kumigashira
Abstract:
Through ${in~situ}$ photoemission spectroscopy, we investigated the change in the electronic and crystal structures of dimensionality-controlled VO$_2$ films coherently grown on TiO$_2$(001) substrates. In the nanostructured films, the balance between the instabilities of a bandlike Peierls transition and a Mott transition is controlled as a function of thickness. The characteristic spectral chang…
▽ More
Through ${in~situ}$ photoemission spectroscopy, we investigated the change in the electronic and crystal structures of dimensionality-controlled VO$_2$ films coherently grown on TiO$_2$(001) substrates. In the nanostructured films, the balance between the instabilities of a bandlike Peierls transition and a Mott transition is controlled as a function of thickness. The characteristic spectral change associated with temperature-driven metal-insulator transition in VO$_2$ thick films holds down to 1.5 nm (roughly corresponding to five V atoms along the [001] direction), whereas VO$_2$ films of less than 1.0 nm exhibit insulating nature without V-V dimerization. These results suggest that the delicate balance between a Mott instability and a bandlike Peierls instability is modulated at a scale of a few nanometers by the dimensional crossover effects and confinement effects, which consequently induce the complicated electronic phase diagram of ultrathin VO$_2$ films.
△ Less
Submitted 1 May, 2020;
originally announced May 2020.
-
Parametric attosecond pulse amplification far from the ionization threshold from high order harmonic generation in He$^+$
Authors:
C. Serrat,
J. Seres,
E. Seres,
T-H. Dinh,
N. Hasegawa,
M. Nishikino,
S. Namba
Abstract:
Parametric amplification of attosecond coherent pulses around 100 eV at the single-atom level is demonstrated for the first time by using the 3D time-dependent Schr{ö}dinger equation in high-harmonic generation processes from excited states of He$^+$. We present the attosecond dynamics of the amplification process far from the ionization threshold and resolve the physics behind it. The amplificati…
▽ More
Parametric amplification of attosecond coherent pulses around 100 eV at the single-atom level is demonstrated for the first time by using the 3D time-dependent Schr{ö}dinger equation in high-harmonic generation processes from excited states of He$^+$. We present the attosecond dynamics of the amplification process far from the ionization threshold and resolve the physics behind it. The amplification of a particular central photon energy requires the seed XUV pulses to be perfectly synchronized in time with the driving laser field for stimulated recombination to the He$^+$ ground state and is only produced in a few specific laser cycles in agreement with the experimental measurements. Our simulations show that the amplified photon energy region can be controlled by varying the peak intensity of the laser field. Our results pave the way to the realization of compact attosecond pulse intense XUV lasers with broad applications.
△ Less
Submitted 25 May, 2020; v1 submitted 27 March, 2020;
originally announced March 2020.
-
Magnetization process of the S = 1/2 two-leg organic spin-ladder compound BIP-BNO
Authors:
Kazuya Nomura,
Yasuhiro H. Matsuda,
Yasuo Narumi,
Koichi Kindo,
Shojiro Takeyama,
Yuko Hosokoshi,
Toshio Ono,
Naoya Hasegawa,
Hidemaro Suwa,
Synge Todo
Abstract:
We have measured the magnetization of the organic compound BIP-BNO (3,5'-bis(N-tert-butylaminoxyl)-3',5-dibromobiphenyl) up to 76 T where the magnetization is saturated. The S = 1/2 antiferromagnetic Heisenberg two-leg spin-ladder model accounts for the obtained experimental data regarding the magnetization curve, which is clarified using the quantum Monte Carlo method. The exchange constants on t…
▽ More
We have measured the magnetization of the organic compound BIP-BNO (3,5'-bis(N-tert-butylaminoxyl)-3',5-dibromobiphenyl) up to 76 T where the magnetization is saturated. The S = 1/2 antiferromagnetic Heisenberg two-leg spin-ladder model accounts for the obtained experimental data regarding the magnetization curve, which is clarified using the quantum Monte Carlo method. The exchange constants on the rung and the side rail of the ladder are estimated to be J(rung)/kB = 65.7 K and J(leg)/kB = 14.1 K, respectively, deeply in the strong coupling region: J(rung)/J(leg) > 1.
△ Less
Submitted 24 June, 2017;
originally announced June 2017.
-
Burst intensification by singularity emitting radiation in multi-stream flows
Authors:
A. S. Pirozhkov,
T. Zh. Esirkepov,
T. A. Pikuz,
A. Ya. Faenov,
K. Ogura,
Y. Hayashi,
H. Kotaki,
E. N. Ragozin,
D. Neely,
H. Kiriyama,
J. K. Koga,
Y. Fukuda,
A. Sagisaka,
M. Nishikino,
T. Imazono,
N. Hasegawa,
T. Kawachi,
P. R. Bolton,
H. Daido,
Y. Kato,
K. Kondo,
S. V. Bulanov,
M. Kando
Abstract:
In various media the elementary components can emit traveling waves such as electromagnetic, gravitational or acoustic types. If these elementary emitters are synchronized, the resulting emission is coherent. Moreover, the faster the emitters approach an observer, the more intense and directional their apparent emission is, with associated frequency increase. Multi-stream flows ubiquitously occur…
▽ More
In various media the elementary components can emit traveling waves such as electromagnetic, gravitational or acoustic types. If these elementary emitters are synchronized, the resulting emission is coherent. Moreover, the faster the emitters approach an observer, the more intense and directional their apparent emission is, with associated frequency increase. Multi-stream flows ubiquitously occur in media (such as with shock waves and jets in astrophysical and laboratory plasmas) and produce fast moving density singularities, where high concentration and synchronism can bring constructive interference. However, a singularity emitting such characteristic coherent radiation has not been demonstrated yet. We show this general phenomenon in laser-driven relativistic plasma, which is an ideal medium for realizing these effects in the laboratory under controllable conditions. Our experiments and simulations reveal bright coherent soft x-ray radiation from nanoscale electron density singularities in multi-stream plasma. They constitute a new compact x-ray source of ultrashort duration, demanded in numerous applications. In general, singularities can be bright sources of other types of traveling waves. Thus our findings open new opportunities in different fields of science. For example, gravitational wave generation, as proposed in ultrahigh-energy accelerators, can be significantly enhanced by intentionally induced density singularities in the particle bunches. Further, we anticipate that multi-stream flows in cosmic media can produce intense bursts of coherent electromagnetic and/or gravitational waves, especially at longer wavelengths which facilitate constructive interference. We can then expect to observe more directional short wavelength bursts from cosmic emitters approaching at relativistic speeds. Thus, we present a new framework for interpreting a broad range of experimental results.
△ Less
Submitted 16 November, 2016;
originally announced November 2016.
-
Liquid is More Rigid than Solid in a High-Frequency Region
Authors:
Naoki Hasegawa,
Tatsuro Yuge,
Akira Shimizu
Abstract:
We compare rigidity of materials in two phases, liquid and solid phases. As a measure of the rigidity, we employ the one characterizing how firmly the material is fixed by low density of pinning centers, such as impurities and rough surfaces of walls, against a weak force. Although a solid is more rigid than a liquid against a low-frequency force, we find that against a high-frequency force the li…
▽ More
We compare rigidity of materials in two phases, liquid and solid phases. As a measure of the rigidity, we employ the one characterizing how firmly the material is fixed by low density of pinning centers, such as impurities and rough surfaces of walls, against a weak force. Although a solid is more rigid than a liquid against a low-frequency force, we find that against a high-frequency force the liquid becomes more rigid than the solid of the same material. Since this result is derived from universal properties of a response function, it is valid for wide classes of materials, including quantum and classical systems and crystalline and amorphous solids. An instructive example is studied using nonequilibrium molecular dynamics simulations. We find that the frequency region in which a solid is more flexible than a liquid is not purely determined by intrinsic properties of the solid. It depends also on extrinsic factors such as the density of pinning centers.
△ Less
Submitted 1 December, 2015; v1 submitted 2 December, 2014;
originally announced December 2014.
