-
Exploring the baryonic effect signature in the Hyper Suprime-Cam Year 3 cosmic shear two-point correlations on small scales: the $S_8$ tension remains present
Authors:
Ryo Terasawa,
Xiangchong Li,
Masahiro Takada,
Takahiro Nishimichi,
Satoshi Tanaka,
Sunao Sugiyama,
Toshiki Kurita,
Tianqing Zhang,
Masato Shirasaki,
Ryuichi Takahashi,
Hironao Miyatake,
Surhud More,
Atsushi J. Nishizawa
Abstract:
The baryonic feedback effect is considered as a possible solution to the so-called $S_8$ tension indicated in cosmic shear cosmology. The baryonic effect is more significant on smaller scales, and affects the cosmic shear two-point correlation functions (2PCFs) with different scale- and redshift-dependencies from those of the cosmological parameters. In this paper, we use the Hyper Suprime-Cam Yea…
▽ More
The baryonic feedback effect is considered as a possible solution to the so-called $S_8$ tension indicated in cosmic shear cosmology. The baryonic effect is more significant on smaller scales, and affects the cosmic shear two-point correlation functions (2PCFs) with different scale- and redshift-dependencies from those of the cosmological parameters. In this paper, we use the Hyper Suprime-Cam Year 3 (HSC-Y3) data to measure the cosmic shear 2PCFs ($ξ_{\pm}$) down to 0.28 arcminutes, taking full advantage of the high number density of source galaxies in the deep HSC data, to explore a possible signature of the baryonic effect. While the published HSC analysis used the cosmic shear 2PCFs on angular scales, which are sensitive to the matter power spectrum at $k\lesssim 1~h{\rm Mpc}^{-1}$, the smaller scale HSC cosmic shear signal allows us to probe the signature of matter power spectrum up to $k\simeq 20~h{\rm Mpc}^{-1}$. Using the accurate emulator of the nonlinear matter power spectrum, DarkEmulator2, we show that the dark matter-only model can provide an acceptable fit to the HSC-Y3 2PCFs down to the smallest scales. In other words, we do not find any clear signature of the baryonic effects or do not find a systematic shift in the $S_8$ value with the inclusion of the smaller-scale information as would be expected if the baryonic effect is significant. Alternatively, we use a flexible 6-parameter model of the baryonic effects, which can lead to both enhancement and suppression in the matter power spectrum compared to the dark matter-only model, to perform the parameter inference of the HSC-Y3 2PCFs. We find that the small-scale HSC data allow only a fractional suppression of up to 5 percent in the matter power spectrum at $k\sim 1~h{\rm Mpc}^{-1}$, which is not sufficient to reconcile the $S_8$ tension.
△ Less
Submitted 29 March, 2024;
originally announced March 2024.
-
Nonlinear redshift space distortion in halo ellipticity correlations: Analytical model and N-body simulations
Authors:
Teppei Okumura,
Atsushi Taruya,
Toshiki Kurita,
Takahiro Nishimichi
Abstract:
We present an analytic model of nonlinear correlators of galaxy/halo ellipticities in redshift space. The three-dimensional ellipticity field is not affected by the redshift-space distortion (RSD) at linear order, but by the nonlinear one, known as the Finger-of-God effect, caused by the coordinate transformation from real to redshift space. Adopting a simple Gaussian dam** function to describe…
▽ More
We present an analytic model of nonlinear correlators of galaxy/halo ellipticities in redshift space. The three-dimensional ellipticity field is not affected by the redshift-space distortion (RSD) at linear order, but by the nonlinear one, known as the Finger-of-God effect, caused by the coordinate transformation from real to redshift space. Adopting a simple Gaussian dam** function to describe the nonlinear RSD effect and the nonlinear alignment model for the relation between the observed ellipticity and underlying tidal fields, we derive analytic formulas for the multipole moments of the power spectra of the ellipticity field in redshift space expanded in not only the associated Legendre basis, a natural basis for the projected galaxy shape field, but also the standard Legendre basis, conventionally used in literature. The multipoles of the corresponding correlation functions of the galaxy shape field are shown to be expressed by a simple Hankel transform, as is the case for those of the conventional galaxy density correlations. We measure these multipoles of the power spectra and correlation functions of the halo ellipticity field using large-volume N-body simulations. We then show that the measured alignment signals can be better predicted by our nonlinear model than the existing linear alignment model. The formulas derived here have already been used to place cosmological constraints using from the redshift-space correlation functions of the galaxy shape field measured from the Sloan Digital Sky Survey (Okumura and Taruya, 2023).
△ Less
Submitted 31 March, 2024; v1 submitted 11 October, 2023;
originally announced October 2023.
-
HYMALAIA: A Hybrid Lagrangian Model for Intrinsic Alignments
Authors:
Francisco Maion,
Raul E. Angulo,
Thomas Bakx,
Nora Elisa Chisari,
Toshiki Kurita,
Marcos Pellejero-Ibáñez
Abstract:
The intrinsic alignment of galaxies is an important ingredient for modelling weak-lensing measurements, and a potentially valuable cosmological and astrophysical signal. In this paper, we present HYMALAIA: a new model to predict the intrinsic alignments of biased tracers. HYMALAIA is based on a perturbative expansion of the statistics of the Lagrangian shapes of objects, which is then advected to…
▽ More
The intrinsic alignment of galaxies is an important ingredient for modelling weak-lensing measurements, and a potentially valuable cosmological and astrophysical signal. In this paper, we present HYMALAIA: a new model to predict the intrinsic alignments of biased tracers. HYMALAIA is based on a perturbative expansion of the statistics of the Lagrangian shapes of objects, which is then advected to Eulerian space using the fully non-linear displacement field obtained from $N$-body simulations. We demonstrate that HYMALAIA is capable of consistently describing monopole and quadrupole of halo shape-shape and matter-shape correlators, and that, without increasing the number of free parameters, it does so more accurately than other perturbatively inspired models such as the non-linear alignment (NLA) model and the tidal-alignment-tidal-torquing (TATT) model.
△ Less
Submitted 6 June, 2024; v1 submitted 25 July, 2023;
originally announced July 2023.
-
What Does it Take to Control Global Temperatures? A toolbox for estimating the impact of economic policies on climate
Authors:
Guillaume Chevillon,
Takamitsu Kurita
Abstract:
This paper tests the feasibility and estimates the cost of climate control through economic policies. It provides a toolbox for a statistical historical assessment of a Stochastic Integrated Model of Climate and the Economy, and its use in (possibly counterfactual) policy analysis. Recognizing that stabilization requires supressing a trend, we use an integrated-cointegrated Vector Autoregressive M…
▽ More
This paper tests the feasibility and estimates the cost of climate control through economic policies. It provides a toolbox for a statistical historical assessment of a Stochastic Integrated Model of Climate and the Economy, and its use in (possibly counterfactual) policy analysis. Recognizing that stabilization requires supressing a trend, we use an integrated-cointegrated Vector Autoregressive Model estimated using a newly compiled dataset ranging between years A.D. 1000-2008, extending previous results on Control Theory in nonstationary systems. We test statistically whether, and quantify to what extent, carbon abatement policies can effectively stabilize or reduce global temperatures. Our formal test of policy feasibility shows that carbon abatement can have a significant long run impact and policies can render temperatures stationary around a chosen long run mean. In a counterfactual empirical illustration of the possibilities of our modeling strategy, we show that the cost of carbon abatement for a retrospective policy aiming to keep global temperatures close to their 1900 historical level is about 75% of the observed 2008 level of world GDP, a cost equivalent to reverting to levels of output historically observed in the mid 1960s. This constitutes a measure of the putative opportunity cost of the lack of investment in carbon abatement technologies.
△ Less
Submitted 11 July, 2023;
originally announced July 2023.
-
The Intrinsic Alignment of Galaxy Clusters and Impact of Projection Effects
Authors:
**g**g Shi,
Tomomi Sunayama,
Toshiki Kurita,
Masahiro Takada,
Sunao Sugiyama,
Rachel Mandelbaum,
Hironao Miyatake,
Surhud More,
Takahiro Nishimichi,
Harry Johnston
Abstract:
Galaxy clusters, being the most massive objects in the Universe, exhibit the strongest alignment with the large-scale structure. However, mis-identification of members due to projection effects from the large scale structure can occur. We studied the impact of projection effects on the measurement of the intrinsic alignment of galaxy clusters, using galaxy cluster mock catalogs. Our findings showe…
▽ More
Galaxy clusters, being the most massive objects in the Universe, exhibit the strongest alignment with the large-scale structure. However, mis-identification of members due to projection effects from the large scale structure can occur. We studied the impact of projection effects on the measurement of the intrinsic alignment of galaxy clusters, using galaxy cluster mock catalogs. Our findings showed that projection effects result in a decrease of the large scale intrinsic alignment signal of the cluster and produce a bump at $r_p\sim 1h^{-1}/Mpc$, most likely due to interlopers and missed member galaxies. This decrease in signal explains the observed similar alignment strength between bright central galaxies and clusters in the SDSS redMaPPer cluster catalog. The projection effect and cluster intrinsic alignment signal are coupled, with clusters having lower fractions of missing members or having higher fraction of interlopers exhibiting higher alignment signals in their projected shapes. We aim to use these findings to determine the impact of projection effects on galaxy cluster cosmology in future studies.
△ Less
Submitted 10 January, 2024; v1 submitted 16 June, 2023;
originally announced June 2023.
-
Effective Field Theory of Intrinsic Alignments at One Loop Order: a Comparison to Dark Matter Simulations
Authors:
Thomas Bakx,
Toshiki Kurita,
Nora Elisa Chisari,
Zvonimir Vlah,
Fabian Schmidt
Abstract:
We test the regime of validity of the effective field theory (EFT) of intrinsic alignments (IA) at the one-loop level by comparing with 3D halo shape statistics in N-body simulations. This model is based on the effective field theory of large-scale structure (EFT of LSS) and thus a theoretically well-motivated extension of the familiar non-linear alignment (NLA) model and the tidal-alignment-tidal…
▽ More
We test the regime of validity of the effective field theory (EFT) of intrinsic alignments (IA) at the one-loop level by comparing with 3D halo shape statistics in N-body simulations. This model is based on the effective field theory of large-scale structure (EFT of LSS) and thus a theoretically well-motivated extension of the familiar non-linear alignment (NLA) model and the tidal-alignment-tidal-torquing (TATT) model. It contains a total of $8$ free bias parameters. Specifically, we measure the dark matter halo shape-shape multipoles $P_{EE}^{(0)}(k), P_{EE}^{(2)}(k), P_{BB}^{(0)}(k), P_{BB}^{(2)}(k)$ as well as the matter-shape multipoles $P_{δE}^{(0)}(k), P_{δE}^{(2)}(k)$ from the simulations and perform a joint fit to determine the largest wavenumber $k_{\text{max}}$ up to which the theory predictions from the EFT of IA are consistent with the measurements. We find that the EFT of IA is able to describe intrinsic alignments of dark matter halos up to $k_\text{max}=0.30\,h/\text{Mpc}$ at $z=0$. This demonstrates a clear improvement over other existing alignment models like NLA and TATT, which are only accurate up to $k_\text{max}=0.05\,h/\text{Mpc}$ . We examine the posterior distributions of the higher-order bias parameters, and show that their inclusion is necessary to describe intrinsic alignments in the quasi-linear regime. Further, the EFT of IA is able to accurately describe the auto-spectrum of intrinsic alignment B-modes, in contrast to the other alignment models considered.
△ Less
Submitted 27 March, 2023;
originally announced March 2023.
-
Constraints on anisotropic primordial non-Gaussianity from intrinsic alignments of SDSS-III BOSS galaxies
Authors:
Toshiki Kurita,
Masahiro Takada
Abstract:
We measure the three-dimensional cross-power spectrum of galaxy density and intrinsic alignment (IA) fields for the first time from the spectroscopic and imaging data of SDSS-III BOSS galaxies, for each of the four samples in the redshift range $0.2 < z < 0.75$. In the measurement we use the power spectrum estimator, developed in our previous work, to take into account the line-of-sight dependent…
▽ More
We measure the three-dimensional cross-power spectrum of galaxy density and intrinsic alignment (IA) fields for the first time from the spectroscopic and imaging data of SDSS-III BOSS galaxies, for each of the four samples in the redshift range $0.2 < z < 0.75$. In the measurement we use the power spectrum estimator, developed in our previous work, to take into account the line-of-sight dependent projection of galaxy shapes onto the sky coordinate and the $E/B$-mode decomposition of the spin-2 shape field. Our method achieves a significant detection of the $E$-mode power spectrum with the total signal-to-noise ratio comparable with that of the quadrupole moment of the galaxy density power spectrum, while the measured $B$-mode power spectra are consistent with a null signal to within the statistical errors for all the galaxy samples. We also show that, compared to the previous results based on the two-dimensional projected correlation function, our method improves the precision of the linear shape bias parameter estimation by up to a factor of two thanks to the three-dimensional information. By performing a joint analysis of the galaxy density and IA power spectra in the linear regime, we constrain the isotropic and anisotropic local primordial non-Gaussianities (PNGs) parameters, $f_\mathrm{NL}^{s=0}$ and $f_\mathrm{NL}^{s=2}$, simultaneously, where the two types of PNGs induce characteristic scale-dependent biases at very large scales in the density and IA power spectra, respectively. We do not find any significant detection for both PNGs: the constraints $f^{s=0}_\mathrm{NL}=57^{+30}_{-29}$ and $f^{s=2}_\mathrm{NL} = -67_{-269}^{+285}$ ($68\%$ C.L.), respectively. Our method paves the way for using the IA power spectrum as a cosmological probe for current and future galaxy surveys.
△ Less
Submitted 6 February, 2023;
originally announced February 2023.
-
Pixel Relationships-based Regularizer for Retinal Vessel Image Segmentation
Authors:
Lukman Hakim,
Takio Kurita
Abstract:
The task of image segmentation is to classify each pixel in the image based on the appropriate label. Various deep learning approaches have been proposed for image segmentation that offers high accuracy and deep architecture. However, the deep learning technique uses a pixel-wise loss function for the training process. Using pixel-wise loss neglected the pixel neighbor relationships in the network…
▽ More
The task of image segmentation is to classify each pixel in the image based on the appropriate label. Various deep learning approaches have been proposed for image segmentation that offers high accuracy and deep architecture. However, the deep learning technique uses a pixel-wise loss function for the training process. Using pixel-wise loss neglected the pixel neighbor relationships in the network learning process. The neighboring relationship of the pixels is essential information in the image. Utilizing neighboring pixel information provides an advantage over using only pixel-to-pixel information. This study presents regularizers to give the pixel neighbor relationship information to the learning process. The regularizers are constructed by the graph theory approach and topology approach: By graph theory approach, graph Laplacian is used to utilize the smoothness of segmented images based on output images and ground-truth images. By topology approach, Euler characteristic is used to identify and minimize the number of isolated objects on segmented images. Experiments show that our scheme successfully captures pixel neighbor relations and improves the performance of the convolutional neural network better than the baseline without a regularization term.
△ Less
Submitted 28 December, 2022;
originally announced December 2022.
-
Single-Image Super-Resolution Reconstruction based on the Differences of Neighboring Pixels
Authors:
Huipeng Zheng,
Lukman Hakim,
Takio Kurita,
Junichi Miyao
Abstract:
The deep learning technique was used to increase the performance of single image super-resolution (SISR). However, most existing CNN-based SISR approaches primarily focus on establishing deeper or larger networks to extract more significant high-level features. Usually, the pixel-level loss between the target high-resolution image and the estimated image is used, but the neighbor relations between…
▽ More
The deep learning technique was used to increase the performance of single image super-resolution (SISR). However, most existing CNN-based SISR approaches primarily focus on establishing deeper or larger networks to extract more significant high-level features. Usually, the pixel-level loss between the target high-resolution image and the estimated image is used, but the neighbor relations between pixels in the image are seldom used. On the other hand, according to observations, a pixel's neighbor relationship contains rich information about the spatial structure, local context, and structural knowledge. Based on this fact, in this paper, we utilize pixel's neighbor relationships in a different perspective, and we propose the differences of neighboring pixels to regularize the CNN by constructing a graph from the estimated image and the ground-truth image. The proposed method outperforms the state-of-the-art methods in terms of quantitative and qualitative evaluation of the benchmark datasets.
Keywords: Super-resolution, Convolutional Neural Networks, Deep Learning
△ Less
Submitted 28 December, 2022;
originally announced December 2022.
-
Synergetic quantum error mitigation by randomized compiling and zero-noise extrapolation for the variational quantum eigensolver
Authors:
Tomochika Kurita,
Hammam Qassim,
Masatoshi Ishii,
Hirotaka Oshima,
Shintaro Sato,
Joseph Emerson
Abstract:
We propose a quantum error mitigation strategy for the variational quantum eigensolver (VQE) algorithm. We find, via numerical simulation, that very small amounts of coherent noise in VQE can cause substantially large errors that are difficult to suppress by conventional mitigation methods, and yet our proposed mitigation strategy is able to significantly reduce these errors. The proposed strategy…
▽ More
We propose a quantum error mitigation strategy for the variational quantum eigensolver (VQE) algorithm. We find, via numerical simulation, that very small amounts of coherent noise in VQE can cause substantially large errors that are difficult to suppress by conventional mitigation methods, and yet our proposed mitigation strategy is able to significantly reduce these errors. The proposed strategy is a combination of previously reported techniques, namely randomized compiling (RC) and zero-noise extrapolation (ZNE). Intuitively, randomized compiling turns coherent errors in the circuit into stochastic Pauli errors, which facilitates extrapolation to the zero-noise limit when evaluating the cost function. Our numerical simulation of VQE for small molecules shows that the proposed strategy can mitigate energy errors induced by various types of coherent noise by up to two orders of magnitude.
△ Less
Submitted 13 November, 2023; v1 submitted 21 December, 2022;
originally announced December 2022.
-
Simultaneous Acquisition of High Quality RGB Image and Polarization Information using a Sparse Polarization Sensor
Authors:
Teppei Kurita,
Yuhi Kondo,
Legong Sun,
Yusuke Moriuchi
Abstract:
This paper proposes a novel polarization sensor structure and network architecture to obtain a high-quality RGB image and polarization information. Conventional polarization sensors can simultaneously acquire RGB images and polarization information, but the polarizers on the sensor degrade the quality of the RGB images. There is a trade-off between the quality of the RGB image and polarization inf…
▽ More
This paper proposes a novel polarization sensor structure and network architecture to obtain a high-quality RGB image and polarization information. Conventional polarization sensors can simultaneously acquire RGB images and polarization information, but the polarizers on the sensor degrade the quality of the RGB images. There is a trade-off between the quality of the RGB image and polarization information as fewer polarization pixels reduce the degradation of the RGB image but decrease the resolution of polarization information. Therefore, we propose an approach that resolves the trade-off by sparsely arranging polarization pixels on the sensor and compensating for low-resolution polarization information with higher resolution using the RGB image as a guide. Our proposed network architecture consists of an RGB image refinement network and a polarization information compensation network. We confirmed the superiority of our proposed network in compensating the differential component of polarization intensity by comparing its performance with state-of-the-art methods for similar tasks: depth completion. Furthermore, we confirmed that our approach could simultaneously acquire higher quality RGB images and polarization information than conventional polarization sensors, resolving the trade-off between the quality of RGB images and polarization information. The baseline code and newly generated real and synthetic large-scale polarization image datasets are available for further research and development.
△ Less
Submitted 26 September, 2022;
originally announced September 2022.
-
Pauli String Partitioning Algorithm with the Ising Model for Simultaneous Measurement
Authors:
Tomochika Kurita,
Mikio Morita,
Hirotaka Oshima,
Shintaro Sato
Abstract:
We propose an efficient algorithm for partitioning Pauli strings into subgroups, which can be simultaneously measured in a single quantum circuit. Our partitioning algorithm drastically reduces the total number of measurements in a variational quantum eigensolver for a quantum chemistry, one of the most promising applications of quantum computing. The algorithm is based on the Ising model optimiza…
▽ More
We propose an efficient algorithm for partitioning Pauli strings into subgroups, which can be simultaneously measured in a single quantum circuit. Our partitioning algorithm drastically reduces the total number of measurements in a variational quantum eigensolver for a quantum chemistry, one of the most promising applications of quantum computing. The algorithm is based on the Ising model optimization problem, which can be quickly solved using an Ising machine. We develop an algorithm that is applicable to problems with sizes larger than the maximum number of variables that an Ising machine can handle ($n_\text{bit}$) through its iterative use. The algorithm has much better time complexity and solution optimality than other algorithms such as Boppana--Halldórsson algorithm and Bron--Kerbosch algorithm, making it useful for the quick and effective reduction of the number of quantum circuits required for measuring the expectation values of multiple Pauli strings. We investigate the performance of the algorithm using the second-generation Digital Annealer, a high-performance Ising hardware, for up to $65,535$ Pauli strings using Hamiltonians of molecules and the full tomography of quantum states. We demonstrate that partitioning problems for quantum chemical calculations can be solved with a time complexity of $O(N)$ for $N\leq n_\text{bit}$ and $O(N^2)$ for $N>n_\text{bit}$ for the worst case, where $N$ denotes the number of candidate Pauli strings and $n_\text{bit}=8,192$ for the second-generation Digital Annealer used in this study. The reduction factor, which is the number of Pauli strings divided by the number of obtained partitions, can be $200$ at maximum.
△ Less
Submitted 5 September, 2022; v1 submitted 8 May, 2022;
originally announced May 2022.
-
Attention-effective multiple instance learning on weakly stem cell colony segmentation
Authors:
Novanto Yudistira,
Muthu Subash Kavitha,
Jeny Rajan,
Takio Kurita
Abstract:
The detection of induced pluripotent stem cell (iPSC) colonies often needs the precise extraction of the colony features. However, existing computerized systems relied on segmentation of contours by preprocessing for classifying the colony conditions were task-extensive. To maximize the efficiency in categorizing colony conditions, we propose a multiple instance learning (MIL) in weakly supervised…
▽ More
The detection of induced pluripotent stem cell (iPSC) colonies often needs the precise extraction of the colony features. However, existing computerized systems relied on segmentation of contours by preprocessing for classifying the colony conditions were task-extensive. To maximize the efficiency in categorizing colony conditions, we propose a multiple instance learning (MIL) in weakly supervised settings. It is designed in a single model to produce weak segmentation and classification of colonies without using finely labeled samples. As a single model, we employ a U-net-like convolution neural network (CNN) to train on binary image-level labels for MIL colonies classification. Furthermore, to specify the object of interest we used a simple post-processing method. The proposed approach is compared over conventional methods using five-fold cross-validation and receiver operating characteristic (ROC) curve. The maximum accuracy of the MIL-net is 95%, which is 15 % higher than the conventional methods. Furthermore, the ability to interpret the location of the iPSC colonies based on the image level label without using a pixel-wise ground truth image is more appealing and cost-effective in colony condition recognition.
△ Less
Submitted 9 March, 2022;
originally announced March 2022.
-
Analysis method for 3D power spectrum of projected tensor field with fast estimator and window convolution modelling: an application to intrinsic alignments
Authors:
Toshiki Kurita,
Masahiro Takada
Abstract:
Rank-2 tensor fields of large-scale structure, e.g. a tensor field inferred from shapes of galaxies, open up a window to directly access 2-scalar, 2-vector and 2-tensor modes, where the scalar fields can be measured independently from the standard density field that is traced by distribution of galaxies. Here we develop an estimator of the multipole moments of power spectra for the three-dimension…
▽ More
Rank-2 tensor fields of large-scale structure, e.g. a tensor field inferred from shapes of galaxies, open up a window to directly access 2-scalar, 2-vector and 2-tensor modes, where the scalar fields can be measured independently from the standard density field that is traced by distribution of galaxies. Here we develop an estimator of the multipole moments of power spectra for the three-dimensional tensor field, taking into account the projection onto plane perpendicular to the line-of-sight direction. To do this, we find that a convenient representation of the power spectrum multipoles can be obtained by the use of the associated Legendre polynomials in the form which allows for the fast Fourier transform estimations under the local plane-parallel (LPP) approximation. The formulation also allows us to obtain the Hankel transforms to connect the two-point statistics in Fourier and configuration space, which are needed to derive theoretical templates of the power spectrum including convolution of a survey window. To validate our estimators, we use the simulation data of the projected tidal field assuming a survey window that mimics the BOSS-like survey footprint. We show that the LPP estimators fairly well recover the multipole moments that are inferred from the global plane-parallel approximation. We find that the survey window causes a more significant change in the multipole moments of projected tensor power spectrum at $k\lesssim 0.1\,h{\rm Mpc}^{-1}$ from the input power spectrum, than in the density power spectrum. Nevertheless, our method to compute the theory template including the survey window effects successfully reproduces the window-convolved multipole moments measured from the simulations. The analysis method presented here paves the way for a cosmological analysis using three-dimensional tensor-type tracers of large-scale structure for current and future surveys.
△ Less
Submitted 10 June, 2022; v1 submitted 23 February, 2022;
originally announced February 2022.
-
An Optimal Estimator of Intrinsic Alignments for Star-forming Galaxies in IllustrisTNG Simulation
Authors:
**g**g Shi,
Ken Osato,
Toshiki Kurita,
Masahiro Takada
Abstract:
Emission line galaxies (ELGs), more generally star-forming galaxies, are valuable tracers of large-scale structure and therefore main targets of upcoming wide-area spectroscopic galaxy surveys. We propose a fixed-aperture shape estimator of each ELG for extracting the intrinsic alignment (IA) signal, and assess the performance of the method using image simulations of ELGs generated from the Illust…
▽ More
Emission line galaxies (ELGs), more generally star-forming galaxies, are valuable tracers of large-scale structure and therefore main targets of upcoming wide-area spectroscopic galaxy surveys. We propose a fixed-aperture shape estimator of each ELG for extracting the intrinsic alignment (IA) signal, and assess the performance of the method using image simulations of ELGs generated from the IllustrisTNG simulation including observational effects such as the sky background noise. We show that our method enables a significant detection of the IA power spectrum with the linear-scale coefficient $A_{\rm IA}\simeq (13$--$15)\pm 3.0$ up to $z=2$, even from the small simulation volume $\sim0.009\,(h^{-1}{\rm Gpc})^3$, in contrast to the null detection with the standard method. Thus the ELG IA signal, measured with our method, opens up opportunities to exploit cosmology and galaxy physics in high-redshift universe.
△ Less
Submitted 6 August, 2021; v1 submitted 25 April, 2021;
originally announced April 2021.
-
Weakly-Supervised Action Localization and Action Recognition using Global-Local Attention of 3D CNN
Authors:
Novanto Yudistira,
Muthu Subash Kavitha,
Takio Kurita
Abstract:
3D Convolutional Neural Network (3D CNN) captures spatial and temporal information on 3D data such as video sequences. However, due to the convolution and pooling mechanism, the information loss seems unavoidable. To improve the visual explanations and classification in 3D CNN, we propose two approaches; i) aggregate layer-wise global to local (global-local) discrete gradients using trained 3DResN…
▽ More
3D Convolutional Neural Network (3D CNN) captures spatial and temporal information on 3D data such as video sequences. However, due to the convolution and pooling mechanism, the information loss seems unavoidable. To improve the visual explanations and classification in 3D CNN, we propose two approaches; i) aggregate layer-wise global to local (global-local) discrete gradients using trained 3DResNext network, and ii) implement attention gating network to improve the accuracy of the action recognition. The proposed approach intends to show the usefulness of every layer termed as global-local attention in 3D CNN via visual attribution, weakly-supervised action localization, and action recognition. Firstly, the 3DResNext is trained and applied for action classification using backpropagation concerning the maximum predicted class. The gradients and activations of every layer are then up-sampled. Later, aggregation is used to produce more nuanced attention, which points out the most critical part of the predicted class's input videos. We use contour thresholding of final attention for final localization. We evaluate spatial and temporal action localization in trimmed videos using fine-grained visual explanation via 3DCam. Experimental results show that the proposed approach produces informative visual explanations and discriminative attention. Furthermore, the action recognition via attention gating on each layer produces better classification results than the baseline model.
△ Less
Submitted 16 August, 2022; v1 submitted 17 December, 2020;
originally announced December 2020.
-
q-SNE: Visualizing Data using q-Gaussian Distributed Stochastic Neighbor Embedding
Authors:
Motoshi Abe,
Junichi Miyao,
Takio Kurita
Abstract:
The dimensionality reduction has been widely introduced to use the high-dimensional data for regression, classification, feature analysis, and visualization. As the one technique of dimensionality reduction, a stochastic neighbor embedding (SNE) was introduced. The SNE leads powerful results to visualize high-dimensional data by considering the similarity between the local Gaussian distributions o…
▽ More
The dimensionality reduction has been widely introduced to use the high-dimensional data for regression, classification, feature analysis, and visualization. As the one technique of dimensionality reduction, a stochastic neighbor embedding (SNE) was introduced. The SNE leads powerful results to visualize high-dimensional data by considering the similarity between the local Gaussian distributions of high and low-dimensional space. To improve the SNE, a t-distributed stochastic neighbor embedding (t-SNE) was also introduced. To visualize high-dimensional data, the t-SNE leads to more powerful and flexible visualization on 2 or 3-dimensional map** than the SNE by using a t-distribution as the distribution of low-dimensional data. Recently, Uniform manifold approximation and projection (UMAP) is proposed as a dimensionality reduction technique. We present a novel technique called a q-Gaussian distributed stochastic neighbor embedding (q-SNE). The q-SNE leads to more powerful and flexible visualization on 2 or 3-dimensional map** than the t-SNE and the SNE by using a q-Gaussian distribution as the distribution of low-dimensional data. The q-Gaussian distribution includes the Gaussian distribution and the t-distribution as the special cases with q=1.0 and q=2.0. Therefore, the q-SNE can also express the t-SNE and the SNE by changing the parameter q, and this makes it possible to find the best visualization by choosing the parameter q. We show the performance of q-SNE as visualization on 2-dimensional map** and classification by k-Nearest Neighbors (k-NN) classifier in embedded space compared with SNE, t-SNE, and UMAP by using the datasets MNIST, COIL-20, OlivettiFaces, FashionMNIST, and Glove.
△ Less
Submitted 2 December, 2020;
originally announced December 2020.
-
Channel Planting for Deep Neural Networks using Knowledge Distillation
Authors:
Kakeru Mitsuno,
Yuichiro Nomura,
Takio Kurita
Abstract:
In recent years, deeper and wider neural networks have shown excellent performance in computer vision tasks, while their enormous amount of parameters results in increased computational cost and overfitting. Several methods have been proposed to compress the size of the networks without reducing network performance. Network pruning can reduce redundant and unnecessary parameters from a network. Kn…
▽ More
In recent years, deeper and wider neural networks have shown excellent performance in computer vision tasks, while their enormous amount of parameters results in increased computational cost and overfitting. Several methods have been proposed to compress the size of the networks without reducing network performance. Network pruning can reduce redundant and unnecessary parameters from a network. Knowledge distillation can transfer the knowledge of deeper and wider networks to smaller networks. The performance of the smaller network obtained by these methods is bounded by the predefined network. Neural architecture search has been proposed, which can search automatically the architecture of the networks to break the structure limitation. Also, there is a dynamic configuration method to train networks incrementally as sub-networks. In this paper, we present a novel incremental training algorithm for deep neural networks called planting. Our planting can search the optimal network architecture with smaller number of parameters for improving the network performance by augmenting channels incrementally to layers of the initial networks while kee** the earlier trained parameters fixed. Also, we propose using the knowledge distillation method for training the channels planted. By transferring the knowledge of deeper and wider networks, we can grow the networks effectively and efficiently. We evaluate the effectiveness of the proposed method on different datasets such as CIFAR-10/100 and STL-10. For the STL-10 dataset, we show that we are able to achieve comparable performance with only 7% parameters compared to the larger network and reduce the overfitting caused by a small amount of the data.
△ Less
Submitted 4 November, 2020;
originally announced November 2020.
-
Filter Pruning using Hierarchical Group Sparse Regularization for Deep Convolutional Neural Networks
Authors:
Kakeru Mitsuno,
Takio Kurita
Abstract:
Since the convolutional neural networks are often trained with redundant parameters, it is possible to reduce redundant kernels or filters to obtain a compact network without drop** the classification accuracy. In this paper, we propose a filter pruning method using the hierarchical group sparse regularization. It is shown in our previous work that the hierarchical group sparse regularization is…
▽ More
Since the convolutional neural networks are often trained with redundant parameters, it is possible to reduce redundant kernels or filters to obtain a compact network without drop** the classification accuracy. In this paper, we propose a filter pruning method using the hierarchical group sparse regularization. It is shown in our previous work that the hierarchical group sparse regularization is effective in obtaining sparse networks in which filters connected to unnecessary channels are automatically close to zero. After training the convolutional neural network with the hierarchical group sparse regularization, the unnecessary filters are selected based on the increase of the classification loss of the randomly selected training samples to obtain a compact network. It is shown that the proposed method can reduce more than 50% parameters of ResNet for CIFAR-10 with only 0.3% decrease in the accuracy of test samples. Also, 34% parameters of ResNet are reduced for TinyImageNet-200 with higher accuracy than the baseline network.
△ Less
Submitted 4 November, 2020;
originally announced November 2020.
-
Transfer Learning by Cascaded Network to identify and classify lung nodules for cancer detection
Authors:
Shah B. Shrey,
Lukman Hakim,
Muthusubash Kavitha,
Hae Won Kim,
Takio Kurita
Abstract:
Lung cancer is one of the most deadly diseases in the world. Detecting such tumors at an early stage can be a tedious task. Existing deep learning architecture for lung nodule identification used complex architecture with large number of parameters. This study developed a cascaded architecture which can accurately segment and classify the benign or malignant lung nodules on computed tomography (CT…
▽ More
Lung cancer is one of the most deadly diseases in the world. Detecting such tumors at an early stage can be a tedious task. Existing deep learning architecture for lung nodule identification used complex architecture with large number of parameters. This study developed a cascaded architecture which can accurately segment and classify the benign or malignant lung nodules on computed tomography (CT) images. The main contribution of this study is to introduce a segmentation network where the first stage trained on a public data set can help to recognize the images which included a nodule from any data set by means of transfer learning. And the segmentation of a nodule improves the second stage to classify the nodules into benign and malignant. The proposed architecture outperformed the conventional methods with an area under curve value of 95.67\%. The experimental results showed that the classification accuracy of 97.96\% of our proposed architecture outperformed other simple and complex architectures in classifying lung nodules for lung cancer detection.
△ Less
Submitted 24 September, 2020;
originally announced September 2020.
-
U-Net with Graph Based Smoothing Regularizer for Small Vessel Segmentation on Fundus Image
Authors:
Lukman Hakim,
Novanto Yudistira,
Muthusubash Kavitha,
Takio Kurita
Abstract:
The detection of retinal blood vessels, especially the changes of small vessel condition is the most important indicator to identify the vascular network of the human body. Existing techniques focused mainly on shape of the large vessels, which is not appropriate for the disconnected small and isolated vessels. Paying attention to the low contrast small blood vessel in fundus region, first time we…
▽ More
The detection of retinal blood vessels, especially the changes of small vessel condition is the most important indicator to identify the vascular network of the human body. Existing techniques focused mainly on shape of the large vessels, which is not appropriate for the disconnected small and isolated vessels. Paying attention to the low contrast small blood vessel in fundus region, first time we proposed to combine graph based smoothing regularizer with the loss function in the U-net framework. The proposed regularizer treated the image as two graphs by calculating the graph laplacians on vessel regions and the background regions on the image. The potential of the proposed graph based smoothing regularizer in reconstructing small vessel is compared over the classical U-net with or without regularizer. Numerical and visual results shows that our developed regularizer proved its effectiveness in segmenting the small vessels and reconnecting the fragmented retinal blood vessels.
△ Less
Submitted 16 September, 2020;
originally announced September 2020.
-
Power Spectrum of Intrinsic Alignments of Galaxies in IllustrisTNG
Authors:
**g**g Shi,
Toshiki Kurita,
Masahiro Takada,
Ken Osato,
Yosuke Kobayashi,
Takahiro Nishimichi
Abstract:
We present the 3-{\it dimensional} intrinsic alignment power spectra between the projected 2d galaxy shape/spin and the 3d tidal field across $0.1<k/h{\rm Mpc}^{-1}<60$ using cosmological hydrodynamical simulation, Illustris-TNG300, at redshifts ranging from $0.3$ to $2$. The shape-tidal field alignment increases with galaxy mass and the linear alignment coefficient $A_{\rm IA}$, defined with resp…
▽ More
We present the 3-{\it dimensional} intrinsic alignment power spectra between the projected 2d galaxy shape/spin and the 3d tidal field across $0.1<k/h{\rm Mpc}^{-1}<60$ using cosmological hydrodynamical simulation, Illustris-TNG300, at redshifts ranging from $0.3$ to $2$. The shape-tidal field alignment increases with galaxy mass and the linear alignment coefficient $A_{\rm IA}$, defined with respect to the primordial tidal field, is found to have weak redshift dependence. We also show a promising detection of the shape/spin-tidal field alignments for stellar mass limited samples and a weak or almost null signal for star-forming galaxies for the TNG300 volume, $\sim 0.01~(h^{-1}{\rm Gpc})^3$. We further study the morphology and environmental dependence of the intrinsic alignment power spectra. The shape of massive disk- and spheroid-galaxies tend to align with the tidal field. The spin of low mass disks (and spheroids at low redshifts) tend to be parallel with the tidal field, while the spin of massive spheroids and disks tend to be perpendicular to tidal field. The shape and spin of massive centrals align with the tidal field at both small and large scales. Satellites show a radial alignment within the one-halo term region, and low mass satellites have an intriguing alignment signal in the two-halo term region. We also forecast a feasibility to measure the intrinsic alignment power spectrum for spectroscopic and imaging surveys such as Subaru HSC/PFS and DESI. Our results thus suggest that galaxy intrinsic alignment can be used as a promising tool for constraining the galaxy formation models.
△ Less
Submitted 28 January, 2021; v1 submitted 1 September, 2020;
originally announced September 2020.
-
Imprint of anisotropic primordial non-Gaussianity on halo intrinsic alignments in simulations
Authors:
Kazuyuki Akitsu,
Toshiki Kurita,
Takahiro Nishimichi,
Masahiro Takada,
Satoshi Tanaka
Abstract:
Using $N$-body simulations of cosmological large-scale structure formation, for the first time, we show that the anisotropic primordial non-Gaussianity (PNG) causes a scale-dependent modification, given by $1/k^2$ at small $k$ limit, in the three-dimensional power spectra of halo shapes (intrinsic alignments), whilst the conventional power spectrum of halo number density field remains unaffected.…
▽ More
Using $N$-body simulations of cosmological large-scale structure formation, for the first time, we show that the anisotropic primordial non-Gaussianity (PNG) causes a scale-dependent modification, given by $1/k^2$ at small $k$ limit, in the three-dimensional power spectra of halo shapes (intrinsic alignments), whilst the conventional power spectrum of halo number density field remains unaffected. We discuss that wide-area imaging and spectrocopic surveys observing the same region of the sky allow us to constrain the quadrupole PNG coefficient $f_{\rm NL}^{s=2}$ at a precision comparable with or better than that of the cosmic microwave background.
△ Less
Submitted 22 March, 2021; v1 submitted 7 July, 2020;
originally announced July 2020.
-
Power spectrum of halo intrinsic alignments in simulations
Authors:
Toshiki Kurita,
Masahiro Takada,
Takahiro Nishimichi,
Ryuichi Takahashi,
Ken Osato,
Yosuke Kobayashi
Abstract:
We use a suite of $N$-body simulations to study intrinsic alignments (IA) of halo shapes with the surrounding large-scale structure in the $Λ$CDM model. For this purpose, we develop a novel method to measure multipole moments of the three-dimensional power spectrum of the $E$-mode field of halo shapes with the matter/halo distribution, $P_{δE}^{(\ell)}(k)$ (or $P^{(\ell)}_{{\rm h}E}$), and those o…
▽ More
We use a suite of $N$-body simulations to study intrinsic alignments (IA) of halo shapes with the surrounding large-scale structure in the $Λ$CDM model. For this purpose, we develop a novel method to measure multipole moments of the three-dimensional power spectrum of the $E$-mode field of halo shapes with the matter/halo distribution, $P_{δE}^{(\ell)}(k)$ (or $P^{(\ell)}_{{\rm h}E}$), and those of the auto-power spectrum of the $E$ mode, $P^{(\ell)}_{EE}(k)$, based on the $E$/$B$-mode decomposition. The IA power spectra have non-vanishing amplitudes over the linear to nonlinear scales, and the large-scale amplitudes at $k\lesssim 0.1~h~{\rm Mpc}^{-1}$ are related to the matter power spectrum via a constant coefficient ($A_{\rm IA}$), similar to the linear bias parameter of galaxy or halo density field. We find that the cross- and auto-power spectra $P_{δE}$ and $P_{EE}$ at nonlinear scales, $k\gtrsim 0.1~h~{\rm Mpc}^{-1}$, show different $k$-dependences relative to the matter power spectrum, suggesting a violation of the nonlinear alignment model commonly used to model contaminations of cosmic shear signals. The IA power spectra exhibit baryon acoustic oscillations, and vary with halo samples of different masses, redshifts and cosmological parameters ($Ω_{\rm m}, S_8$). The cumulative signal-to-noise ratio for the IA power spectra is about 60% of that for the halo density power spectrum, where the super-sample covariance is found to give a significant contribution to the total covariance. Thus our results demonstrate that the IA power spectra of galaxy shapes, measured from imaging and spectroscopic surveys for an overlap** area of the sky, can be used to probe the underlying matter power spectrum, the primordial curvature perturbations, and cosmological parameters, in addition to the standard galaxy density power spectrum.
△ Less
Submitted 19 November, 2020; v1 submitted 27 April, 2020;
originally announced April 2020.
-
Triplet Loss for Knowledge Distillation
Authors:
Hideki Oki,
Motoshi Abe,
Junichi Miyao,
Takio Kurita
Abstract:
In recent years, deep learning has spread rapidly, and deeper, larger models have been proposed. However, the calculation cost becomes enormous as the size of the models becomes larger. Various techniques for compressing the size of the models have been proposed to improve performance while reducing computational costs. One of the methods to compress the size of the models is knowledge distillatio…
▽ More
In recent years, deep learning has spread rapidly, and deeper, larger models have been proposed. However, the calculation cost becomes enormous as the size of the models becomes larger. Various techniques for compressing the size of the models have been proposed to improve performance while reducing computational costs. One of the methods to compress the size of the models is knowledge distillation (KD). Knowledge distillation is a technique for transferring knowledge of deep or ensemble models with many parameters (teacher model) to smaller shallow models (student model). Since the purpose of knowledge distillation is to increase the similarity between the teacher model and the student model, we propose to introduce the concept of metric learning into knowledge distillation to make the student model closer to the teacher model using pairs or triplets of the training samples. In metric learning, the researchers are develo** the methods to build a model that can increase the similarity of outputs for similar samples. Metric learning aims at reducing the distance between similar and increasing the distance between dissimilar. The functionality of the metric learning to reduce the differences between similar outputs can be used for the knowledge distillation to reduce the differences between the outputs of the teacher model and the student model. Since the outputs of the teacher model for different objects are usually different, the student model needs to distinguish them. We think that metric learning can clarify the difference between the different outputs, and the performance of the student model could be improved. We have performed experiments to compare the proposed method with state-of-the-art knowledge distillation methods.
△ Less
Submitted 17 April, 2020;
originally announced April 2020.
-
Adaptive Neuron-wise Discriminant Criterion and Adaptive Center Loss at Hidden Layer for Deep Convolutional Neural Network
Authors:
Motoshi Abe,
Junichi Miyao,
Takio Kurita
Abstract:
A deep convolutional neural network (CNN) has been widely used in image classification and gives better classification accuracy than the other techniques. The softmax cross-entropy loss function is often used for classification tasks. There are some works to introduce the additional terms in the objective function for training to make the features of the output layer more discriminative. The neuro…
▽ More
A deep convolutional neural network (CNN) has been widely used in image classification and gives better classification accuracy than the other techniques. The softmax cross-entropy loss function is often used for classification tasks. There are some works to introduce the additional terms in the objective function for training to make the features of the output layer more discriminative. The neuron-wise discriminant criterion makes the input feature of each neuron in the output layer discriminative by introducing the discriminant criterion to each of the features. Similarly, the center loss was introduced to the features before the softmax activation function for face recognition to make the deep features discriminative. The ReLU function is often used for the network as an active function in the hidden layers of the CNN. However, it is observed that the deep features trained by using the ReLU function are not discriminative enough and show elongated shapes. In this paper, we propose to use the neuron-wise discriminant criterion at the output layer and the center-loss at the hidden layer. Also, we introduce the online computation of the means of each class with the exponential forgetting. We named them adaptive neuron-wise discriminant criterion and adaptive center loss, respectively. The effectiveness of the integration of the adaptive neuron-wise discriminant criterion and the adaptive center loss is shown by the experiments with MNSIT, FashionMNIST, CIFAR10, CIFAR100, and STL10. Source code is at https://github.com/i13abe/Adaptive-discriminant-and-center
△ Less
Submitted 17 April, 2020;
originally announced April 2020.
-
Hierarchical Group Sparse Regularization for Deep Convolutional Neural Networks
Authors:
Kakeru Mitsuno,
Junichi Miyao,
Takio Kurita
Abstract:
In a deep neural network (DNN), the number of the parameters is usually huge to get high learning performances. For that reason, it costs a lot of memory and substantial computational resources, and also causes overfitting. It is known that some parameters are redundant and can be removed from the network without decreasing performance. Many sparse regularization criteria have been proposed to sol…
▽ More
In a deep neural network (DNN), the number of the parameters is usually huge to get high learning performances. For that reason, it costs a lot of memory and substantial computational resources, and also causes overfitting. It is known that some parameters are redundant and can be removed from the network without decreasing performance. Many sparse regularization criteria have been proposed to solve this problem. In a convolutional neural network (CNN), group sparse regularizations are often used to remove unnecessary subsets of the weights, such as filters or channels. When we apply a group sparse regularization for the weights connected to a neuron as a group, each convolution filter is not treated as a target group in the regularization. In this paper, we introduce the concept of hierarchical grou** to solve this problem, and we propose several hierarchical group sparse regularization criteria for CNNs. Our proposed the hierarchical group sparse regularization can treat the weight for the input-neuron or the output-neuron as a group and convolutional filter as a group in the same group to prune the unnecessary subsets of weights. As a result, we can prune the weights more adequately depending on the structure of the network and the number of channels kee** high performance. In the experiment, we investigate the effectiveness of the proposed sparse regularizations through intensive comparison experiments on public datasets with several network architectures. Code is available on GitHub: "https://github.com/K-Mitsuno/hierarchical-group-sparse-regularization"
△ Less
Submitted 9 April, 2020;
originally announced April 2020.
-
On-line non-overlap** camera calibration net
Authors:
Zhao Fangda,
Toru Tamaki,
Takio Kurita,
Bisser Raytchev,
Kazufumi Kaneda
Abstract:
We propose an easy-to-use non-overlap** camera calibration method. First, successive images are fed to a PoseNet-based network to obtain ego-motion of cameras between frames. Next, the pose between cameras are estimated. Instead of using a batch method, we propose an on-line method of the inter-camera pose estimation. Furthermore, we implement the entire procedure on a computation graph. Experim…
▽ More
We propose an easy-to-use non-overlap** camera calibration method. First, successive images are fed to a PoseNet-based network to obtain ego-motion of cameras between frames. Next, the pose between cameras are estimated. Instead of using a batch method, we propose an on-line method of the inter-camera pose estimation. Furthermore, we implement the entire procedure on a computation graph. Experiments with simulations and the KITTI dataset show the proposed method to be effective in simulation.
△ Less
Submitted 18 February, 2020;
originally announced February 2020.
-
The impact of projection effects on cluster observables: stacked lensing and projected clustering
Authors:
Tomomi Sunayama,
Youngsoo Park,
Masahiro Takada,
Yosuke Kobayashi,
Takahiro Nishimichi,
Toshiki Kurita,
Surhud More,
Masamune Oguri,
Ken Osato
Abstract:
An optical cluster finder inevitably suffers from projection effects, where it misidentifies a superposition of galaxies in multiple halos along the line-of-sight as a single cluster. Using mock cluster catalogs built from cosmological N-body simulations, we quantify the impact of these projection effects with a particular focus on the observables of interest for cluster cosmology, namely the clus…
▽ More
An optical cluster finder inevitably suffers from projection effects, where it misidentifies a superposition of galaxies in multiple halos along the line-of-sight as a single cluster. Using mock cluster catalogs built from cosmological N-body simulations, we quantify the impact of these projection effects with a particular focus on the observables of interest for cluster cosmology, namely the cluster lensing and the cluster clustering signals. We find that "observed" clusters, i.e. clusters identified by our cluster finder algorithm, exhibit lensing and clustering signals that deviate from expectations based on a statistically isotropic halo model -- while both signals agree with halo model expectations on small scales, they show unexpected boosts on large scales, by up to a factor of 1.2 or 1.4 respectively. We identify the origin of these boosts as the inherent selection bias of optical cluster finders for clusters embedded within filaments aligned with the line-of-sight, and show that a minority ($\sim 30\%$) of such clusters within the entire sample is responsible for this observed boost. We discuss the implications of our results on previous studies of optical cluster, as well as prospects for identifying and mitigating projection effects in future cluster cosmology analyses.
△ Less
Submitted 16 June, 2020; v1 submitted 10 February, 2020;
originally announced February 2020.
-
Mixup of Feature Maps in a Hidden Layer for Training of Convolutional Neural Network
Authors:
Hideki Oki,
Takio Kurita
Abstract:
The deep Convolutional Neural Network (CNN) became very popular as a fundamental technique for image classification and objects recognition. To improve the recognition accuracy for the more complex tasks, deeper networks have being introduced. However, the recognition accuracy of the trained deep CNN drastically decreases for the samples which are obtained from the outside regions of the training…
▽ More
The deep Convolutional Neural Network (CNN) became very popular as a fundamental technique for image classification and objects recognition. To improve the recognition accuracy for the more complex tasks, deeper networks have being introduced. However, the recognition accuracy of the trained deep CNN drastically decreases for the samples which are obtained from the outside regions of the training samples. To improve the generalization ability for such samples, Krizhevsky et al. proposed to generate additional samples through transformations from the existing samples and to make the training samples richer. This method is known as data augmentation. Hongyi Zhang et al. introduced data augmentation method called mixup which achieves state-of-the-art performance in various datasets. Mixup generates new samples by mixing two different training samples. Mixing of the two images is implemented with simple image morphing. In this paper, we propose to apply mixup to the feature maps in a hidden layer. To implement the mixup in the hidden layer we use the Siamese network or the triplet network architecture to mix feature maps. From the experimental comparison, it is observed that the mixup of the feature maps obtained from the first convolution layer is more effective than the original image mixup.
△ Less
Submitted 24 June, 2019;
originally announced June 2019.
-
On the wave optics effect on primordial black hole constraints from optical microlensing search
Authors:
Sunao Sugiyama,
Toshiki Kurita,
Masahiro Takada
Abstract:
Microlensing of stars, e.g. in the Galactic bulge and Andromeda galaxy (M31), is among the most robust, powerful method to constrain primordial black holes (PBHs) that are a viable candidate of dark matter. If PBHs are in the mass range $M_{\rm PBH} \lower.5ex\hbox{$\; \buildrel < \over \sim \;$} 10^{-10}M_\odot$, its Schwarzschild radius ($r_{\rm Sch}$) becomes comparable with or shorter than opt…
▽ More
Microlensing of stars, e.g. in the Galactic bulge and Andromeda galaxy (M31), is among the most robust, powerful method to constrain primordial black holes (PBHs) that are a viable candidate of dark matter. If PBHs are in the mass range $M_{\rm PBH} \lower.5ex\hbox{$\; \buildrel < \over \sim \;$} 10^{-10}M_\odot$, its Schwarzschild radius ($r_{\rm Sch}$) becomes comparable with or shorter than optical wavelength ($λ)$ used in a microlensing search, and in this regime the wave optics effect on microlensing needs to be taken into account. For a lensing PBH with mass satisfying $r_{\rm Sch}\sim λ$, it causes a characteristic oscillatory feature in the microlensing light curve, and it will give a smoking gun evidence of PBH if detected, because any astrophysical object cannot have such a tiny Schwarzschild radius. Even in a statistical study, e.g. constraining the abundance of PBHs from a systematic search of microlensing events for a sample of many source stars, the wave effect needs to be taken into account. We examine the impact of wave effect on the PBH constraints obtained from the $r$-band (6210Å) monitoring observation of M31 stars in Niikura et al. (2019), and find that a finite source size effect is dominant over the wave effect for PBHs in the mass range $M_{\rm PBH}\simeq[10^{-11},10^{-10}]M_\odot$. We also discuss that, if a denser-cadence (10~sec), $g$-band monitoring observation for a sample of white dwarfs over a year timescale is available, it would allow one to explore the wave optics effect on microlensing light curve, if it occurs, or improve the PBH constraints in $M_{\rm PBH}\lower.5ex\hbox{$\; \buildrel < \over \sim \;$} 10^{-11}M_\odot$ even from a null detection.
△ Less
Submitted 30 March, 2020; v1 submitted 15 May, 2019;
originally announced May 2019.
-
Correlation Net: Spatiotemporal multimodal deep learning for action recognition
Authors:
Novanto Yudistira,
Takio Kurita
Abstract:
This paper describes a network that captures multimodal correlations over arbitrary timestamps. The proposed scheme operates as a complementary, extended network over a multimodal convolutional neural network (CNN). Spatial and temporal streams are required for action recognition by a deep CNN, but overfitting reduction and fusing these two streams remain open problems. The existing fusion approac…
▽ More
This paper describes a network that captures multimodal correlations over arbitrary timestamps. The proposed scheme operates as a complementary, extended network over a multimodal convolutional neural network (CNN). Spatial and temporal streams are required for action recognition by a deep CNN, but overfitting reduction and fusing these two streams remain open problems. The existing fusion approach averages the two streams. Here we propose a correlation network with a Shannon fusion for learning a pre-trained CNN. A Long-range video may consist of spatiotemporal correlations over arbitrary times, which can be captured by forming the correlation network from simple fully connected layers. This approach was found to complement the existing network fusion methods. The importance of multimodal correlation is validated in comparison experiments on the UCF-101 and HMDB-51 datasets. The multimodal correlation enhanced the accuracy of the video recognition results.
△ Less
Submitted 16 December, 2019; v1 submitted 22 July, 2018;
originally announced July 2018.
-
Fast and Accurate Image Super Resolution by Deep CNN with Skip Connection and Network in Network
Authors:
** Yamanaka,
Shigesumi Kuwashima,
Takio Kurita
Abstract:
We propose a highly efficient and faster Single Image Super-Resolution (SISR) model with Deep Convolutional neural networks (Deep CNN). Deep CNN have recently shown that they have a significant reconstruction performance on single-image super-resolution. Current trend is using deeper CNN layers to improve performance. However, deep models demand larger computation resources and is not suitable for…
▽ More
We propose a highly efficient and faster Single Image Super-Resolution (SISR) model with Deep Convolutional neural networks (Deep CNN). Deep CNN have recently shown that they have a significant reconstruction performance on single-image super-resolution. Current trend is using deeper CNN layers to improve performance. However, deep models demand larger computation resources and is not suitable for network edge devices like mobile, tablet and IoT devices. Our model achieves state of the art reconstruction performance with at least 10 times lower calculation cost by Deep CNN with Residual Net, Skip Connection and Network in Network (DCSCN). A combination of Deep CNNs and Skip connection layers is used as a feature extractor for image features on both local and global area. Parallelized 1x1 CNNs, like the one called Network in Network, is also used for image reconstruction. That structure reduces the dimensions of the previous layer's output for faster computation with less information loss, and make it possible to process original images directly. Also we optimize the number of layers and filters of each CNN to significantly reduce the calculation cost. Thus, the proposed algorithm not only achieves the state of the art performance but also achieves faster and efficient computation. Code is available at https://github.com/**y2001/dcscn-super-resolution
△ Less
Submitted 8 September, 2020; v1 submitted 17 July, 2017;
originally announced July 2017.
-
Mixture of Counting CNNs: Adaptive Integration of CNNs Specialized to Specific Appearance for Crowd Counting
Authors:
Shohei Kumagai,
Kazuhiro Hotta,
Takio Kurita
Abstract:
This paper proposes a crowd counting method. Crowd counting is difficult because of large appearance changes of a target which caused by density and scale changes. Conventional crowd counting methods generally utilize one predictor (e,g., regression and multi-class classifier). However, such only one predictor can not count targets with large appearance changes well. In this paper, we propose to p…
▽ More
This paper proposes a crowd counting method. Crowd counting is difficult because of large appearance changes of a target which caused by density and scale changes. Conventional crowd counting methods generally utilize one predictor (e,g., regression and multi-class classifier). However, such only one predictor can not count targets with large appearance changes well. In this paper, we propose to predict the number of targets using multiple CNNs specialized to a specific appearance, and those CNNs are adaptively selected according to the appearance of a test image. By integrating the selected CNNs, the proposed method has the robustness to large appearance changes. In experiments, we confirm that the proposed method can count crowd with lower counting error than a CNN and integration of CNNs with fixed weights. Moreover, we confirm that each predictor automatically specialized to a specific appearance.
△ Less
Submitted 27 March, 2017;
originally announced March 2017.
-
Microlensing constraints on primordial black holes with the Subaru/HSC Andromeda observation
Authors:
Hiroko Niikura,
Masahiro Takada,
Naoki Yasuda,
Robert H. Lupton,
Takahiro Sumi,
Surhud More,
Toshiki Kurita,
Sunao Sugiyama,
Anupreeta More,
Masamune Oguri,
Masashi Chiba
Abstract:
Primordial black holes (PBHs) have long been suggested as a viable candidate for the elusive dark matter (DM). The abundance of such PBHs has been constrained using a number of astrophysical observations, except for a hitherto unexplored mass window of $M_{\rm PBH}=[10^{-14},10^{-9}]M_\odot$. Here we carry out a dense-cadence (2~min sampling rate), 7 hour-long observation of the Andromeda galaxy (…
▽ More
Primordial black holes (PBHs) have long been suggested as a viable candidate for the elusive dark matter (DM). The abundance of such PBHs has been constrained using a number of astrophysical observations, except for a hitherto unexplored mass window of $M_{\rm PBH}=[10^{-14},10^{-9}]M_\odot$. Here we carry out a dense-cadence (2~min sampling rate), 7 hour-long observation of the Andromeda galaxy (M31) with the Subaru Hyper Suprime-Cam to search for microlensing of stars in M31 by PBHs lying in the halo regions of the Milky Way (MW) and M31. Given our simultaneous monitoring of tens of millions of stars in M31, if such light PBHs make up a significant fraction of DM, we expect to find many microlensing events for the PBH DM scenario. However, we identify only a single candidate event, which translates into the most stringent upper bounds on the abundance of PBHs in the mass range $M_{\rm PBH}\simeq [10^{-11}, 10^{-6}]M_\odot$.
△ Less
Submitted 26 October, 2018; v1 submitted 9 January, 2017;
originally announced January 2017.
-
Domain Adaptation with L2 constraints for classifying images from different endoscope systems
Authors:
Toru Tamaki,
Shoji Sonoyama,
Takio Kurita,
Tsubasa Hirakawa,
Bisser Raytchev,
Kazufumi Kaneda,
Tetsushi Koide,
Shigeto Yoshida,
Hiroshi Mieno,
Shinji Tanaka,
Kazuaki Chayama
Abstract:
This paper proposes a method for domain adaptation that extends the maximum margin domain transfer (MMDT) proposed by Hoffman et al., by introducing L2 distance constraints between samples of different domains; thus, our method is denoted as MMDTL2. Motivated by the differences between the images taken by narrow band imaging (NBI) endoscopic devices, we utilize different NBI devices as different d…
▽ More
This paper proposes a method for domain adaptation that extends the maximum margin domain transfer (MMDT) proposed by Hoffman et al., by introducing L2 distance constraints between samples of different domains; thus, our method is denoted as MMDTL2. Motivated by the differences between the images taken by narrow band imaging (NBI) endoscopic devices, we utilize different NBI devices as different domains and estimate the transformations between samples of different domains, i.e., image samples taken by different NBI endoscope systems. We first formulate the problem in the primal form, and then derive the dual form with much lesser computational costs as compared to the naive approach. From our experimental results using NBI image datasets from two different NBI endoscopic devices, we find that MMDTL2 is better than MMDT and also support vector machines without adaptation, especially when NBI image features are high-dimensional and the per-class training samples are greater than 20.
△ Less
Submitted 2 February, 2018; v1 submitted 8 November, 2016;
originally announced November 2016.
