-
A Batch Sequential Halving Algorithm without Performance Degradation
Authors:
Sotetsu Koyamada,
Soichiro Nishimori,
Shin Ishii
Abstract:
In this paper, we investigate the problem of pure exploration in the context of multi-armed bandits, with a specific focus on scenarios where arms are pulled in fixed-size batches. Batching has been shown to enhance computational efficiency, but it can potentially lead to a degradation compared to the original sequential algorithm's performance due to delayed feedback and reduced adaptability. We…
▽ More
In this paper, we investigate the problem of pure exploration in the context of multi-armed bandits, with a specific focus on scenarios where arms are pulled in fixed-size batches. Batching has been shown to enhance computational efficiency, but it can potentially lead to a degradation compared to the original sequential algorithm's performance due to delayed feedback and reduced adaptability. We introduce a simple batch version of the Sequential Halving (SH) algorithm (Karnin et al., 2013) and provide theoretical evidence that batching does not degrade the performance of the original algorithm under practical conditions. Furthermore, we empirically validate our claim through experiments, demonstrating the robust nature of the SH algorithm in fixed-size batch settings.
△ Less
Submitted 1 June, 2024;
originally announced June 2024.
-
First joint oscillation analysis of Super-Kamiokande atmospheric and T2K accelerator neutrino data
Authors:
Super-Kamiokande,
T2K collaborations,
:,
S. Abe,
K. Abe,
N. Akhlaq,
R. Akutsu,
H. Alarakia-Charles,
A. Ali,
Y. I. Alj Hakim,
S. Alonso Monsalve,
S. Amanai,
C. Andreopoulos,
L. H. V. Anthony,
M. Antonova,
S. Aoki,
K. A. Apte,
T. Arai,
T. Arihara,
S. Arimoto,
Y. Asada,
R. Asaka,
Y. Ashida,
E. T. Atkin,
N. Babu
, et al. (524 additional authors not shown)
Abstract:
The Super-Kamiokande and T2K collaborations present a joint measurement of neutrino oscillation parameters from their atmospheric and beam neutrino data. It uses a common interaction model for events overlap** in neutrino energy and correlated detector systematic uncertainties between the two datasets, which are found to be compatible. Using 3244.4 days of atmospheric data and a beam exposure of…
▽ More
The Super-Kamiokande and T2K collaborations present a joint measurement of neutrino oscillation parameters from their atmospheric and beam neutrino data. It uses a common interaction model for events overlap** in neutrino energy and correlated detector systematic uncertainties between the two datasets, which are found to be compatible. Using 3244.4 days of atmospheric data and a beam exposure of $19.7(16.3) \times 10^{20}$ protons on target in (anti)neutrino mode, the analysis finds a 1.9$σ$ exclusion of CP-conservation (defined as $J_{CP}=0$) and a preference for the normal mass ordering.
△ Less
Submitted 21 May, 2024;
originally announced May 2024.
-
Leveraging Domain-Unlabeled Data in Offline Reinforcement Learning across Two Domains
Authors:
Soichiro Nishimori,
Xin-Qiang Cai,
Johannes Ackermann,
Masashi Sugiyama
Abstract:
In this paper, we investigate an offline reinforcement learning (RL) problem where datasets are collected from two domains. In this scenario, having datasets with domain labels facilitates efficient policy training. However, in practice, the task of assigning domain labels can be resource-intensive or infeasible at a large scale, leading to a prevalence of domain-unlabeled data. To formalize this…
▽ More
In this paper, we investigate an offline reinforcement learning (RL) problem where datasets are collected from two domains. In this scenario, having datasets with domain labels facilitates efficient policy training. However, in practice, the task of assigning domain labels can be resource-intensive or infeasible at a large scale, leading to a prevalence of domain-unlabeled data. To formalize this challenge, we introduce a novel offline RL problem setting named Positive-Unlabeled Offline RL (PUORL), which incorporates domain-unlabeled data. To address PUORL, we develop an offline RL algorithm utilizing positive-unlabeled learning to predict the domain labels of domain-unlabeled data, enabling the integration of this data into policy training. Our experiments show the effectiveness of our method in accurately identifying domains and learning policies that outperform baselines in the PUORL setting, highlighting its capability to leverage domain-unlabeled data effectively.
△ Less
Submitted 11 April, 2024;
originally announced April 2024.
-
$K_S^0$ meson production in inelastic p+p interactions at 31, 40 and 80 GeV/c beam momentum measured by NA61/SHINE at the CERN SPS
Authors:
N. Abgrall,
H. Adhikary,
P. Adrich,
K. K. Allison,
N. Amin,
E. V. Andronov,
T. Antičić,
I. -C. Arsene,
M. Bajda,
Y. Balkova,
M. Baszczyk,
D. Battaglia,
A. Bazgir,
S. Bhosale,
M. Bielewicz,
A. Blondel,
M. Bogomilov,
Y. Bondar,
N. Bostan,
A. Brandin,
A. Bravar,
W. Brylinski,
J. Brzychczyk,
M. Buryakov,
A. F. Camino
, et al. (133 additional authors not shown)
Abstract:
Measurements of $K_S^0$ meson production via its $π^{+} π^{-}$ decay mode in inelastic $\textit{p+p}$ interactions at incident projectile momenta of 31, 40 and 80 GeV/$c$ ($\sqrt{s_{NN}}=7.7, 8.8$ and $12.3$ GeV, respectively) are presented. The data were recorded by the NA61/SHINE spectrometer at the CERN Super Proton Synchrotron. Double-differential distributions were obtained in transverse mome…
▽ More
Measurements of $K_S^0$ meson production via its $π^{+} π^{-}$ decay mode in inelastic $\textit{p+p}$ interactions at incident projectile momenta of 31, 40 and 80 GeV/$c$ ($\sqrt{s_{NN}}=7.7, 8.8$ and $12.3$ GeV, respectively) are presented. The data were recorded by the NA61/SHINE spectrometer at the CERN Super Proton Synchrotron. Double-differential distributions were obtained in transverse momentum and rapidity. The mean multiplicities of $K_S^0$ mesons were determined to be $(5.95 \pm 0.19 (stat) \pm 0.22 (sys)) \times 10^{-2}$ at 31 GeV/$c$, $(7.61 \pm 0.13 (stat) \pm 0.31 (sys)) \times 10^{-2}$ at 40 GeV/$c$ and $(11.58 \pm 0.12 (stat) \pm 0.37 (sys)) \times 10^{-2}$ at 80 GeV/$c$. The results on $K^{0}_{S}$ production are compared with model calculations (Epos1.99, SMASH 2.0 and PHSD) as well as with published data from other experiments.
△ Less
Submitted 26 February, 2024;
originally announced February 2024.
-
A Policy Gradient Primal-Dual Algorithm for Constrained MDPs with Uniform PAC Guarantees
Authors:
Toshinori Kitamura,
Tadashi Kozuno,
Masahiro Kato,
Yuki Ichihara,
Soichiro Nishimori,
Akiyoshi Sannai,
Sho Sonoda,
Wataru Kumagai,
Yutaka Matsuo
Abstract:
We study a primal-dual (PD) reinforcement learning (RL) algorithm for online constrained Markov decision processes (CMDPs). Despite its widespread practical use, the existing theoretical literature on PD-RL algorithms for this problem only provides sublinear regret guarantees and fails to ensure convergence to optimal policies. In this paper, we introduce a novel policy gradient PD algorithm with…
▽ More
We study a primal-dual (PD) reinforcement learning (RL) algorithm for online constrained Markov decision processes (CMDPs). Despite its widespread practical use, the existing theoretical literature on PD-RL algorithms for this problem only provides sublinear regret guarantees and fails to ensure convergence to optimal policies. In this paper, we introduce a novel policy gradient PD algorithm with uniform probably approximate correctness (Uniform-PAC) guarantees, simultaneously ensuring convergence to optimal policies, sublinear regret, and polynomial sample complexity for any target accuracy. Notably, this represents the first Uniform-PAC algorithm for the online CMDP problem. In addition to the theoretical guarantees, we empirically demonstrate in a simple CMDP that our algorithm converges to optimal policies, while baseline algorithms exhibit oscillatory performance and constraint violation.
△ Less
Submitted 1 July, 2024; v1 submitted 31 January, 2024;
originally announced January 2024.
-
Search for a critical point of strongly-interacting matter in central $^{40}$Ar +$^{45}$Sc collisions at 13$A$-75$A$ GeV/$c$ beam momentum
Authors:
The NA61/SHINE Collaboration,
:,
H. Adhikary,
P. Adrich,
K. K. Allison,
N. Amin,
E. V. Andronov,
T. Antićić,
I. -C. Arsene,
M. Bajda,
Y. Balkova,
M. Baszczyk,
D. Battaglia,
A. Bazgir,
S. Bhosale,
M. Bielewicz,
A. Blondel,
M. Bogomilov,
Y. Bondar,
N. Bostan,
A. Brandin,
W. Bryliński,
J. Brzychczyk,
M. Buryakov,
A. F. Camino
, et al. (133 additional authors not shown)
Abstract:
The critical point of strongly interacting matter is searched for at the CERN SPS by the NA61/SHINE experiment in central $^{40}$Ar +$^{45}$Sc collisions at 13$A$, 19$A$, 30$A$, 40$A$, and 75$A$ GeV/$c$. The dependence of the second-order scaled factorial moments of proton multiplicity distributions on the number of subdivisions in transverse momentum space is measured. The intermittency analysis…
▽ More
The critical point of strongly interacting matter is searched for at the CERN SPS by the NA61/SHINE experiment in central $^{40}$Ar +$^{45}$Sc collisions at 13$A$, 19$A$, 30$A$, 40$A$, and 75$A$ GeV/$c$. The dependence of the second-order scaled factorial moments of proton multiplicity distributions on the number of subdivisions in transverse momentum space is measured. The intermittency analysis uses statistically independent data sets for every subdivision in transverse and cumulative-transverse momentum variables.
The results obtained do not indicate the searched intermittent pattern. An upper limit on the fraction of correlated protons and the intermittency index is obtained based on a comparison with the Power-law Model.
△ Less
Submitted 7 January, 2024;
originally announced January 2024.
-
Measurements of higher-order cumulants of multiplicity and net-electric charge distributions in inelastic proton-proton interactions by NA61/SHINE
Authors:
NA61/SHINE,
:,
H. Adhikary,
P. Adrich,
K. K. Allison,
N. Amin,
E. V. Andronov,
I. -C. Arsene,
M. Bajda,
Y. Balkova,
D. Battaglia,
A. Bazgir,
S. Bhosale,
M. Bielewicz,
A. Blondel,
M. Bogomilov,
Y. Bondar,
A. Borucka,
A. Brandin,
W. Bryliński,
J. Brzychczyk,
M. Buryakov,
A. F. Camino,
M. Ćirković,
M. Csanád
, et al. (126 additional authors not shown)
Abstract:
This paper presents the energy dependence of multiplicity and net-electric charge fluctuations in $p+p$ interactions at beam momenta 20, 31, 40, 80, and 158 GeV/$c$. Results are corrected for the experimental biases and quantified with the use of cumulants and factorial cumulants. Data are compared with the Epos1.99 and FTFP-BERT model predictions.
This paper presents the energy dependence of multiplicity and net-electric charge fluctuations in $p+p$ interactions at beam momenta 20, 31, 40, 80, and 158 GeV/$c$. Results are corrected for the experimental biases and quantified with the use of cumulants and factorial cumulants. Data are compared with the Epos1.99 and FTFP-BERT model predictions.
△ Less
Submitted 21 December, 2023;
originally announced December 2023.
-
Evidence for an excess of charged over neutral $K$ meson production in high-energy collisions of atomic nuclei
Authors:
NA61/SHINE Collaboration,
:,
H. Adhikary,
P. Adrich,
K. K. Allison,
N. Amin,
E. V. Andronov,
I. -C. Arsene,
M. Bajda,
Y. Balkova,
D. Battaglia,
A. Bazgir,
S. Bhosale,
M. Bielewicz,
A. Blondel,
M. Bogomilov,
Y. Bondar,
A. Brandin,
W. Brylinski,
J. Brzychczyk,
M. Buryakov,
A. F. Camino,
M. Cirkovic,
M. Csanád,
J. Cybowska
, et al. (127 additional authors not shown)
Abstract:
Collisions of atomic nuclei at relativistic velocities produce new particles, predominantly mesons containing one valence quark and one valence anti-quark. These particles are produced in strong interactions, which preserve an approximate symmetry between up ($u$) and down ($d$) quarks. In the case of $K$ meson production, if this symmetry were exact, it would result in equal numbers of charged (…
▽ More
Collisions of atomic nuclei at relativistic velocities produce new particles, predominantly mesons containing one valence quark and one valence anti-quark. These particles are produced in strong interactions, which preserve an approximate symmetry between up ($u$) and down ($d$) quarks. In the case of $K$ meson production, if this symmetry were exact, it would result in equal numbers of charged ($K^+$ and $K^-$) and neutral ($K^0$ and $\overline K^0$) mesons in the final state. In this Letter, we report a measurement of the relative abundance of charged over neutral $K$ meson production in collisions of argon and scandium nuclei at a center-of-mass energy of 11.9 GeV per nucleon pair. We find that production of $\mathit{K^+}$ and $\mathit{K^-}$ mesons at mid-rapidity is $(18.4\pm 6.1)\%$ higher than that of the neutral $K$ mesons. The origin of this unexpected excess remains to be elucidated.
△ Less
Submitted 16 May, 2024; v1 submitted 11 December, 2023;
originally announced December 2023.
-
Measurements of $π^\pm$, $K^\pm$, $p$ and $\bar{p}$ spectra in $^{40}$Ar+$^{45}$Sc collisions at 13$A$ to 150$A$ GeV/$c$
Authors:
NA61/SHINE Collaboration,
:,
H. Adhikary,
P. Adrich,
K. K. Allison,
N. Amin,
E. V. Andronov,
T. Antićić,
I. -C. Arsene,
M. Bajda,
Y. Balkova,
M. Baszczyk,
D. Battaglia,
A. Bazgir,
S. Bhosale,
M. Bielewicz,
A. Blondel,
M. Bogomilov,
Y. Bondar,
N. Bostan,
A. Brandin,
W. Bryliński,
J. Brzychczyk,
M. Buryakov,
A. F. Camino
, et al. (131 additional authors not shown)
Abstract:
The NA61/SHINE experiment at the CERN Super Proton Synchrotron studies the onset of deconfinement in strongly interacting matter through a beam energy scan of particle production in collisions of nuclei of varied sizes. This paper presents results on inclusive double-differential spectra, transverse momentum and rapidity distributions and mean multiplicities of $π^\pm$, $K^\pm$, $p$ and $\bar{p}$…
▽ More
The NA61/SHINE experiment at the CERN Super Proton Synchrotron studies the onset of deconfinement in strongly interacting matter through a beam energy scan of particle production in collisions of nuclei of varied sizes. This paper presents results on inclusive double-differential spectra, transverse momentum and rapidity distributions and mean multiplicities of $π^\pm$, $K^\pm$, $p$ and $\bar{p}$ produced in $^{40}$Ar+$^{45}$Sc collisions at beam momenta of 13$A$, 19$A$, 30$A$, 40$A$, 75$A$ and 150$A$~\GeVc. The analysis uses the 10\% most central collisions, where the observed forward energy defines centrality. The energy dependence of the $K^\pm$/$π^\pm$ ratios as well as of inverse slope parameters of the $K^\pm$ transverse mass distributions are placed in between those found in inelastic $p$+$p$ and central Pb+Pb collisions. The results obtained here establish a system-size dependence of hadron production properties that so far cannot be explained either within statistical or dynamical models.
△ Less
Submitted 23 April, 2024; v1 submitted 31 August, 2023;
originally announced August 2023.
-
Measurements of the $ν_μ$ and $\barν_μ$-induced Coherent Charged Pion Production Cross Sections on $^{12}C$ by the T2K experiment
Authors:
K. Abe,
N. Akhlaq,
R. Akutsu,
A. Ali,
S. Alonso Monsalve,
C. Alt,
C. Andreopoulos,
M. Antonova,
S. Aoki,
T. Arihara,
Y. Asada,
Y. Ashida,
E. T. Atkin,
M. Barbi,
G. J. Barker,
G. Barr,
D. Barrow,
M. Batkiewicz-Kwasniak,
V. Berardi,
L. Berns,
S. Bhadra,
A. Blanchet,
A. Blondel,
S. Bolognesi,
T. Bonus
, et al. (359 additional authors not shown)
Abstract:
We report an updated measurement of the $ν_μ$-induced, and the first measurement of the $\barν_μ$-induced coherent charged pion production cross section on $^{12}C$ nuclei in the T2K experiment. This is measured in a restricted region of the final-state phase space for which $p_{μ,π} > 0.2$ GeV, $\cos(θ_μ) > 0.8$ and $\cos(θ_π) > 0.6$, and at a mean (anti)neutrino energy of 0.85 GeV using the T2K…
▽ More
We report an updated measurement of the $ν_μ$-induced, and the first measurement of the $\barν_μ$-induced coherent charged pion production cross section on $^{12}C$ nuclei in the T2K experiment. This is measured in a restricted region of the final-state phase space for which $p_{μ,π} > 0.2$ GeV, $\cos(θ_μ) > 0.8$ and $\cos(θ_π) > 0.6$, and at a mean (anti)neutrino energy of 0.85 GeV using the T2K near detector. The measured $ν_μ$ CC coherent pion production flux-averaged cross section on $^{12}C$ is $(2.98 \pm 0.37 (stat.) \pm 0.31 (syst.) \substack{ +0.49 \\ -0.00 } \mathrm{ (Q^2\,model)}) \times 10^{-40}~\mathrm{cm}^{2}$. The new measurement of the $\barν_μ$-induced cross section on $^{12}{C}$ is $(3.05 \pm 0.71 (stat.) \pm 0.39 (syst.) \substack{ +0.74 \\ -0.00 } \mathrm{(Q^2\,model)}) \times 10^{-40}~\mathrm{cm}^{2}$. The results are compatible with both the NEUT 5.4.0 Berger-Sehgal (2009) and GENIE 2.8.0 Rein-Sehgal (2007) model predictions.
△ Less
Submitted 14 October, 2023; v1 submitted 31 August, 2023;
originally announced August 2023.
-
Measurements of $π^+$, $π^-$, $p$, $\bar{p}$, $K^+$ and $K^-$ production in 120 GeV/$c$ p + C interactions
Authors:
H. Adhikary,
P. Adrich,
K. K. Allison,
N. Amin,
E. V. Andronov,
T. Antićić,
I. -C. Arsene,
M. Bajda,
Y. Balkova,
M. Baszczyk,
D. Battaglia,
A. Bazgir,
S. Bhosale,
M. Bielewicz,
A. Blondel,
M. Bogomilov,
Y. Bondar,
N. Bostan,
A. Brandin,
W. Bryliński,
J. Brzychczyk,
M. Buryakov,
A. F. Camino,
M. Ćirković,
M. Csanád
, et al. (130 additional authors not shown)
Abstract:
This paper presents multiplicity measurements of charged hadrons produced in 120 GeV/$c$ proton-carbon interactions. The measurements were made using data collected at the NA61/SHINE experiment during two different data-taking periods, with increased phase space coverage in the second configuration due to the addition of new subdetectors. Particle identification via $dE/dx$ was employed to obtain…
▽ More
This paper presents multiplicity measurements of charged hadrons produced in 120 GeV/$c$ proton-carbon interactions. The measurements were made using data collected at the NA61/SHINE experiment during two different data-taking periods, with increased phase space coverage in the second configuration due to the addition of new subdetectors. Particle identification via $dE/dx$ was employed to obtain double-differential production multiplicities of $π^+$, $π^-$, $p$, $\bar{p}$, $K^+$ and $K^-$. These measurements are presented as a function of laboratory momentum in intervals of laboratory polar angle covering the range from 0 to 450 mrad. They provide crucial inputs for current and future long-baseline neutrino experiments, where they are used to estimate the initial neutrino flux.
△ Less
Submitted 20 October, 2023; v1 submitted 5 June, 2023;
originally announced June 2023.
-
Updated T2K measurements of muon neutrino and antineutrino disappearance using 3.6 $\times$ 10$^{21}$ protons on target
Authors:
K. Abe,
N. Akhlaq,
R. Akutsu,
H. Alarakia-Charles,
A. Ali,
Y. I. Alj Hakim,
S. Alonso Monsalve,
C. Alt,
C. Andreopoulos,
M. Antonova,
S. Aoki,
T. Arihara,
Y. Asada,
Y. Ashida,
E. T. Atkin,
M. Barbi,
G. J. Barker,
G. Barr,
D. Barrow,
M. Batkiewicz-Kwasniak,
F. Bench,
V. Berardi,
L. Berns,
S. Bhadra,
A. Blanchet
, et al. (385 additional authors not shown)
Abstract:
Muon neutrino and antineutrino disappearance probabilities are identical in the standard three-flavor neutrino oscillation framework, but CPT violation and non-standard interactions can violate this symmetry. In this work we report the measurements of $\sin^{2} θ_{23}$ and $Δm_{32}^2$ independently for neutrinos and antineutrinos. The aforementioned symmetry violation would manifest as an inconsis…
▽ More
Muon neutrino and antineutrino disappearance probabilities are identical in the standard three-flavor neutrino oscillation framework, but CPT violation and non-standard interactions can violate this symmetry. In this work we report the measurements of $\sin^{2} θ_{23}$ and $Δm_{32}^2$ independently for neutrinos and antineutrinos. The aforementioned symmetry violation would manifest as an inconsistency in the neutrino and antineutrino oscillation parameters. The analysis discussed here uses a total of 1.97$\times$10$^{21}$ and 1.63$\times$10$^{21}$ protons on target taken with a neutrino and antineutrino beam respectively, and benefits from improved flux and cross-section models, new near detector samples and more than double the data reducing the overall uncertainty of the result. No significant deviation is observed, consistent with the standard neutrino oscillation picture.
△ Less
Submitted 16 October, 2023; v1 submitted 16 May, 2023;
originally announced May 2023.
-
Search for the critical point of strongly-interacting matter in ${}^{40}$Ar + ${}^{45}$Sc collisions at 150A GeV/c using scaled factorial moments of protons
Authors:
NA61/SHINE Collaboration,
:,
H. Adhikary,
P. Adrich,
K. K. Allison,
N. Amin,
E. V. Andronov,
T. Antićić,
I. -C. Arsene,
M. Bajda,
Y. Balkova,
M. Baszczyk,
D. Battaglia,
A. Bazgir,
S. Bhosale,
M. Bielewicz,
A. Blondel,
M. Bogomilov,
Y. Bondar,
N. Bostan,
A. Brandin,
W. Bryliński,
J. Brzychczyk,
M. Buryakov,
A. F. Camino
, et al. (136 additional authors not shown)
Abstract:
The critical point of dense, strongly interacting matter is searched for at the CERN SPS in ${}^{40}$Ar + ${}^{45}$Sc collisions at 150A GeV/c. The dependence of second-order scaled factorial moments of proton multiplicity distribution on the number of subdivisions of transverse momentum space is measured. The intermittency analysis is performed using both transverse momentum and cumulative transv…
▽ More
The critical point of dense, strongly interacting matter is searched for at the CERN SPS in ${}^{40}$Ar + ${}^{45}$Sc collisions at 150A GeV/c. The dependence of second-order scaled factorial moments of proton multiplicity distribution on the number of subdivisions of transverse momentum space is measured. The intermittency analysis is performed using both transverse momentum and cumulative transverse momentum. For the first time, statistically independent data sets are used for each subdivision number. The obtained results do not indicate any statistically significant intermittency pattern. An upper limit on the fraction of critical proton pairs and the power of the correlation function is obtained based on a comparison with the Power-law Model developed for this purpose.
△ Less
Submitted 12 May, 2023;
originally announced May 2023.
-
End-to-End Policy Gradient Method for POMDPs and Explainable Agents
Authors:
Soichiro Nishimori,
Sotetsu Koyamada,
Shin Ishii
Abstract:
Real-world decision-making problems are often partially observable, and many can be formulated as a Partially Observable Markov Decision Process (POMDP). When we apply reinforcement learning (RL) algorithms to the POMDP, reasonable estimation of the hidden states can help solve the problems. Furthermore, explainable decision-making is preferable, considering their application to real-world tasks s…
▽ More
Real-world decision-making problems are often partially observable, and many can be formulated as a Partially Observable Markov Decision Process (POMDP). When we apply reinforcement learning (RL) algorithms to the POMDP, reasonable estimation of the hidden states can help solve the problems. Furthermore, explainable decision-making is preferable, considering their application to real-world tasks such as autonomous driving cars. We proposed an RL algorithm that estimates the hidden states by end-to-end training, and visualize the estimation as a state-transition graph. Experimental results demonstrated that the proposed algorithm can solve simple POMDP problems and that the visualization makes the agent's behavior interpretable to humans.
△ Less
Submitted 19 April, 2023;
originally announced April 2023.
-
Pgx: Hardware-Accelerated Parallel Game Simulators for Reinforcement Learning
Authors:
Sotetsu Koyamada,
Shinri Okano,
Soichiro Nishimori,
Yu Murata,
Keigo Habara,
Haruka Kita,
Shin Ishii
Abstract:
We propose Pgx, a suite of board game reinforcement learning (RL) environments written in JAX and optimized for GPU/TPU accelerators. By leveraging JAX's auto-vectorization and parallelization over accelerators, Pgx can efficiently scale to thousands of simultaneous simulations over accelerators. In our experiments on a DGX-A100 workstation, we discovered that Pgx can simulate RL environments 10-1…
▽ More
We propose Pgx, a suite of board game reinforcement learning (RL) environments written in JAX and optimized for GPU/TPU accelerators. By leveraging JAX's auto-vectorization and parallelization over accelerators, Pgx can efficiently scale to thousands of simultaneous simulations over accelerators. In our experiments on a DGX-A100 workstation, we discovered that Pgx can simulate RL environments 10-100x faster than existing implementations available in Python. Pgx includes RL environments commonly used as benchmarks in RL research, such as backgammon, chess, shogi, and Go. Additionally, Pgx offers miniature game sets and baseline models to facilitate rapid research cycles. We demonstrate the efficient training of the Gumbel AlphaZero algorithm with Pgx environments. Overall, Pgx provides high-performance environment simulators for researchers to accelerate their RL experiments. Pgx is available at http://github.com/sotetsuk/pgx.
△ Less
Submitted 15 January, 2024; v1 submitted 28 March, 2023;
originally announced March 2023.
-
First measurement of muon neutrino charged-current interactions on hydrocarbon without pions in the final state using multiple detectors with correlated energy spectra at T2K
Authors:
K. Abe,
N. Akhlaq,
R. Akutsu,
H. Alarakia-Charles,
A. Ali,
Y. I. Alj Hakim,
S. Alonso Monsalve,
C. Alt,
C. Andreopoulos,
M. Antonova,
S. Aoki,
T. Arihara,
Y. Asada,
Y. Ashida,
E. T. Atkin,
M. Barbi,
G. J. Barker,
G. Barr,
D. Barrow,
M. Batkiewicz-Kwasniak,
F. Bench,
V. Berardi,
L. Berns,
S. Bhadra,
A. Blanchet
, et al. (380 additional authors not shown)
Abstract:
This paper reports the first measurement of muon neutrino charged-current interactions without pions in the final state using multiple detectors with correlated energy spectra at T2K. The data was collected on hydrocarbon targets using the off-axis T2K near detector (ND280) and the on-axis T2K near detector (INGRID) with neutrino energy spectra peaked at 0.6 GeV and 1.1 GeV respectively. The corre…
▽ More
This paper reports the first measurement of muon neutrino charged-current interactions without pions in the final state using multiple detectors with correlated energy spectra at T2K. The data was collected on hydrocarbon targets using the off-axis T2K near detector (ND280) and the on-axis T2K near detector (INGRID) with neutrino energy spectra peaked at 0.6 GeV and 1.1 GeV respectively. The correlated neutrino flux presents an opportunity to reduce the impact of the flux uncertainty and to study the energy dependence of neutrino interactions. The extracted double-differential cross sections are compared to several Monte Carlo neutrino-nucleus interaction event generators showing the agreement between both detectors individually and with the correlated result.
△ Less
Submitted 18 October, 2023; v1 submitted 24 March, 2023;
originally announced March 2023.
-
Measurements of neutrino oscillation parameters from the T2K experiment using $3.6\times10^{21}$ protons on target
Authors:
The T2K Collaboration,
K. Abe,
N. Akhlaq,
R. Akutsu,
A. Ali,
S. Alonso Monsalve,
C. Alt,
C. Andreopoulos,
M. Antonova,
S. Aoki,
T. Arihara,
Y. Asada,
Y. Ashida,
E. T. Atkin,
M. Barbi,
G. J. Barker,
G. Barr,
D. Barrow,
M. Batkiewicz-Kwasniak,
F. Bench,
V. Berardi,
L. Berns,
S. Bhadra,
A. Blanchet,
A. Blondel
, et al. (376 additional authors not shown)
Abstract:
The T2K experiment presents new measurements of neutrino oscillation parameters using $19.7(16.3)\times10^{20}$ protons on target (POT) in (anti-)neutrino mode at the far detector (FD). Compared to the previous analysis, an additional $4.7\times10^{20}$ POT neutrino data was collected at the FD. Significant improvements were made to the analysis methodology, with the near-detector analysis introdu…
▽ More
The T2K experiment presents new measurements of neutrino oscillation parameters using $19.7(16.3)\times10^{20}$ protons on target (POT) in (anti-)neutrino mode at the far detector (FD). Compared to the previous analysis, an additional $4.7\times10^{20}$ POT neutrino data was collected at the FD. Significant improvements were made to the analysis methodology, with the near-detector analysis introducing new selections and using more than double the data. Additionally, this is the first T2K oscillation analysis to use NA61/SHINE data on a replica of the T2K target to tune the neutrino flux model, and the neutrino interaction model was improved to include new nuclear effects and calculations. Frequentist and Bayesian analyses are presented, including results on $\sin^2θ_{13}$ and the impact of priors on the $δ_\mathrm{CP}$ measurement. Both analyses prefer the normal mass ordering and upper octant of $\sin^2θ_{23}$ with a nearly maximally CP-violating phase. Assuming the normal ordering and using the constraint on $\sin^2θ_{13}$ from reactors, $\sin^2θ_{23}=0.561^{+0.021}_{-0.032}$ using Feldman--Cousins corrected intervals, and $Δm^2_{32}=2.494_{-0.058}^{+0.041}\times10^{-3}~\mathrm{eV^2}$ using constant $Δχ^{2}$ intervals. The CP-violating phase is constrained to $δ_\mathrm{CP}=-1.97_{-0.70}^{+0.97}$ using Feldman--Cousins corrected intervals, and $δ_\mathrm{CP}=0,π$ is excluded at more than 90% confidence level. A Jarlskog invariant of zero is excluded at more than $2σ$ credible level using a flat prior in $δ_\mathrm{CP}$, and just below $2σ$ using a flat prior in $\sinδ_\mathrm{CP}$. When the external constraint on $\sin^2θ_{13}$ is removed, $\sin^2θ_{13}=28.0^{+2.8}_{-6.5}\times10^{-3}$, in agreement with measurements from reactor experiments. These results are consistent with previous T2K analyses.
△ Less
Submitted 10 September, 2023; v1 submitted 6 March, 2023;
originally announced March 2023.
-
Measurements of two-pion HBT correlations in Be+Be collisions at 150A GeV/c beam momentum, at the NA61/SHINE experiment at CERN
Authors:
NA61/SHINE Collaboration,
:,
H. Adhikary,
P. Adrich,
K. K. Allison,
N. Amin,
E. V. Andronov,
T. Antićić,
I. -C. Arsene,
M. Bajda,
Y. Balkova,
M. Baszczyk,
D. Battaglia,
A. Bazgir,
S. Bhosale,
M. Bielewicz,
A. Blondel,
M. Bogomilov,
Y. Bondar,
N. Bostan,
A. Brandin,
W. Bryliński,
J. Brzychczyk,
M. Buryakov,
A. F. Camino
, et al. (133 additional authors not shown)
Abstract:
This paper reports measurements of two-pion Bose-Einstein (HBT) correlations in Be+Be collisions at a beam momentum of 150$A\,\mbox{GeV}/\textit{c}$ by the $\mbox{NA61/SHINE}$ experiment at the CERN SPS accelerator. The obtained momentum space correlation functions can be well described by a Lévy distributed source model. The transverse mass dependence of the Lévy source parameters is presented, a…
▽ More
This paper reports measurements of two-pion Bose-Einstein (HBT) correlations in Be+Be collisions at a beam momentum of 150$A\,\mbox{GeV}/\textit{c}$ by the $\mbox{NA61/SHINE}$ experiment at the CERN SPS accelerator. The obtained momentum space correlation functions can be well described by a Lévy distributed source model. The transverse mass dependence of the Lévy source parameters is presented, and their possible theoretical interpretations are discussed. The results show that the Lévy exponent $α$ is approximately constant as a function of $m_{\rm{T}}$ , and far from both the Gaussian case of $α= 2$ or the conjectured value at the critical endpoint, $α= 0.5$. The radius scale parameter $R$ shows a slight decrease in $m_{\rm{T}}$, which can be explained as a signature of transverse flow. Finally, an approximately constant trend of the intercept parameter $λ$ as a function of $m_{\rm{T}}$ was observed, different from measurement results at RHIC.
△ Less
Submitted 9 February, 2023;
originally announced February 2023.
-
Measurements of $K^0_{\textrm{S}}$, $Λ$ and $\barΛ$ production in 120 GeV/$c$ p + C interactions
Authors:
NA61/SHINE Collaboration,
:,
H. Adhikary,
K. K. Allison,
N. Amin,
E. V. Andronov,
T. Antićić,
I. -C. Arsene,
Y. Balkova,
M. Baszczyk,
D. Battaglia,
S. Bhosale,
A. Blondel,
M. Bogomilov,
Y. Bondar,
N. Bostan,
A. Brandin,
A. Bravar,
W. Bryliński,
J. Brzychczyk,
M. Buryakov,
M. Ćirković,
M. Csanad,
J. Cybowska,
T. Czopowicz
, et al. (134 additional authors not shown)
Abstract:
This paper presents multiplicity measurements of $K^0_{\textrm{S}}$, $Λ$, and $\barΛ$ produced in 120 GeV/$c$ proton-carbon interactions. The measurements were made using data collected at the NA61/SHINE experiment during two different periods. Decays of these neutral hadrons impact the measured $π^+$, $π^-$, $p$ and $\bar{p}$ multiplicities in the 120 GeV/$c$ proton-carbon reaction, which are cru…
▽ More
This paper presents multiplicity measurements of $K^0_{\textrm{S}}$, $Λ$, and $\barΛ$ produced in 120 GeV/$c$ proton-carbon interactions. The measurements were made using data collected at the NA61/SHINE experiment during two different periods. Decays of these neutral hadrons impact the measured $π^+$, $π^-$, $p$ and $\bar{p}$ multiplicities in the 120 GeV/$c$ proton-carbon reaction, which are crucial inputs for long-baseline neutrino experiment predictions of neutrino beam flux. The double-differential multiplicities presented here will be used to more precisely measure charged-hadron multiplicities in this reaction, and to re-weight neutral hadron production in neutrino beam Monte Carlo simulations.
△ Less
Submitted 2 March, 2023; v1 submitted 31 October, 2022;
originally announced November 2022.
-
Measurement of Hadron Production in $π^-$-C Interactions at 158 and 350 GeV/c with NA61/SHINE at the CERN SPS
Authors:
NA61/SHINE Collaboration,
:,
H. Adhikary,
K. K. Allison,
N. Amin,
E. V. Andronov,
T. Antićić,
I. -C. Arsene,
Y. Balkova,
M. Baszczyk,
D. Battaglia,
S. Bhosale,
A. Blondel,
M. Bogomilov,
Y. Bondar,
N. Bostan,
A. Brandin,
A. Bravar,
W. Bryliński,
J. Brzychczyk,
M. Buryakov,
M. Ćirković,
M. Csanad,
J. Cybowska,
T. Czopowicz
, et al. (134 additional authors not shown)
Abstract:
We present a measurement of the momentum spectra of $π^\pm$, K$^\pm$, p$^\pm$, $Λ$, $\barΛ$ and K$^{0}_{S}$ produced in interactions of negatively charged pions with carbon nuclei at beam momenta of 158 and 350 GeV/c. The total production cross sections are measured as well. The data were collected with the large-acceptance spectrometer of the fixed target experiment NA61/SHINE at the CERN SPS. Th…
▽ More
We present a measurement of the momentum spectra of $π^\pm$, K$^\pm$, p$^\pm$, $Λ$, $\barΛ$ and K$^{0}_{S}$ produced in interactions of negatively charged pions with carbon nuclei at beam momenta of 158 and 350 GeV/c. The total production cross sections are measured as well. The data were collected with the large-acceptance spectrometer of the fixed target experiment NA61/SHINE at the CERN SPS. The obtained double-differential $p$-$p_T$ spectra provide a unique reference data set with unprecedented precision and large phase-space coverage to tune models used for the simulation of particle production in extensive air showers in which pions are the most numerous projectiles.
△ Less
Submitted 21 September, 2022;
originally announced September 2022.
