-
The Integrated Forward-Forward Algorithm: Integrating Forward-Forward and Shallow Backpropagation With Local Losses
Authors:
Desmond Y. M. Tang
Abstract:
The backpropagation algorithm, despite its widespread use in neural network learning, may not accurately emulate the human cortex's learning process. Alternative strategies, such as the Forward-Forward Algorithm (FFA), offer a closer match to the human cortex's learning characteristics. However, the original FFA paper and related works on the Forward-Forward Algorithm only mentioned very limited t…
▽ More
The backpropagation algorithm, despite its widespread use in neural network learning, may not accurately emulate the human cortex's learning process. Alternative strategies, such as the Forward-Forward Algorithm (FFA), offer a closer match to the human cortex's learning characteristics. However, the original FFA paper and related works on the Forward-Forward Algorithm only mentioned very limited types of neural network mechanisms and may limit its application and effectiveness. In response to these challenges, we propose an integrated method that combines the strengths of both FFA and shallow backpropagation, yielding a biologically plausible neural network training algorithm which can also be applied to various network structures. We applied this integrated approach to the classification of the Modified National Institute of Standards and Technology (MNIST) database, where it outperformed FFA and demonstrated superior resilience to noise compared to backpropagation. We show that training neural networks with the Integrated Forward-Forward Algorithm has the potential of generating neural networks with advantageous features like robustness.
△ Less
Submitted 22 May, 2023;
originally announced May 2023.
-
Relation of cyclotron resonant energy and luminosity in a strongly magnetized neutron star GRO J1008-57 observed by Insight-HXMT
Authors:
X. Chen,
W. Wang,
Y. M. Tang,
Y. Z. Ding,
Y. L. Tuo,
A. A. Mushtukov,
O. Nishimura,
S. N. Zhang,
M. Y. Ge,
L. M. Song,
F. J. Lu,
S. Zhang,
J. L. Qu
Abstract:
Cyclotron line scattering features are detected in a few tens of X-ray pulsars (XRPs) and used as direct indicators of a strong magnetic field at the surface of accreting neutron stars (NSs). In a few cases, cyclotron lines are known to be variable with accretion luminosity of XRPs. It is accepted that the observed variations of cyclotron line scattering features are related to variations of geome…
▽ More
Cyclotron line scattering features are detected in a few tens of X-ray pulsars (XRPs) and used as direct indicators of a strong magnetic field at the surface of accreting neutron stars (NSs). In a few cases, cyclotron lines are known to be variable with accretion luminosity of XRPs. It is accepted that the observed variations of cyclotron line scattering features are related to variations of geometry and dynamics of accretion flow above the magnetic poles of a NS. A positive correlation between the line centroid energy and luminosity is typical for sub-critical XRPs, where the accretion results in hot spots at the magnetic poles. The negative correlation was proposed to be a specific feature of bright super-critical XRPs, where radiation pressure supports accretion columns above the stellar surface. Cyclotron line in spectra of Be-transient X-ray pulsar GRO J1008-57 is detected at energies from $\sim 75 -90$ keV, the highest observed energy of cyclotron line feature in XRPs. We report the peculiar relation of cyclotron line centroid energies with luminosity in GRO J1008-57 during the Type II outburst in August 2017 observed by Insight-HXMT. The cyclotron line energy was detected to be negatively correlated with the luminosity at $3.2\times 10^{37}\,\ergs<L<4.2\times 10^{37}\,\ergs$, and positively correlated at $L\gtrsim 5\times 10^{37}\,\ergs$. We speculate that the observed peculiar behavior of a cyclotron line would be due to variations of accretion channel geometry.
△ Less
Submitted 7 July, 2021;
originally announced July 2021.
-
Accretion Torque Reversals in GRO J1008-57 Revealed by Insight-HXMT
Authors:
W. Wang,
Y. M. Tang,
Y. L. Tuo,
P. R. Epili,
S. N. Zhang,
L. M. Song,
F. J. Lu,
J. L. Qu,
S. Zhang,
M. Y. Ge,
Y. Huang,
B. Li,
Q. C. Bu,
C. Cai,
X. L. Cao,
Z. Chang,
L. Chen,
T. X. Chen,
Y. B. Chen,
Y. Chen,
Y. P. Chen,
W. W. Cui,
Y. Y. Du,
G. H. Gao,
H. Gao
, et al. (70 additional authors not shown)
Abstract:
GRO J1008-57, as a Be/X-ray transient pulsar, is considered to have the highest magnetic field in known neutron star X-ray binary systems. Observational data of the X-ray outbursts in GRO J1008-57 from 2017 to 2020 were collected by the Insight-HXMT satellite. In this work, the spin period of the neutron star in GRO J1008-57 was determined to be about 93.28 seconds in August 2017, 93.22 seconds in…
▽ More
GRO J1008-57, as a Be/X-ray transient pulsar, is considered to have the highest magnetic field in known neutron star X-ray binary systems. Observational data of the X-ray outbursts in GRO J1008-57 from 2017 to 2020 were collected by the Insight-HXMT satellite. In this work, the spin period of the neutron star in GRO J1008-57 was determined to be about 93.28 seconds in August 2017, 93.22 seconds in February 2018, 93.25 seconds in June 2019 and 93.14 seconds in June 2020. GRO J1008-57 evolved in the spin-up process with a mean rate of $-(2.10\pm 0.05)\times$10$^{-4}$ s/d from 2009 -- 2018, and turned into a spin down process with a rate of $(6.7\pm 0.6)\times$10$^{-5}$ s/d from Feb 2018 to June 2019. During the type II outburst of 2020, GRO J1008-57 had the spin-up torque again. During the torque reversals, the pulse profiles and continuum X-ray spectra did not change significantly, and the cyclotron resonant scattering feature around 80 keV was only detected during the outbursts in 2017 and 2020. Based on the observed mean spin-up rate, we estimated the inner accretion disk radius in GRO J1008-57 (about 1 - 2 times of the Alfvén radius) by comparing different accretion torque models of magnetic neutron stars. During the spin-down process, the magnetic torque should dominate over the matter accreting inflow torque, and we constrained the surface dipole magnetic field $B\geq 6\times 10^{12}$ G for the neutron star in GRO J1008-57, which is consistent with the magnetic field strength obtained by cyclotron line centroid energy.
△ Less
Submitted 24 February, 2021;
originally announced February 2021.
