-
PAC-Bayesian Spectrally-Normalized Bounds for Adversarially Robust Generalization
Authors:
Jiancong Xiao,
Ruoyu Sun,
Zhi- Quan Luo
Abstract:
Deep neural networks (DNNs) are vulnerable to adversarial attacks. It is found empirically that adversarially robust generalization is crucial in establishing defense algorithms against adversarial attacks. Therefore, it is interesting to study the theoretical guarantee of robust generalization. This paper focuses on norm-based complexity, based on a PAC-Bayes approach (Neyshabur et al., 2017). Th…
▽ More
Deep neural networks (DNNs) are vulnerable to adversarial attacks. It is found empirically that adversarially robust generalization is crucial in establishing defense algorithms against adversarial attacks. Therefore, it is interesting to study the theoretical guarantee of robust generalization. This paper focuses on norm-based complexity, based on a PAC-Bayes approach (Neyshabur et al., 2017). The main challenge lies in extending the key ingredient, which is a weight perturbation bound in standard settings, to the robust settings. Existing attempts heavily rely on additional strong assumptions, leading to loose bounds. In this paper, we address this issue and provide a spectrally-normalized robust generalization bound for DNNs. Compared to existing bounds, our bound offers two significant advantages: Firstly, it does not depend on additional assumptions. Secondly, it is considerably tighter, aligning with the bounds of standard generalization. Therefore, our result provides a different perspective on understanding robust generalization: The mismatch terms between standard and robust generalization bounds shown in previous studies do not contribute to the poor robust generalization. Instead, these disparities solely due to mathematical issues. Finally, we extend the main result to adversarial robustness against general non-$\ell_p$ attacks and other neural network architectures.
△ Less
Submitted 28 October, 2023; v1 submitted 9 October, 2023;
originally announced October 2023.
-
Optical Observing Conditions at Delingha Station
Authors:
J. F. Tian,
L. C. Deng,
X. B. Zhang,
X. M. Lu,
J. J. Sun,
Q. L. Liu,
Q. Zhou,
Z. Z. Yan,
Y. Xin,
K. Wang,
X. J. Jiang,
Z. Q. Luo,
J. Yang
Abstract:
SONG is a global ground based network of 1 meter telescopes for stellar time-domain science, an international collaboration involving many countries across the world. In order to enable a favourable duty cycle, the SONG network plans to create a homogeneous distribution of 4 nodes in each of the northern and southern hemispheres. A natural possibility was building one of the northern nodes in East…
▽ More
SONG is a global ground based network of 1 meter telescopes for stellar time-domain science, an international collaboration involving many countries across the world. In order to enable a favourable duty cycle, the SONG network plans to create a homogeneous distribution of 4 nodes in each of the northern and southern hemispheres. A natural possibility was building one of the northern nodes in East Asia, preferably on the Qinghai-Tibetan Plateau. During the last decade, a great deal of effort has been invested in searching for high a quality site for ground based astronomy in China, since this has been one of the major concerns for the development of Chinese astronomy. A number of sites on the plateau have been in operation for many years, but most of them are used only for radio astronomy, as well as small optical telescopes for applied astronomy. Several potential sites for large optical instruments have been identified by the plateau site survey, but as yet none of them have been adequately quantitatively characterised. Here we present results from a detailed multi-year study of the Delingha site, which was eventually selected for the SONG-China node. We also describe the site monitoring system that will allow an isolated SONG and 50BiN node to operate safely in an automated mode.
△ Less
Submitted 2 February, 2016;
originally announced February 2016.
-
Photometric study of the pulsating, eclipsing binary OO Dra
Authors:
X. B. Zhang,
L. C. Deng,
J. F. Tian,
K. Wang,
J. J. Sun,
Q. L. Liu,
H. Q. Xin,
Q. Zhou,
Z. Z. Yan,
Z. Q. Luo,
C. Q. Luo
Abstract:
We present a comprehensive photometric study of the pulsating, eclipsing binary OO Dra. Simultaneous B- and V-band photometry of the star was carried out on 14 nights. Revised orbital period and a new ephemeris were derived from the data. The first photometric solution of the binary system and the physical parameters of the component stars are determined. It reveals that OO Dra could be a detached…
▽ More
We present a comprehensive photometric study of the pulsating, eclipsing binary OO Dra. Simultaneous B- and V-band photometry of the star was carried out on 14 nights. Revised orbital period and a new ephemeris were derived from the data. The first photometric solution of the binary system and the physical parameters of the component stars are determined. It reveals that OO Dra could be a detached system with the less-massive secondary component nearly filling in its Roche lobe. By subtracting the eclipsing light changes from the data, we obtained the intrinsic pulsating light curves of the hotter and massive primary component. Frequency analysis of the residuals light yields two confident pulsation modes in both B- and V-band data with the dominant frequency detected at 41.865 c/d. A brief discussion concerning the evolutionary status and the pulsation nature of the binary system is finally given.
△ Less
Submitted 4 August, 2014;
originally announced August 2014.
-
Probing charged impurities in suspended graphene using Raman spectroscopy
Authors:
Zhen Hua Ni,
Ting Yu,
Zhi Qiang Luo,
Ying Ying Wang,
Lei Liu,
Choun Pei Wong,
Jian Min Miao,
Wei Huang,
Ze Xiang Shen
Abstract:
Charged impurity (CI) scattering is one of the dominant factors that affect the carrier mobility in graphene. In this paper, we use Raman spectroscopy to probe the charged impurities in suspended graphene. We find that the 2D band intensity is very sensitive to the CI concentration in graphene, while the G band intensity is not affected. The intensity ratio between the 2D and G bands, I2D/IG, of…
▽ More
Charged impurity (CI) scattering is one of the dominant factors that affect the carrier mobility in graphene. In this paper, we use Raman spectroscopy to probe the charged impurities in suspended graphene. We find that the 2D band intensity is very sensitive to the CI concentration in graphene, while the G band intensity is not affected. The intensity ratio between the 2D and G bands, I2D/IG, of suspended graphene is much stronger compared to that of non-suspended graphene, due to the extremely weak CI scattering in the former. This finding is consistent with the ultra-high carrier mobility in suspended graphene observed in recent transport measurements. Our results also suggest that at low CI concentrations that are critical for device applications, the I2D/IG ratio is a better criterion in selecting high quality single layer graphene samples than is the G band blue shift.
△ Less
Submitted 18 February, 2009; v1 submitted 22 December, 2008;
originally announced December 2008.
-
Phase Transition Between superfluid and Normal states of Neutrons in Neutron Stars--The Origin of Glitches of Pulsars
Authors:
Q. H. Peng,
Z. Q. Luo
Abstract:
Starting from a neutron star heating mechanism by the magnetic dipole radiation from the 3^P_2 neutron superfluid vortices in neutron stars, we propose a neutron phase oscillation model which describes the phase transition between the normal neutron Fermi fluid and the 3^P_2 neutron superfluid vortices at the transition temperature of T_{trans}=(5-6)\times 10^8 K. With this model, we can give qu…
▽ More
Starting from a neutron star heating mechanism by the magnetic dipole radiation from the 3^P_2 neutron superfluid vortices in neutron stars, we propose a neutron phase oscillation model which describes the phase transition between the normal neutron Fermi fluid and the 3^P_2 neutron superfluid vortices at the transition temperature of T_{trans}=(5-6)\times 10^8 K. With this model, we can give qualitative explanation to most of the pulsar glitches observed up to date.
△ Less
Submitted 6 January, 2005;
originally announced January 2005.
