-
Combining Stochastic Adaptive Cubic Regularization with Negative Curvature for Nonconvex Optimization
Authors:
Seonho Park,
Seung Hyun Jung,
Panos M. Pardalos
Abstract:
We focus on minimizing nonconvex finite-sum functions that typically arise in machine learning problems. In an attempt to solve this problem, the adaptive cubic regularized Newton method has shown its strong global convergence guarantees and ability to escape from strict saddle points. This method uses a trust region-like scheme to determine if an iteration is successful or not, and updates only w…
▽ More
We focus on minimizing nonconvex finite-sum functions that typically arise in machine learning problems. In an attempt to solve this problem, the adaptive cubic regularized Newton method has shown its strong global convergence guarantees and ability to escape from strict saddle points. This method uses a trust region-like scheme to determine if an iteration is successful or not, and updates only when it is successful. In this paper, we suggest an algorithm combining negative curvature with the adaptive cubic regularized Newton method to update even at unsuccessful iterations. We call this new method Stochastic Adaptive cubic regularization with Negative Curvature (SANC). Unlike the previous method, in order to attain stochastic gradient and Hessian estimators, the SANC algorithm uses independent sets of data points of consistent size over all iterations. It makes the SANC algorithm more practical to apply for solving large-scale machine learning problems. To the best of our knowledge, this is the first approach that combines the negative curvature method with the adaptive cubic regularized Newton method. Finally, we provide experimental results including neural networks problems supporting the efficiency of our method.
△ Less
Submitted 26 June, 2019;
originally announced June 2019.
-
Feasibility Study of Neutron Dose for Real Time Image Guided Proton Therapy: A Monte Carlo Study
Authors:
** Sung Kim,
Jung Suk Shin,
Daehyun Kim,
EunHyuk Shin,
Kwangzoo Chung,
Sungkoo Cho,
Sung Hwan Ahn,
Sanggyu Ju,
Yoonsun Chung,
Sang Hoon Jung,
Youngyih Han
Abstract:
Two full rotating gantry with different nozzles (Multipurpose nozzle with MLC, Scanning Dedicated nozzle) with conventional cyclotron system is installed and under commissioning for various proton treatment options at Samsung Medical Center in Korea. The purpose of this study is to investigate neutron dose equivalent per therapeutic dose, H/D, to x-ray imaging equipment under various treatment con…
▽ More
Two full rotating gantry with different nozzles (Multipurpose nozzle with MLC, Scanning Dedicated nozzle) with conventional cyclotron system is installed and under commissioning for various proton treatment options at Samsung Medical Center in Korea. The purpose of this study is to investigate neutron dose equivalent per therapeutic dose, H/D, to x-ray imaging equipment under various treatment conditions with monte carlo simulation. At first, we investigated H/D with the various modifications of the beam line devices (Scattering, Scanning, Multi-leaf collimator, Aperture, Compensator) at isocenter, 20, 40, 60 cm distance from isocenter and compared with other research groups. Next, we investigated the neutron dose at x-ray equipments used for real time imaging with various treatment conditions. Our investigation showed the 0.07 ~ 0.19 mSv/Gy at x-ray imaging equipments according to various treatment options and intestingly 50% neutron dose reduction effect of flat panel detector was observed due to multi- leaf collimator during proton scanning treatment with multipurpose nozzle. In future studies, we plan to investigate experimental measurement of neutron dose and validation of simulation data for x-ray imaging equipment with additional neutron dose reduction method.
△ Less
Submitted 11 March, 2015;
originally announced March 2015.
-
Infrared Hall conductivity of Na$_{0.7}$CoO$_2$
Authors:
E. J. Choi,
S. H. Jung,
J. H. Noh,
A. Zimmers,
D. Schmadel,
H. D. Drew,
J. Y. Son,
J. H. Cho
Abstract:
We report infrared Hall conductivity $σ_{xy}(ω)$ of Na$_{0.7}$CoO$_2$ thin films determined from Faraday rotation angle $θ_{F}$ measurements. $σ_{xy}(ω)$ exhibits two types of hole conduction, Drude and incoherent carriers. The coherent Drude carrier shows a large renormalized mass and Fermi liquid-like behavior of Hall scattering rate, $γ_{H} \sim aT^{2}$. The spectral weight is suppressed and…
▽ More
We report infrared Hall conductivity $σ_{xy}(ω)$ of Na$_{0.7}$CoO$_2$ thin films determined from Faraday rotation angle $θ_{F}$ measurements. $σ_{xy}(ω)$ exhibits two types of hole conduction, Drude and incoherent carriers. The coherent Drude carrier shows a large renormalized mass and Fermi liquid-like behavior of Hall scattering rate, $γ_{H} \sim aT^{2}$. The spectral weight is suppressed and disappears at T = 120K. The incoherent carrier response is centered at mid-IR frequency and shifts to lower energy with increasing T. Infrared Hall constant is positive and almost independent of temperature in sharp contrast with the dc-Hall constant.
△ Less
Submitted 3 November, 2006; v1 submitted 1 November, 2006;
originally announced November 2006.