Showing 1–27 of 27 results for author: Wang, A L

"Beam `a la carte": laser heater sha** for attosecond pulses in a multiplexed x-ray free-electron laser

Authors: Siqi Li, Zhen Zhang, Shawn Alverson, David Cesar, Taran Driver, Paris Franz, Erik Isele, Joseph P. Duris, Kirk Larsen, Ming-Fu Lin, Razib Obaid, Jordan T O'Neal, River Robles, Nick Sudar, Zhaoheng Guo, Sharon Vetter, Peter Walter, Anna L. Wang, Joseph Xu, Sergio Carbajo, James P. Cryan, Agostino Marinelli

Abstract: Electron beam sha** allows the control of the temporal properties of x-ray free-electron laser pulses from femtosecond to attosecond timescales. Here we demonstrate the use of a laser heater to shape electron bunches and enable the generation of attosecond x-ray pulses. We demonstrate that this method can be applied in a selective way, sha** a targeted subset of bunches while leaving the remai… ▽ More Electron beam sha** allows the control of the temporal properties of x-ray free-electron laser pulses from femtosecond to attosecond timescales. Here we demonstrate the use of a laser heater to shape electron bunches and enable the generation of attosecond x-ray pulses. We demonstrate that this method can be applied in a selective way, sha** a targeted subset of bunches while leaving the remaining bunches unchanged. This experiment enables the delivery of shaped x-ray pulses to multiple undulator beamlines, with pulse properties tailored to specialized scientific applications. △ Less

Submitted 2 April, 2024; originally announced April 2024.

Accelerated Objective Gap and Gradient Norm Convergence for Gradient Descent via Long Steps

Authors: Benjamin Grimmer, Kevin Shu, Alex L. Wang

Abstract: This work considers gradient descent for L-smooth convex optimization with stepsizes larger than the classic regime where descent can be ensured. The stepsize schedules considered are similar to but differ slightly from the recent silver stepsizes of Altschuler and Parrilo. For one of our stepsize sequences, we prove a $O\left(N^{- 1.2716\dots}\right)$ convergence rate in terms of objective gap de… ▽ More This work considers gradient descent for L-smooth convex optimization with stepsizes larger than the classic regime where descent can be ensured. The stepsize schedules considered are similar to but differ slightly from the recent silver stepsizes of Altschuler and Parrilo. For one of our stepsize sequences, we prove a $O\left(N^{- 1.2716\dots}\right)$ convergence rate in terms of objective gap decrease and for the other, we show the same rate of decrease for squared-gradient-norm decrease. This first result improves on the recent result of Altschuler and Parrilo by a constant factor, while the second results improve on the exponent of the prior best squared-gradient-norm convergence guarantee of $O\left(N^{-1}\right)$. △ Less

Submitted 12 April, 2024; v1 submitted 20 March, 2024; originally announced March 2024.

On semidefinite descriptions for convex hulls of quadratic programs

Authors: Alex L. Wang, Fatma Kilinc-Karzan

Abstract: Quadratically constrained quadratic programs (QCQPs) are a highly expressive class of nonconvex optimization problems. While QCQPs are NP-hard in general, they admit a natural convex relaxation via the standard semidefinite program (SDP) relaxation. In this paper we study when the convex hull of the epigraph of a QCQP coincides with the projected epigraph of the SDP relaxation. We present a suffic… ▽ More Quadratically constrained quadratic programs (QCQPs) are a highly expressive class of nonconvex optimization problems. While QCQPs are NP-hard in general, they admit a natural convex relaxation via the standard semidefinite program (SDP) relaxation. In this paper we study when the convex hull of the epigraph of a QCQP coincides with the projected epigraph of the SDP relaxation. We present a sufficient condition for convex hull exactness and show that this condition is further necessary under an additional geometric assumption. The sufficient condition is based on geometric properties of $Γ$, the cone of convex Lagrange multipliers, and its relatives $Γ_1$ and $Γ^\circ$. △ Less

Submitted 20 March, 2024; v1 submitted 7 March, 2024; originally announced March 2024.

Comments: This paper is a significant rewrite of arXiv:2011.07155 [math.OC] and contains both new content and rewritten content

Attosecond X-ray Chronoscopy of Core-level Photoemission

Authors: Jia-Bao Ji, Zhaoheng Guo, Taran Driver, Cynthia S. Trevisan, David Cesar, Xinxin Cheng, Joseph Duris, Paris L. Franz, James Glownia, Xiaochun Gong, Daniel Hammerland, Meng Han, Saijoscha Heck, Matthias Hoffmann, Andrei Kamalov, Kirk A. Larsen, Xiang Li, Ming-Fu Lin, Yuchen Liu, C. William McCurdy, Razib Obaid, Jordan T. ONeal, Thomas N. Rescigno, River R. Robles, Nicholas Sudar , et al. (10 additional authors not shown)

Abstract: Attosecond photoemission or photoionization delays are a unique probe of the structure and the electronic dynamics of matter. However, spectral congestion and spatial delocalization of valence electron wave functions set fundamental limits to the complexity of systems that can be studied and the information that can be retrieved, respectively. Using attosecond X-ray pulses from LCLS, we demonstrat… ▽ More Attosecond photoemission or photoionization delays are a unique probe of the structure and the electronic dynamics of matter. However, spectral congestion and spatial delocalization of valence electron wave functions set fundamental limits to the complexity of systems that can be studied and the information that can be retrieved, respectively. Using attosecond X-ray pulses from LCLS, we demonstrate the key advantages of measuring core-level delays: the photoelectron spectra remain atom-like, the measurements become element specific and the observed scattering dynamics originate from a point-like source. We exploit these unique features to reveal the effects of electronegativity and symmetry on attosecond scattering dynamics by measuring the photoionization delays between N-1s and C-1s core shells of a series of aromatic azabenzene molecules. Remarkably, the delays systematically increase with the number of nitrogen atoms in the molecule and reveal multiple resonances. We identify two previously unknown mechanisms regulating the associated attosecond dynamics, namely the enhanced confinement of the trapped wavefunction with increasing electronegativity of the atoms and the decrease of the coupling strength among the photoemitted partial waves with increasing symmetry. This study demonstrates the unique opportunities opened by measurements of core-level photoionization delays for unravelling attosecond electron dynamics in complex matter. △ Less

Submitted 8 April, 2024; v1 submitted 27 February, 2024; originally announced February 2024.

Attosecond Delays in X-ray Molecular Ionization

Authors: Taran Driver, Miles Mountney, Jun Wang, Lisa Ortmann, Andre Al-Haddad, Nora Berrah, Christoph Bostedt, Elio G. Champenois, Louis F. DiMauro, Joseph Duris, Douglas Garratt, James M. Glownia, Zhaoheng Guo, Daniel Haxton, Erik Isele, Igor Ivanov, Jiabao Ji, Andrei Kamalov, Siqi Li, Ming-Fu Lin, Jon P. Marangos, Razib Obaid, Jordan T. O'Neal, Philipp Rosenberger, Niranjan H. Shivaram , et al. (12 additional authors not shown)

Abstract: The photoelectric effect is not truly instantaneous, but exhibits attosecond delays that can reveal complex molecular dynamics. Sub-femtosecond duration light pulses provide the requisite tools to resolve the dynamics of photoionization. Accordingly, the past decade has produced a large volume of work on photoionization delays following single photon absorption of an extreme ultraviolet (XUV) phot… ▽ More The photoelectric effect is not truly instantaneous, but exhibits attosecond delays that can reveal complex molecular dynamics. Sub-femtosecond duration light pulses provide the requisite tools to resolve the dynamics of photoionization. Accordingly, the past decade has produced a large volume of work on photoionization delays following single photon absorption of an extreme ultraviolet (XUV) photon. However, the measurement of time-resolved core-level photoionization remained out of reach. The required x-ray photon energies needed for core-level photoionization were not available with attosecond tabletop sources. We have now measured the x-ray photoemission delay of core-level electrons, and here report unexpectedly large delays, ranging up to 700 attoseconds in NO near the oxygen K-shell threshold. These measurements exploit attosecond soft x-ray pulses from a free-electron laser (XFEL) to scan across the entire region near the K-shell threshold. Furthermore, we find the delay spectrum is richly modulated, suggesting several contributions including transient trap** of the photoelectron due to shape resonances, collisions with the Auger-Meitner electron that is emitted in the rapid non-radiative relaxation of the molecule, and multi-electron scattering effects. The results demonstrate how x-ray attosecond experiments, supported by comprehensive theoretical modelling, can unravel the complex correlated dynamics of core-level photoionization. △ Less

Submitted 20 February, 2024; originally announced February 2024.

Experimental Demonstration of Attosecond Pump-Probe Spectroscopy with an X-ray Free-Electron Laser

Authors: Zhaoheng Guo, Taran Driver, Sandra Beauvarlet, David Cesar, Joseph Duris, Paris L. Franz, Oliver Alexander, Dorian Bohler, Christoph Bostedt, Vitali Averbukh, Xinxin Cheng, Louis F. DiMauro, Gilles Doumy, Ruaridh Forbes, Oliver Gessner, James M. Glownia, Erik Isele, Andrei Kamalov, Kirk A. Larsen, Siqi Li, Xiang Li, Ming-Fu Lin, Gregory A. McCracken, Razib Obaid, Jordan T. ONeal , et al. (25 additional authors not shown)

Abstract: Pump-probe experiments with sub-femtosecond resolution are the key to understanding electronic dynamics in quantum systems. Here we demonstrate the generation and control of sub-femtosecond pulse pairs from a two-colour X-ray free-electron laser (XFEL). By measuring the delay between the two pulses with an angular streaking diagnostic, we characterise the group velocity of the XFEL and demonstrate… ▽ More Pump-probe experiments with sub-femtosecond resolution are the key to understanding electronic dynamics in quantum systems. Here we demonstrate the generation and control of sub-femtosecond pulse pairs from a two-colour X-ray free-electron laser (XFEL). By measuring the delay between the two pulses with an angular streaking diagnostic, we characterise the group velocity of the XFEL and demonstrate control of the pulse delay down to 270 as. We demonstrate the application of this technique to a pump-probe measurement in core-excited para-aminophenol. These results demonstrate the ability to perform pump-probe experiments with sub-femtosecond resolution and atomic site specificity. △ Less

Submitted 26 January, 2024; originally announced January 2024.

Comments: 55 pages, main manuscript (5 figures) + supplementary materials (25 figures), 30 figures total. Submitted to Nature Photonics

Accelerated Gradient Descent via Long Steps

Authors: Benjamin Grimmer, Kevin Shu, Alex L. Wang

Abstract: Recently Grimmer [1] showed for smooth convex optimization by utilizing longer steps periodically, gradient descent's textbook $LD^2/2T$ convergence guarantees can be improved by constant factors, conjecturing an accelerated rate strictly faster than $O(1/T)$ could be possible. Here we prove such a big-O gain, establishing gradient descent's first accelerated convergence rate in this setting. Name… ▽ More Recently Grimmer [1] showed for smooth convex optimization by utilizing longer steps periodically, gradient descent's textbook $LD^2/2T$ convergence guarantees can be improved by constant factors, conjecturing an accelerated rate strictly faster than $O(1/T)$ could be possible. Here we prove such a big-O gain, establishing gradient descent's first accelerated convergence rate in this setting. Namely, we prove a $O(1/T^{1.0564})$ rate for smooth convex minimization by utilizing a nonconstant nonperiodic sequence of increasingly large stepsizes. It remains open if one can achieve the $O(1/T^{1.178})$ rate conjectured by Das Gupta et. al. [2] or the optimal gradient method rate of $O(1/T^2)$. Big-O convergence rate accelerations from long steps follow from our theory for strongly convex optimization, similar to but somewhat weaker than those concurrently developed by Altschuler and Parrilo [3]. △ Less

Submitted 26 September, 2023; v1 submitted 18 September, 2023; originally announced September 2023.

Sharpness and well-conditioning of nonsmooth convex formulations in statistical signal recovery

Authors: Lijun Ding, Alex L. Wang

Abstract: We study a sample complexity vs. conditioning tradeoff in modern signal recovery problems where convex optimization problems are built from sampled observations. We begin by introducing a set of condition numbers related to sharpness in $\ell_p$ or Schatten-p norms ($p\in[1,2]$) based on nonsmooth reformulations of a class of convex optimization problems, including sparse recovery, low-rank matrix… ▽ More We study a sample complexity vs. conditioning tradeoff in modern signal recovery problems where convex optimization problems are built from sampled observations. We begin by introducing a set of condition numbers related to sharpness in $\ell_p$ or Schatten-p norms ($p\in[1,2]$) based on nonsmooth reformulations of a class of convex optimization problems, including sparse recovery, low-rank matrix sensing, covariance estimation, and (abstract) phase retrieval. In each of the recovery tasks, we show that the condition numbers become dimension independent constants once the sample size exceeds some constant multiple of the recovery threshold. Structurally, this result ensures that the inaccuracy in the recovered signal due to both observation noise and optimization error is well-controlled. Algorithmically, such a result ensures that a new first-order method for solving the class of sharp convex functions in a given $\ell_p$ or Schatten-p norm, when applied to the nonsmooth formulations, achieves nearly-dimension-independent linear convergence. △ Less

Submitted 13 July, 2023; originally announced July 2023.

Hidden convexity, optimization, and algorithms on rotation matrices

Authors: Akshay Ramachandran, Kevin Shu, Alex L. Wang

Abstract: This paper studies hidden convexity properties associated with constrained optimization problems over the set of rotation matrices $\text{SO}(n)$. Such problems are nonconvex due to the constraint $X \in \text{SO}(n)$. Nonetheless, we show that certain linear images of $\text{SO}(n)$ are convex, opening up the possibility for convex optimization algorithms with provable guarantees for these proble… ▽ More This paper studies hidden convexity properties associated with constrained optimization problems over the set of rotation matrices $\text{SO}(n)$. Such problems are nonconvex due to the constraint $X \in \text{SO}(n)$. Nonetheless, we show that certain linear images of $\text{SO}(n)$ are convex, opening up the possibility for convex optimization algorithms with provable guarantees for these problems. Our main technical contributions show that any two-dimensional image of $\text{SO}(n)$ is convex and that the projection of $\text{SO}(n)$ onto its strict upper triangular entries is convex. These results allow us to construct exact convex reformulations for constrained optimization problems over $\text{SO}(n)$ with a single constraint or with constraints defined by low-rank matrices. Both of these results are optimal in a formal sense. △ Less

Submitted 29 April, 2024; v1 submitted 17 April, 2023; originally announced April 2023.

MSC Class: 90C22; 90C26; 70G65; 52A41

Solving Stackelberg Prediction Game with Least Squares Loss via Spherically Constrained Least Squares Reformulation

Authors: Jiali Wang, Wen Huang, Rujun Jiang, Xudong Li, Alex L. Wang

Abstract: The Stackelberg prediction game (SPG) is popular in characterizing strategic interactions between a learner and an attacker. As an important special case, the SPG with least squares loss (SPG-LS) has recently received much research attention. Although initially formulated as a difficult bi-level optimization problem, SPG-LS admits tractable reformulations which can be polynomially globally solved… ▽ More The Stackelberg prediction game (SPG) is popular in characterizing strategic interactions between a learner and an attacker. As an important special case, the SPG with least squares loss (SPG-LS) has recently received much research attention. Although initially formulated as a difficult bi-level optimization problem, SPG-LS admits tractable reformulations which can be polynomially globally solved by semidefinite programming or second order cone programming. However, all the available approaches are not well-suited for handling large-scale datasets, especially those with huge numbers of features. In this paper, we explore an alternative reformulation of the SPG-LS. By a novel nonlinear change of variables, we rewrite the SPG-LS as a spherically constrained least squares (SCLS) problem. Theoretically, we show that an $ε$ optimal solution to the SCLS (and the SPG-LS) can be achieved in $\tilde{O}(N/\sqrtε)$ floating-point operations, where $N$ is the number of nonzero entries in the data matrix. Practically, we apply two well-known methods for solving this new reformulation, i.e., the Krylov subspace method and the Riemannian trust region method. Both algorithms are factorization free so that they are suitable for solving large scale problems. Numerical results on both synthetic and real-world datasets indicate that the SPG-LS, equipped with the SCLS reformulation, can be solved orders of magnitude faster than the state of the art. △ Less

Submitted 6 June, 2022; originally announced June 2022.

Accelerated first-order methods for a class of semidefinite programs

Authors: Alex L. Wang, Fatma Kilinc-Karzan

Abstract: This paper introduces a new storage-optimal first-order method (FOM), CertSDP, for solving a special class of semidefinite programs (SDPs) to high accuracy. The class of SDPs that we consider, the exact QMP-like SDPs, is characterized by low-rank solutions, a priori knowledge of the restriction of the SDP solution to a small subspace, and standard regularity assumptions such as strict complementar… ▽ More This paper introduces a new storage-optimal first-order method (FOM), CertSDP, for solving a special class of semidefinite programs (SDPs) to high accuracy. The class of SDPs that we consider, the exact QMP-like SDPs, is characterized by low-rank solutions, a priori knowledge of the restriction of the SDP solution to a small subspace, and standard regularity assumptions such as strict complementarity. Crucially, we show how to use a certificate of strict complementarity to construct a low-dimensional strongly convex minimax problem whose optimizer coincides with a factorization of the SDP optimizer. From an algorithmic standpoint, we show how to construct the necessary certificate and how to solve the minimax problem efficiently. We accompany our theoretical results with preliminary numerical experiments suggesting that CertSDP significantly outperforms current state-of-the-art methods on large sparse exact QMP-like SDPs. △ Less

Submitted 3 March, 2024; v1 submitted 1 June, 2022; originally announced June 2022.

Phase retrieval from angular streaking of XUV atomic ionization

Authors: Anatoli S. Kheifets, Rickson Wielian, Igor A. Ivanov, Anna Li Wang, Agostino Marinelli, James P. Cryan

Abstract: We demonstrate an accurate phase retrieval of XUV atomic ionization by streaking the photoelectron in a circularly polarized IR laser field. The streaking phase can then be converted to the atomic time delay containing the Wigner and continuum-continuum components. Our demonstration is based on a numerical solution of the time-dependent Schrödinger equation. We test this technique using the hydrog… ▽ More We demonstrate an accurate phase retrieval of XUV atomic ionization by streaking the photoelectron in a circularly polarized IR laser field. The streaking phase can then be converted to the atomic time delay containing the Wigner and continuum-continuum components. Our demonstration is based on a numerical solution of the time-dependent Schrödinger equation. We test this technique using the hydrogen atom ionized by an isolated attosecond XUV pulse across a wide range of photon energies. In parallel, we run a series of RABBITT simulations and demonstrate equivalence of the phase and timing information provided by the two methods. This validates the proposed technique and makes it a useful tool that can be applied to a broad range of atomic and molecular targets exposed to XUV radiation from novel free-electron laser sources. △ Less

Submitted 23 August, 2022; v1 submitted 12 February, 2022; originally announced February 2022.

Comments: 7 pages, 5 figures

Implicit regularity and linear convergence rates for the generalized trust-region subproblem

Authors: Alex L. Wang, Yunlei Lu, Fatma Kilinc-Karzan

Abstract: In this paper we develop efficient first-order algorithms for the generalized trust-region subproblem (GTRS), which has applications in signal processing, compressed sensing, and engineering. Although the GTRS, as stated, is nonlinear and nonconvex, it is well-known that objective value exactness holds for its SDP relaxation under a Slater condition. While polynomial-time SDP-based algorithms exis… ▽ More In this paper we develop efficient first-order algorithms for the generalized trust-region subproblem (GTRS), which has applications in signal processing, compressed sensing, and engineering. Although the GTRS, as stated, is nonlinear and nonconvex, it is well-known that objective value exactness holds for its SDP relaxation under a Slater condition. While polynomial-time SDP-based algorithms exist for the GTRS, their relatively large computational complexity has motivated and spurred the development of custom approaches for solving the GTRS. In particular, recent work in this direction has developed first-order methods for the GTRS whose running times are linear in the sparsity (the number of nonzero entries) of the input data. In contrast to these algorithms, in this paper we develop algorithms for computing $ε$-approximate solutions to the GTRS whose running times are linear in both the input sparsity and the precision $\log(1/ε)$ whenever a regularity parameter is positive. We complement our theoretical guarantees with numerical experiments comparing our approach against algorithms from the literature. Our numerical experiments highlight that our new algorithms significantly outperform prior state-of-the-art algorithms on sparse large-scale instances. △ Less

Submitted 27 December, 2021; originally announced December 2021.

The Time-resolved Atomic, Molecular and Optical Science Instrument at the Linac Coherent Light Source

Authors: Peter Walter, Timur Osipov, Ming-Fu Lin, James Cryan, Taran Driver, Andrei Kamalov, Agostino Marinelli, Joe Robinson, Matt Seaberg, Thomas J. A. Wolf, Jeff Aldrich, Nolan Brown, Elio G. Champenois, Xinxin Cheng, Daniele Cocco, Alan Conder, Ivan Curiel, Adam Egger, James M. Glownia, Philip Heimann, Michael Holmes, Tyler Johnson, Xiang Li, Stefan Moeller, DanielS Morton , et al. (17 additional authors not shown)

Abstract: The newly constructed Time-resolved atomic, Molecular and Optical science instrument (TMO), is configured to take full advantage of both linear accelerators at SLAC National Accelerator Laboratory, the copper accelerator operating at a repetition rate of 120 Hz providing high per pulse energy, as well as the superconducting accelerator operating at a repetition rate of about 1 MHz providing high a… ▽ More The newly constructed Time-resolved atomic, Molecular and Optical science instrument (TMO), is configured to take full advantage of both linear accelerators at SLAC National Accelerator Laboratory, the copper accelerator operating at a repetition rate of 120 Hz providing high per pulse energy, as well as the superconducting accelerator operating at a repetition rate of about 1 MHz providing high average intensity. Both accelerators build a soft X-ray free electron laser with the new variable gab undulator section. With this flexible light sources, TMO supports many experimental techniques not previously available at LCLS and will have two X-ray beam focus spots in line. Thereby, TMO supports Atomic, Molecular and Optical (AMO), strong-field and nonlinear science and will host a designated new dynamic reaction microscope with a sub-micron X-ray focus spot. The flexible instrument design is optimized for studying ultrafast electronic and molecular phenomena and can take full advantage of the sub-femtosecond soft X-ray pulse generation program. △ Less

Submitted 1 December, 2021; originally announced December 2021.

Report number: gb5129

Journal ref: Journal of Synchrotron Radiation 2022

Exactness in SDP relaxations of QCQPs: Theory and applications

Authors: Fatma Kılınç-Karzan, Alex L. Wang

Abstract: Quadratically constrained quadratic programs (QCQPs) are a fundamental class of optimization problems. In a QCQP, we are asked to minimize a (possibly nonconvex) quadratic function subject to a number of (possibly nonconvex) quadratic constraints. Such problems arise naturally in many areas of operations research, computer science, and engineering. Although QCQPs are NP-hard to solve in general, t… ▽ More Quadratically constrained quadratic programs (QCQPs) are a fundamental class of optimization problems. In a QCQP, we are asked to minimize a (possibly nonconvex) quadratic function subject to a number of (possibly nonconvex) quadratic constraints. Such problems arise naturally in many areas of operations research, computer science, and engineering. Although QCQPs are NP-hard to solve in general, they admit a natural convex relaxation via the standard (Shor) semidefinite program (SDP) relaxation. In this tutorial, we will study the SDP relaxation for general QCQPs, present various exactness concepts related to this relaxation and discuss conditions guaranteeing such SDP exactness. In particular, we will define and examine three notions of SDP exactness: (i) objective value exactness -- the condition that the optimal value of the QCQP and the optimal value of its SDP relaxation coincide, (ii) convex hull exactness -- the condition that the convex hull of the QCQP epigraph coincides with the (projected) SDP epigraph, and (iii) the rank-one generated (ROG) property -- the condition that a particular conic subset of the positive semidefinite matrices related to a given QCQP is generated by its rank-one matrices. Our analysis for objective value exactness and convex hull exactness stems from a geometric treatment of the projected SDP relaxation and crucially considers how the objective function interacts with the constraints. The ROG property complements these results by offering a sufficient condition for both objective value exactness and convex hull exactness which is oblivious to the objective function. We will give a variety of sufficient conditions for these exactness conditions and discuss settings where these sufficient conditions are additionally necessary. Throughout, we will highlight implications of our results for a number of example applications. △ Less

Submitted 14 July, 2021; originally announced July 2021.

Attosecond Coherent Electron Motion in Auger-Meitner Decay

Authors: Siqi Li, Taran Driver, Philipp Rosenberger, Elio G. Champenois, Joseph Duris, Andre Al-Haddad, Vitali Averbukh, Jonathan C. T. Barnard, Nora Berrah, Christoph Bostedt, Philip H. Bucksbaum, Ryan Coffee, Louis F. DiMauro, Li Fang, Douglas Garratt, Averell Gatton, Zhaoheng Guo, Gregor Hartmann, Daniel Haxton, Wolfram Helml, Zhirong Huang, Aaron C. LaForge, Andrei Kamalov, Jonas Knurr, Ming-Fu Lin , et al. (16 additional authors not shown)

Abstract: In quantum systems, coherent superpositions of electronic states evolve on ultrafast timescales (few femtosecond to attosecond, 1 as = 0.001 fs = 10^{-18} s), leading to a time dependent charge density. Here we exploit the first attosecond soft x-ray pulses produced by an x-ray free-electron laser to induce a coherent core-hole excitation in nitric oxide. Using an additional circularly polarized i… ▽ More In quantum systems, coherent superpositions of electronic states evolve on ultrafast timescales (few femtosecond to attosecond, 1 as = 0.001 fs = 10^{-18} s), leading to a time dependent charge density. Here we exploit the first attosecond soft x-ray pulses produced by an x-ray free-electron laser to induce a coherent core-hole excitation in nitric oxide. Using an additional circularly polarized infrared laser pulse we create a clock to time-resolve the electron dynamics, and demonstrate control of the coherent electron motion by tuning the photon energy of the x-ray pulse. Core-excited states offer a fundamental test bed for studying coherent electron dynamics in highly excited and strongly correlated matter. △ Less

Submitted 18 May, 2021; originally announced May 2021.

New notions of simultaneous diagonalizability of quadratic forms with applications to QCQPs

Authors: Alex L. Wang, Rujun Jiang

Abstract: A set of quadratic forms is simultaneously diagonalizable via congruence (SDC) if there exists a basis under which each of the quadratic forms is diagonal. This property appears naturally when analyzing quadratically constrained quadratic programs (QCQPs) and has important implications in this context. This paper extends the reach of the SDC property by studying two new related but weaker notions… ▽ More A set of quadratic forms is simultaneously diagonalizable via congruence (SDC) if there exists a basis under which each of the quadratic forms is diagonal. This property appears naturally when analyzing quadratically constrained quadratic programs (QCQPs) and has important implications in this context. This paper extends the reach of the SDC property by studying two new related but weaker notions of simultaneous diagonalizability. Specifically, we say that a set of quadratic forms is almost SDC (ASDC) if it is the limit of SDC sets and d-restricted SDC (d-RSDC) if it is the restriction of an SDC set in up to d-many additional dimensions. Our main contributions are a complete characterization of the ASDC pairs and the nonsingular ASDC triples, as well as a sufficient condition for the 1-RSDC property for pairs of quadratic forms. Surprisingly, we show that every singular pair is ASDC and that almost every pair is 1-RSDC. We accompany our theoretical results with preliminary numerical experiments applying the RSDC property to QCQPs with a single quadratic constraint. △ Less

Submitted 28 January, 2021; originally announced January 2021.

A Geometric View of SDP Exactness in QCQPs and its Applications

Authors: Alex L. Wang, Fatma Kilinc-Karzan

Abstract: Quadratically constrained quadratic programs (QCQPs) are a highly expressive class of nonconvex optimization problems. While QCQPs are NP-hard in general, they admit a natural convex relaxation via the standard (Shor) semidefinite program (SDP) relaxation. Towards understanding when this relaxation is exact, we study general QCQPs and their (projected) SDP relaxations. We present sufficient (and i… ▽ More Quadratically constrained quadratic programs (QCQPs) are a highly expressive class of nonconvex optimization problems. While QCQPs are NP-hard in general, they admit a natural convex relaxation via the standard (Shor) semidefinite program (SDP) relaxation. Towards understanding when this relaxation is exact, we study general QCQPs and their (projected) SDP relaxations. We present sufficient (and in some cases, also necessary) conditions for objective value exactness (the condition that the objective values of the QCQP and its SDP relaxation coincide) and convex hull exactness (the condition that the convex hull of the QCQP epigraph coincides with the epigraph of its SDP relaxation). Our conditions for exactness are based on geometric properties of $Γ$, the cone of convex Lagrange multipliers, and its relatives $Γ_P$ and $Γ^\circ$. These tools form the basis of our main message: questions of exactness can be treated systematically whenever $Γ$, $Γ_P$, or $Γ^\circ$ is well-understood. As further evidence of this message, we apply our tools to address questions of exactness for a prototypical QCQP involving a binary on-off constraint, quadratic matrix programs, the QCQP formulation of the partition problem, and random and semi-random QCQPs. △ Less

Submitted 26 November, 2021; v1 submitted 13 November, 2020; originally announced November 2020.

Necessary and sufficient conditions for rank-one generated cones

Authors: C. J. Argue, Fatma Kılınç-Karzan, Alex L. Wang

Abstract: A closed convex conic subset $\mathcal{S}$ of the positive semidefinite (PSD) cone is rank-one generated (ROG) if all of its extreme rays are generated by rank-one matrices. The ROG property of $\mathcal{S}$ is closely related to the exactness of SDP relaxations of nonconvex quadratically constrained quadratic programs (QCQPs) related to $\mathcal{S}$. We consider the case where $\mathcal{S}$ is o… ▽ More A closed convex conic subset $\mathcal{S}$ of the positive semidefinite (PSD) cone is rank-one generated (ROG) if all of its extreme rays are generated by rank-one matrices. The ROG property of $\mathcal{S}$ is closely related to the exactness of SDP relaxations of nonconvex quadratically constrained quadratic programs (QCQPs) related to $\mathcal{S}$. We consider the case where $\mathcal{S}$ is obtained as the intersection of the PSD cone with finitely many homogeneous linear matrix inequalities and conic constraints and identify sufficient conditions that guarantee that $\mathcal{S}$ is ROG. Our general framework allows us to recover a number of well-known results from the literature. In the case of two linear matrix inequalities, we also establish the necessity of our sufficient conditions. This extends one of the few settings from the literature -- the case of one linear matrix inequality and the S-lemma -- where an explicit characterization for the ROG property exists. Finally, we show how our ROG results on cones can be translated into inhomogeneous SDP exactness results and convex hull descriptions in the original space of a QCQP. We close with a few applications of these results; specifically, we recover the well-known perspective reformulation of a simple mixed-binary set via the ROG toolkit. △ Less

Submitted 25 May, 2021; v1 submitted 14 July, 2020; originally announced July 2020.

Weighted Cheeger and Buser Inequalities, with Applications to Clustering and Cutting Probability Densities

Authors: Timothy Chu, Gary L. Miller, Noel J. Walkington, Alex L. Wang

Abstract: In this paper, we show how sparse or isoperimetric cuts of a probability density function relate to Cheeger cuts of its principal eigenfunction, for appropriate definitions of `sparse cut' and `principal eigenfunction'. We construct these appropriate definitions of sparse cut and principal eigenfunction in the probability density setting. Then, we prove Cheeger and Buser type inequalities simila… ▽ More In this paper, we show how sparse or isoperimetric cuts of a probability density function relate to Cheeger cuts of its principal eigenfunction, for appropriate definitions of `sparse cut' and `principal eigenfunction'. We construct these appropriate definitions of sparse cut and principal eigenfunction in the probability density setting. Then, we prove Cheeger and Buser type inequalities similar to those for the normalized graph Laplacian of Alon-Milman. We demonstrate that no such inequalities hold for most prior definitions of sparse cut and principal eigenfunction. We apply this result to generate novel algorithms for cutting probability densities and clustering data, including a principled variant of spectral clustering. △ Less

Submitted 6 May, 2020; v1 submitted 20 April, 2020; originally announced April 2020.

On convex hulls of epigraphs of QCQPs

Authors: Alex L. Wang, Fatma Kilinc-Karzan

Abstract: Quadratically constrained quadratic programs (QCQPs) are a fundamental class of optimization problems well-known to be NP-hard in general. In this paper we study sufficient conditions for a convex hull result that immediately implies that the standard semidefinite program (SDP) relaxation of a QCQP is tight. We begin by outlining a general framework for proving such sufficient conditions. Then usi… ▽ More Quadratically constrained quadratic programs (QCQPs) are a fundamental class of optimization problems well-known to be NP-hard in general. In this paper we study sufficient conditions for a convex hull result that immediately implies that the standard semidefinite program (SDP) relaxation of a QCQP is tight. We begin by outlining a general framework for proving such sufficient conditions. Then using this framework, we show that the convex hull result holds whenever the quadratic eigenvalue multiplicity, a parameter capturing the amount of symmetry present in a given problem, is large enough. Our results also imply new sufficient conditions for the tightness (as well as convex hull exactness) of a second order cone program relaxation of simultaneously diagonalizable QCQPs. △ Less

Submitted 4 February, 2020; originally announced February 2020.

Comments: To appear at IPCO 2020. This conference extended abstract covers material already online at arXiv:1911.09195

On the tightness of SDP relaxations of QCQPs

Authors: Alex L. Wang, Fatma Kilinc-Karzan

Abstract: Quadratically constrained quadratic programs (QCQPs) are a fundamental class of optimization problems well-known to be NP-hard in general. In this paper we study conditions under which the standard semidefinite program (SDP) relaxation of a QCQP is tight. We begin by outlining a general framework for proving such sufficient conditions. Then using this framework, we show that the SDP relaxation is… ▽ More Quadratically constrained quadratic programs (QCQPs) are a fundamental class of optimization problems well-known to be NP-hard in general. In this paper we study conditions under which the standard semidefinite program (SDP) relaxation of a QCQP is tight. We begin by outlining a general framework for proving such sufficient conditions. Then using this framework, we show that the SDP relaxation is tight whenever the quadratic eigenvalue multiplicity, a parameter capturing the amount of symmetry present in a given problem, is large enough. We present similar sufficient conditions under which the projected epigraph of the SDP gives the convex hull of the epigraph in the original QCQP. Our results also imply new sufficient conditions for the tightness (as well as convex hull exactness) of a second order cone program relaxation of simultaneously diagonalizable QCQPs. △ Less

Submitted 13 November, 2020; v1 submitted 20 November, 2019; originally announced November 2019.

The Generalized Trust Region Subproblem: solution complexity and convex hull results

Authors: Alex L. Wang, Fatma Kilinc-Karzan

Abstract: We consider the Generalized Trust Region Subproblem (GTRS) of minimizing a nonconvex quadratic objective over a nonconvex quadratic constraint. A lifting of this problem recasts the GTRS as minimizing a linear objective subject to two nonconvex quadratic constraints. Our first main contribution is structural: we give an explicit description of the convex hull of this nonconvex set in terms of the… ▽ More We consider the Generalized Trust Region Subproblem (GTRS) of minimizing a nonconvex quadratic objective over a nonconvex quadratic constraint. A lifting of this problem recasts the GTRS as minimizing a linear objective subject to two nonconvex quadratic constraints. Our first main contribution is structural: we give an explicit description of the convex hull of this nonconvex set in terms of the generalized eigenvalues of an associated matrix pencil. This result may be of interest in building relaxations for nonconvex quadratic programs. Moreover, this result allows us to reformulate the GTRS as the minimization of two convex quadratic functions in the original space. Our next set of contributions is algorithmic: we present an algorithm for solving the GTRS up to an epsilon additive error based on this reformulation. We carefully handle numerical issues that arise from inexact generalized eigenvalue and eigenvector computations and establish explicit running time guarantees for these algorithms. Notably, our algorithms run in linear (in the size of the input) time. Furthermore, our algorithm for computing an epsilon-optimal solution has a slightly-improved running time dependence on epsilon over the state-of-the-art algorithm. Our analysis shows that the dominant cost in solving the GTRS lies in solving a generalized eigenvalue problem -- establishing a natural connection between these problems. Finally, generalizations of our convex hull results allow us to apply our algorithms and their theoretical guarantees directly to equality-, interval-, and hollow- constrained variants of the GTRS. This gives the first linear-time algorithm in the literature for these variants of the GTRS. △ Less

Submitted 13 November, 2020; v1 submitted 20 July, 2019; originally announced July 2019.

Electron Correlation Effects in Attosecond Photoionization of CO$_{2}$

Authors: Andrei Kamalov, Anna L. Wang, Philip H. Bucksbaum, Daniel J. Haxton, James P. Cryan

Abstract: A technique for measuring photoionization time delays with attosecond precision is combined with calculations of photoionization matrix elements to demonstrate how multi-electron dynamics affect photoionization time delays in carbon dioxide. Electron correlation is observed to affect the time delays through two mechanisms: autoionization of molecular Rydberg states and accelerated escape from a co… ▽ More A technique for measuring photoionization time delays with attosecond precision is combined with calculations of photoionization matrix elements to demonstrate how multi-electron dynamics affect photoionization time delays in carbon dioxide. Electron correlation is observed to affect the time delays through two mechanisms: autoionization of molecular Rydberg states and accelerated escape from a continuum shape resonance. △ Less

Submitted 25 June, 2019; originally announced June 2019.

Journal ref: Phys. Rev. A 102, 023118 (2020)

Laser Cooling of Radium Ions

Authors: M. Fan, C. A. Holliman, A. L. Wang, A. M. Jayich

Abstract: The unstable radium nucleus is appealing for probing new physics due to its high mass, octupole deformation and energy level structure. Ion traps, with long hold times and low particle numbers, are excellent for work with radioactive species, such as radium and radium-based molecular ions, where low activity, and hence low total numbers, is desirable. We address the challenges associated with the… ▽ More The unstable radium nucleus is appealing for probing new physics due to its high mass, octupole deformation and energy level structure. Ion traps, with long hold times and low particle numbers, are excellent for work with radioactive species, such as radium and radium-based molecular ions, where low activity, and hence low total numbers, is desirable. We address the challenges associated with the lack of stable isotopes in a tabletop experiment with a low-activity ($\sim 10 \ μ\mathrm{Ci}$) source where we laser-cool trapped radium ions. With a laser-cooled radium ion we measured the $7p\ ^2P_{1/2}^o$ state's branching fractions to the ground state, $7s\ ^2S_{1/2}$, and a metastable excited state, $6d\ ^2D_{3/2}$, to be $p=0.9104(7)$ and $0.0896(7)$, respectively. With a nearby tellurium reference line we measured the $7s\ ^2S_{1/2} \rightarrow 7p\ ^2P_{1/2}^o$ transition frequency, 640.09663(6) THz. △ Less

Submitted 17 June, 2019; v1 submitted 28 January, 2019; originally announced January 2019.

Comments: 5 pages, 4 figures

Journal ref: Phys. Rev. Lett. 122, 223001 (2019)

Hardy-Muckenhoupt Bounds for Laplacian Eigenvalues

Authors: Gary L. Miller, Noel J. Walkington, Alex L. Wang

Abstract: We present two graph quantities Psi(G,S) and Psi_2(G) which give constant factor estimates to the Dirichlet and Neumann eigenvalues, lambda(G,S) and lambda_2(G), respectively. Our techniques make use of a discrete Hardy-type inequality. We present two graph quantities Psi(G,S) and Psi_2(G) which give constant factor estimates to the Dirichlet and Neumann eigenvalues, lambda(G,S) and lambda_2(G), respectively. Our techniques make use of a discrete Hardy-type inequality. △ Less

Submitted 6 December, 2018; originally announced December 2018.

Enhanced Mixtures of Part Model for Human Pose Estimation

Authors: Wenjuan Gong, Yongzhen Huang, Jordi Gonzalez, and Liang Wang

Abstract: Mixture of parts model has been successfully applied to 2D human pose estimation problem either as explicitly trained body part model or as latent variables for the whole human body model. Mixture of parts model usually utilize tree structure for representing relations between body parts. Tree structures facilitate training and referencing of the model but could not deal with double counting probl… ▽ More Mixture of parts model has been successfully applied to 2D human pose estimation problem either as explicitly trained body part model or as latent variables for the whole human body model. Mixture of parts model usually utilize tree structure for representing relations between body parts. Tree structures facilitate training and referencing of the model but could not deal with double counting problems, which hinder its applications in 3D pose estimation. While most of work targeted to solve these problems tend to modify the tree models or the optimization target. We incorporate other cues from input features. For example, in surveillance environments, human silhouettes can be extracted relative easily although not flawlessly. In this condition, we can combine extracted human blobs with histogram of gradient feature, which is commonly used in mixture of parts model for training body part templates. The method can be easily extend to other candidate features under our generalized framework. We show 2D body part detection results on a public available dataset: HumanEva dataset. Furthermore, a 2D to 3D pose estimator is trained with Gaussian process regression model and 2D body part detections from the proposed method is fed to the estimator, thus 3D poses are predictable given new 2D body part detections. We also show results of 3D pose estimation on HumanEva dataset. △ Less

Submitted 28 January, 2015; v1 submitted 21 January, 2015; originally announced January 2015.