Showing 201–250 of 263 results for author: Becker, S

Strong convergence rates for explicit space-time discrete numerical approximations of stochastic Allen-Cahn equations

Authors: Sebastian Becker, Benjamin Gess, Arnulf Jentzen, Peter E. Kloeden

Abstract: The scientific literature contains a number of numerical approximation results for stochastic partial differential equations (SPDEs) with superlinearly growing nonlinearities but, to the best of our knowledge, none of them prove strong or weak convergence rates for full-discrete numerical approximations of space-time white noise driven SPDEs with superlinearly growing nonlinearities. In particular… ▽ More The scientific literature contains a number of numerical approximation results for stochastic partial differential equations (SPDEs) with superlinearly growing nonlinearities but, to the best of our knowledge, none of them prove strong or weak convergence rates for full-discrete numerical approximations of space-time white noise driven SPDEs with superlinearly growing nonlinearities. In particular, in the scientific literature there exists neither a result which proves strong convergence rates nor a result which proves weak convergence rates for full-discrete numerical approximations of stochastic Allen-Cahn equations. In this article we bridge this gap and establish strong convergence rates for full-discrete numerical approximations of space-time white noise driven SPDEs with superlinearly growing nonlinearities such as stochastic Allen-Cahn equations. Moreover, we also establish lower bounds for strong temporal and spatial approximation errors which demonstrate that our strong convergence rates are essentially sharp and can, in general, not be improved. △ Less

Submitted 7 November, 2017; originally announced November 2017.

Comments: 104 pages

MSC Class: 60H35; 65C30; 60H15

Journal ref: Stoch PDE: Anal Comp (2023) 11:211-268

Improved Fixed-Rank Nyström Approximation via QR Decomposition: Practical and Theoretical Aspects

Authors: Farhad Pourkamali-Anaraki, Stephen Becker

Abstract: The Nystrom method is a popular technique that uses a small number of landmark points to compute a fixed-rank approximation of large kernel matrices that arise in machine learning problems. In practice, to ensure high quality approximations, the number of landmark points is chosen to be greater than the target rank. However, for simplicity the standard Nystrom method uses a sub-optimal procedure f… ▽ More The Nystrom method is a popular technique that uses a small number of landmark points to compute a fixed-rank approximation of large kernel matrices that arise in machine learning problems. In practice, to ensure high quality approximations, the number of landmark points is chosen to be greater than the target rank. However, for simplicity the standard Nystrom method uses a sub-optimal procedure for rank reduction. In this paper, we examine the drawbacks of the standard Nystrom method in terms of poor performance and lack of theoretical guarantees. To address these issues, we present an efficient modification for generating improved fixed-rank Nystrom approximations. Theoretical analysis and numerical experiments are provided to demonstrate the advantages of the modified method over the standard Nystrom method. Overall, the aim of this paper is to convince researchers to use the modified method, as it has nearly identical computational complexity, is easy to code, has greatly improved accuracy in many cases, and is optimal in a sense that we make precise. △ Less

Submitted 2 December, 2019; v1 submitted 8 August, 2017; originally announced August 2017.

Comments: Accepted in Neurocomputing. arXiv admin note: text overlap with arXiv:1612.06470

Journal ref: Neurocomputing, 2019

An ultrahigh-vacuum cryostat for simultaneous scanning tunneling microscopy and magneto-transport measurements down to 400mK

Authors: Marcus Liebmann, Jan Raphael Bindel, Mike Pezzotta, Stefan Becker, Florian Muckel, Tjorven Johnsen, Christian Saunus, Christian R. Ast, Markus Morgenstern

Abstract: We present the design and calibration measurements of a scanning tunneling microscope setup in a 3He ultrahigh-vacuum cryostat operating at 400 mK with a hold time of 10 days. With 2.70 m in height and 4.70 m free space needed for assembly, the cryostat fits in a one-story lab building. The microscope features optical access, an xy table, in situ tip and sample exchange, and enough contacts to fac… ▽ More We present the design and calibration measurements of a scanning tunneling microscope setup in a 3He ultrahigh-vacuum cryostat operating at 400 mK with a hold time of 10 days. With 2.70 m in height and 4.70 m free space needed for assembly, the cryostat fits in a one-story lab building. The microscope features optical access, an xy table, in situ tip and sample exchange, and enough contacts to facilitate atomic force microscopy in tuning fork operation and simultaneous magneto-transport measurements on the sample. Hence, it enables scanning tunneling spectroscopy on microstructured samples which are tuned into preselected transport regimes. A superconducting magnet provides a perpendicular field of up to 14 T. The vertical noise of the scanning tunneling microscope amounts to 1 pmrms within a 700 Hz bandwidth. Tunneling spectroscopy using one superconducting electrode revealed an energy resolution of 120 mueV. Data on tip-sample Josephson contacts yield an even smaller feature size of 60 mueV, implying that the system operates close to the physical noise limit. △ Less

Submitted 17 January, 2018; v1 submitted 29 July, 2017; originally announced July 2017.

Comments: 12 pages, 11 figures

Journal ref: Rev. Sci. Instrum. 88, 123707 (2017)

Efficient Adjoint Computation for Wavelet and Convolution Operators

Authors: James Folberth, Stephen Becker

Abstract: First-order optimization algorithms, often preferred for large problems, require the gradient of the differentiable terms in the objective function. These gradients often involve linear operators and their adjoints, which must be applied rapidly. We consider two example problems and derive methods for quickly evaluating the required adjoint operator. The first example is an image deblurring proble… ▽ More First-order optimization algorithms, often preferred for large problems, require the gradient of the differentiable terms in the objective function. These gradients often involve linear operators and their adjoints, which must be applied rapidly. We consider two example problems and derive methods for quickly evaluating the required adjoint operator. The first example is an image deblurring problem, where we must compute efficiently the adjoint of multi-stage wavelet reconstruction. Our formulation of the adjoint works for a variety of boundary conditions, which allows the formulation to generalize to a larger class of problems. The second example is a blind channel estimation problem taken from the optimization literature where we must compute the adjoint of the convolution of two signals. In each example, we show how the adjoint operator can be applied efficiently while leveraging existing software. △ Less

Submitted 6 July, 2017; originally announced July 2017.

Comments: This manuscript is published in the IEEE Signal Processing Magazine, Volume 33, Issue 6, November 2016

ACM Class: G.1.6

Reexamination of Tolman's law and the Gibbs adsorption equation for curved interfaces

Authors: Martin Thomas Horsch, Stefan Becker, Michaela Heier, Jayant Kumar Singh, Felix Diewald, Ralf Müller, George Jackson, Jadran Vrabec, Hans Hasse

Abstract: In manuscript arXiv:1703.08719 [cond-mat.soft], it was claimed that the well-known deduction of Tolman's law is not rigorous, since Tolman's argument implies that two different definitions of the surface tension, called $γ$ and $\barγ$ in the manuscript, coincide. This claim is retracted as it can be shown by free-energy minimization that $γ= \barγ$ indeed holds for the Laplace radius. Joachim Gro… ▽ More In manuscript arXiv:1703.08719 [cond-mat.soft], it was claimed that the well-known deduction of Tolman's law is not rigorous, since Tolman's argument implies that two different definitions of the surface tension, called $γ$ and $\barγ$ in the manuscript, coincide. This claim is retracted as it can be shown by free-energy minimization that $γ= \barγ$ indeed holds for the Laplace radius. Joachim Groß, Philipp Rehner, Carlos Vega, Øivind Wilhelmsen, and the anonymous reviewers of The Journal of Chemical Physics contributed to finding the mistake in the manuscript. △ Less

Submitted 3 July, 2019; v1 submitted 25 March, 2017; originally announced March 2017.

Comments: Manuscript arXiv:1703.08719 [cond-mat.soft] contains claims that were shown to be incorrect; the manuscript and the claims are retracted

URV Factorization with Random Orthogonal System Mixing

Authors: Stephen Becker, James Folberth, Laura Grigori

Abstract: The unpivoted and pivoted Householder QR factorizations are ubiquitous in numerical linear algebra. A difficulty with pivoted Householder QR is the communication bottleneck introduced by pivoting. In this paper we propose using random orthogonal systems to quickly mix together the columns of a matrix before computing an unpivoted QR factorization. This method computes a URV factorization which for… ▽ More The unpivoted and pivoted Householder QR factorizations are ubiquitous in numerical linear algebra. A difficulty with pivoted Householder QR is the communication bottleneck introduced by pivoting. In this paper we propose using random orthogonal systems to quickly mix together the columns of a matrix before computing an unpivoted QR factorization. This method computes a URV factorization which forgoes expensive pivoted QR steps in exchange for mixing in advance, followed by a cheaper, unpivoted QR factorization. The mixing step typically reduces the variability of the column norms, and in certain experiments, allows us to compute an accurate factorization where a plain, unpivoted QR performs poorly. We experiment with linear least-squares, rank-revealing factorizations, and the QLP approximation, and conclude that our randomized URV factorization behaves comparably to a similar randomized rank-revealing URV factorization, but at a fraction of the computational cost. Our experiments provide evidence that our proposed factorization might be rank-revealing with high probability. △ Less

Submitted 7 March, 2017; originally announced March 2017.

MSC Class: 65F20; 65F25

Conditional quasi-exact solvability of the quantum planar pendulum and of its anti-isospectral hyperbolic counterpart

Authors: Simon Becker, Marjan Mirahmadi, Burkhard Schmidt, Konrad Schatz, Bretislav Friedrich

Abstract: We have subjected the planar pendulum eigenproblem to a symmetry analysis with the goal of explaining the relationship between its conditional quasi-exact solvability (C-QES) and the topology of its eigenenergy surfaces, established in our earlier work [Frontiers in Physical Chemistry and Chemical Physics 2, 1-16, (2014)]. The present analysis revealed that this relationship can be traced to the s… ▽ More We have subjected the planar pendulum eigenproblem to a symmetry analysis with the goal of explaining the relationship between its conditional quasi-exact solvability (C-QES) and the topology of its eigenenergy surfaces, established in our earlier work [Frontiers in Physical Chemistry and Chemical Physics 2, 1-16, (2014)]. The present analysis revealed that this relationship can be traced to the structure of the tridiagonal matrices representing the symmetry-adapted pendular Hamiltonian, as well as enabled us to identify many more -- forty in total to be exact -- analytic solutions. Furthermore, an analogous analysis of the hyperbolic counterpart of the planar pendulum, the Razavy problem, which was shown to be also C-QES [American Journal of Physics 48, 285 (1980)], confirmed that it is anti-isospectral with the pendular eigenproblem. Of key importance for both eigenproblems proved to be the topological index $κ$, as it determines the loci of the intersections (genuine and avoided) of the eigenenergy surfaces spanned by the dimensionless interaction parameters $η$ and $ζ$. It also encapsulates the conditions under which analytic solutions to the two eigenproblems obtain and provides the number of analytic solutions. At a given $κ$, the anti-isospectrality occurs for single states only (i.e., not for doublets), like C-QES holds solely for integer values of $κ$, and only occurs for the lowest eigenvalues of the pendular and Razavy Hamiltonians, with the order of the eigenvalues reversed for the latter. For all other states, the pendular and Razavy spectra become in fact qualitatively different, as higher pendular states appear as doublets whereas all higher Razavy states are singlets. △ Less

Submitted 27 March, 2017; v1 submitted 28 February, 2017; originally announced February 2017.

Adapting Regularized Low Rank Models for Parallel Architectures

Authors: Derek Driggs, Stephen Becker, Aleksandr Aravkin

Abstract: We introduce a reformulation of regularized low-rank recovery models to take advantage of GPU, multiple CPU, and hybridized architectures. Low-rank recovery often involves nuclear-norm minimization through iterative thresholding of singular values. These models are slow to fit and difficult to parallelize because of their dependence on computing a singular value decomposition at each iteration. Re… ▽ More We introduce a reformulation of regularized low-rank recovery models to take advantage of GPU, multiple CPU, and hybridized architectures. Low-rank recovery often involves nuclear-norm minimization through iterative thresholding of singular values. These models are slow to fit and difficult to parallelize because of their dependence on computing a singular value decomposition at each iteration. Regularized low-rank recovery models also incorporate non-smooth terms to separate structured components (e.g. sparse outliers) from the low-rank component, making these problems more difficult. Using Burer-Monteiro splitting and marginalization, we develop a smooth, non-convex formulation of regularized low-rank recovery models that can be fit with first-order solvers. We develop a computable certificate of convergence for this non-convex program, and use it to establish bounds on the suboptimality of any point. Using robust principal component analysis (RPCA) as an example, we include numerical experiments showing that this approach is an order-of-magnitude faster than existing RPCA solvers on the GPU. We also show that this acceleration allows new applications for RPCA, including real-time background subtraction and MR image analysis. △ Less

Submitted 4 October, 2017; v1 submitted 7 February, 2017; originally announced February 2017.

Comments: 23 pages, 14 figures, pre-print

MSC Class: 90-08

Randomized Clustered Nystrom for Large-Scale Kernel Machines

Authors: Farhad Pourkamali-Anaraki, Stephen Becker

Abstract: The Nystrom method has been popular for generating the low-rank approximation of kernel matrices that arise in many machine learning problems. The approximation quality of the Nystrom method depends crucially on the number of selected landmark points and the selection procedure. In this paper, we present a novel algorithm to compute the optimal Nystrom low-approximation when the number of landmark… ▽ More The Nystrom method has been popular for generating the low-rank approximation of kernel matrices that arise in many machine learning problems. The approximation quality of the Nystrom method depends crucially on the number of selected landmark points and the selection procedure. In this paper, we present a novel algorithm to compute the optimal Nystrom low-approximation when the number of landmark points exceed the target rank. Moreover, we introduce a randomized algorithm for generating landmark points that is scalable to large-scale data sets. The proposed method performs K-means clustering on low-dimensional random projections of a data set and, thus, leads to significant savings for high-dimensional data sets. Our theoretical results characterize the tradeoffs between the accuracy and efficiency of our proposed method. Extensive experiments demonstrate the competitive performance as well as the efficiency of our proposed method. △ Less

Submitted 19 December, 2016; originally announced December 2016.

Flow tracing as a tool set for the analysis of networked large-scale renewable electricity systems

Authors: Jonas Hörsch, Mirko Schäfer, Sarah Becker, Stefan Schramm, Martin Greiner

Abstract: The method of flow tracing follows the power flow from net-generating sources through the network to the net-consuming sinks, which allows to assign the usage of the underlying transmission infrastructure to the system participants. This article presents a reformulation that is applicable to arbitrary compositions of inflow appearing naturally in models of large-scale electricity systems with a hi… ▽ More The method of flow tracing follows the power flow from net-generating sources through the network to the net-consuming sinks, which allows to assign the usage of the underlying transmission infrastructure to the system participants. This article presents a reformulation that is applicable to arbitrary compositions of inflow appearing naturally in models of large-scale electricity systems with a high share of renewable power generation. We propose an application which allows to associate power flows on the grid to specific regions or generation technologies, and emphasizes the capability of this technique to disentangle the spatio-temporal patterns of physical imports and exports occurring in such systems. The analytical potential of this method is showcased for a scenario based on the IEEE 118 bus network. △ Less

Submitted 26 August, 2017; v1 submitted 9 September, 2016; originally announced September 2016.

Comments: 20 pages, 7 figures, 2 tables; version 2 includes revised introduction, methodology and conclusion sections

Journal ref: Int. J. Electr. Power Energy Syst. 96 (2018) 390-397

A Randomized Approach to Efficient Kernel Clustering

Authors: Farhad Pourkamali-Anaraki, Stephen Becker

Abstract: Kernel-based K-means clustering has gained popularity due to its simplicity and the power of its implicit non-linear representation of the data. A dominant concern is the memory requirement since memory scales as the square of the number of data points. We provide a new analysis of a class of approximate kernel methods that have more modest memory requirements, and propose a specific one-pass rand… ▽ More Kernel-based K-means clustering has gained popularity due to its simplicity and the power of its implicit non-linear representation of the data. A dominant concern is the memory requirement since memory scales as the square of the number of data points. We provide a new analysis of a class of approximate kernel methods that have more modest memory requirements, and propose a specific one-pass randomized kernel approximation followed by standard K-means on the transformed data. The analysis and experiments suggest the method is accurate, while requiring drastically less memory than standard kernel K-means and significantly less memory than Nystrom based approximations. △ Less

Submitted 2 December, 2016; v1 submitted 26 August, 2016; originally announced August 2016.

Comments: To appear in IEEE GlobalSIP 2016

Dual Smoothing and Level Set Techniques for Variational Matrix Decomposition

Authors: Aleksandr Y. Aravkin, Stephen Becker

Abstract: We focus on the robust principal component analysis (RPCA) problem, and review a range of old and new convex formulations for the problem and its variants. We then review dual smoothing and level set techniques in convex optimization, present several novel theoretical results, and apply the techniques on the RPCA problem. In the final sections, we show a range of numerical experiments for simulate… ▽ More We focus on the robust principal component analysis (RPCA) problem, and review a range of old and new convex formulations for the problem and its variants. We then review dual smoothing and level set techniques in convex optimization, present several novel theoretical results, and apply the techniques on the RPCA problem. In the final sections, we show a range of numerical experiments for simulated and real-world problems. △ Less

Submitted 1 March, 2016; originally announced March 2016.

Comments: 38 pages, 10 figures. arXiv admin note: text overlap with arXiv:1406.1089

MSC Class: 90C06; 81P50; 65K10; 62F35; 47N30

Strong convergence rates for nonlinearity-truncated Euler-type approximations of stochastic Ginzburg-Landau equations

Authors: Sebastian Becker, Arnulf Jentzen

Abstract: This article proposes and analyzes explicit and easily implementable temporal numerical approximation schemes for additive noise-driven stochastic partial differential equations (SPDEs) with polynomial nonlinearities such as, e.g., stochastic Ginzburg-Landau equations. We prove essentially sharp strong convergence rates for the considered approximation schemes. Our analysis is carried out for abst… ▽ More This article proposes and analyzes explicit and easily implementable temporal numerical approximation schemes for additive noise-driven stochastic partial differential equations (SPDEs) with polynomial nonlinearities such as, e.g., stochastic Ginzburg-Landau equations. We prove essentially sharp strong convergence rates for the considered approximation schemes. Our analysis is carried out for abstract stochastic evolution equations on separable Banach and Hilbert spaces including the above mentioned SPDEs as special cases. We also illustrate our strong convergence rate results by means of a numerical simulation in Matlab. △ Less

Submitted 21 January, 2016; originally announced January 2016.

Comments: 58 pages

MSC Class: 60H35; 65C30; 60H15

Journal ref: Stochastic Process. Appl. 129 (2019), no. 1, 28-69

Preconditioned Data Sparsification for Big Data with Applications to PCA and K-means

Authors: Farhad Pourkamali-Anaraki, Stephen Becker

Abstract: We analyze a compression scheme for large data sets that randomly keeps a small percentage of the components of each data sample. The benefit is that the output is a sparse matrix and therefore subsequent processing, such as PCA or K-means, is significantly faster, especially in a distributed-data setting. Furthermore, the sampling is single-pass and applicable to streaming data. The sampling mech… ▽ More We analyze a compression scheme for large data sets that randomly keeps a small percentage of the components of each data sample. The benefit is that the output is a sparse matrix and therefore subsequent processing, such as PCA or K-means, is significantly faster, especially in a distributed-data setting. Furthermore, the sampling is single-pass and applicable to streaming data. The sampling mechanism is a variant of previous methods proposed in the literature combined with a randomized preconditioning to smooth the data. We provide guarantees for PCA in terms of the covariance matrix, and guarantees for K-means in terms of the error in the center estimators at a given step. We present numerical evidence to show both that our bounds are nearly tight and that our algorithms provide a real benefit when applied to standard test data sets, as well as providing certain benefits over related sampling approaches. △ Less

Submitted 19 September, 2016; v1 submitted 31 October, 2015; originally announced November 2015.

Comments: 28 pages, 10 figures

Robust Partially-Compressed Least-Squares

Authors: Stephen Becker, Ban Kawas, Marek Petrik, Karthikeyan N. Ramamurthy

Abstract: Randomized matrix compression techniques, such as the Johnson-Lindenstrauss transform, have emerged as an effective and practical way for solving large-scale problems efficiently. With a focus on computational efficiency, however, forsaking solutions quality and accuracy becomes the trade-off. In this paper, we investigate compressed least-squares problems and propose new models and algorithms tha… ▽ More Randomized matrix compression techniques, such as the Johnson-Lindenstrauss transform, have emerged as an effective and practical way for solving large-scale problems efficiently. With a focus on computational efficiency, however, forsaking solutions quality and accuracy becomes the trade-off. In this paper, we investigate compressed least-squares problems and propose new models and algorithms that address the issue of error and noise introduced by compression. While maintaining computational efficiency, our models provide robust solutions that are more accurate--relative to solutions of uncompressed least-squares--than those of classical compressed variants. We introduce tools from robust optimization together with a form of partial compression to improve the error-time trade-offs of compressed least-squares solvers. We develop an efficient solution algorithm for our Robust Partially-Compressed (RPC) model based on a reduction to a one-dimensional search. We also derive the first approximation error bounds for Partially-Compressed least-squares solutions. Empirical results comparing numerous alternatives suggest that robust and partially compressed solutions are effectively insulated against aggressive randomized transforms. △ Less

Submitted 16 October, 2015; originally announced October 2015.

Contact angle of sessile drops in Lennard-Jones systems

Authors: Stefan Becker, Herbert M. Urbassek, Martin Horsch, Hans Hasse

Abstract: Molecular dynamics simulation is used for studying the contact angle of nanoscale sessile drops on a planar solid wall in a system interacting via the truncated and shifted Lennard-Jones potential. The entire range between total wetting and dewetting is investigated by varying the solid--fluid dispersive interaction energy. The temperature is varied between the triple point and the critical temper… ▽ More Molecular dynamics simulation is used for studying the contact angle of nanoscale sessile drops on a planar solid wall in a system interacting via the truncated and shifted Lennard-Jones potential. The entire range between total wetting and dewetting is investigated by varying the solid--fluid dispersive interaction energy. The temperature is varied between the triple point and the critical temperature. A correlation is obtained for the contact angle in dependence of the temperature and the dispersive interaction energy. Size effects are studied by varying the number of fluid particles at otherwise constant conditions, using up to 150 000 particles. For particle numbers below 10 000, a decrease of the contact angle is found. This is attributed to a dependence of the solid-liquid surface tension on the droplet size. A convergence to a constant contact angle is observed for larger system sizes. The influence of the wall model is studied by varying the density of the wall. The effective solid-fluid dispersive interaction energy at a contact angle of 90 degrees is found to be independent of temperature and to decrease linearly with the solid density. A correlation is developed which describes the contact angle as a function of the dispersive interaction, the temperature and the solid density. The density profile of the sessile drop and the surrounding vapor phase is described by a correlation combining a sigmoidal function and an oscillation term. △ Less

Submitted 25 July, 2015; originally announced July 2015.

Journal ref: Langmuir 30 (45): 13606-13614 (2014)

General Optimization Framework for Robust and Regularized 3D Full Waveform Inversion

Authors: Stephen Becker, Lior Horesh, Aleksandr Aravkin, Sergiy Zhuk

Abstract: Scarcity of hydrocarbon resources and high exploration risks motivate the development of high fidelity algorithms and computationally viable approaches to exploratory geophysics. Whereas early approaches considered least-squares minimization, recent developments have emphasized the importance of robust formulations, as well as formulations that allow disciplined encoding of prior information into… ▽ More Scarcity of hydrocarbon resources and high exploration risks motivate the development of high fidelity algorithms and computationally viable approaches to exploratory geophysics. Whereas early approaches considered least-squares minimization, recent developments have emphasized the importance of robust formulations, as well as formulations that allow disciplined encoding of prior information into the inverse problem formulation. The cost of a more flexible optimization framework is a greater computational complexity, as least-squares optimization can be performed using straightforward methods (e.g., steepest descent, Gauss-Newton, L-BFGS), whilst incorporation of robust (non-smooth) penalties requires custom changes that may be difficult to implement in the context of a general seismic inversion workflow. In this study, we propose a generic, flexible optimization framework capable of incorporating a broad range of noise models, forward models, regularizers, and reparametrization transforms. This framework covers seamlessly robust noise models (such as Huber and Student's $t$), as well as sparse regularizers, projected constraints, and Total Variation regularization. The proposed framework is also expandable --- we explain the adjustments that are required for any new formulation to be included. Lastly, we conclude with few numerical examples demonstrating the versatility of the formulation. △ Less

Submitted 17 April, 2015; originally announced April 2015.

Comments: submitted to the 77th European Association of Geoscientists and Engineers (EAGE) Conference & Exhibition, Madrid, Spain, 2015

ACM Class: G.1.8; G.1.6; G.3

Efficient Dictionary Learning via Very Sparse Random Projections

Authors: Farhad Pourkamali-Anaraki, Stephen Becker, Shannon M. Hughes

Abstract: Performing signal processing tasks on compressive measurements of data has received great attention in recent years. In this paper, we extend previous work on compressive dictionary learning by showing that more general random projections may be used, including sparse ones. More precisely, we examine compressive K-means clustering as a special case of compressive dictionary learning and give theor… ▽ More Performing signal processing tasks on compressive measurements of data has received great attention in recent years. In this paper, we extend previous work on compressive dictionary learning by showing that more general random projections may be used, including sparse ones. More precisely, we examine compressive K-means clustering as a special case of compressive dictionary learning and give theoretical guarantees for its performance for a very general class of random projections. We then propose a memory and computation efficient dictionary learning algorithm, specifically designed for analyzing large volumes of high-dimensional data, which learns the dictionary from very sparse random projections. Experimental results demonstrate that our approach allows for reduction of computational complexity and memory/data access, with controllable loss in accuracy. △ Less

Submitted 5 April, 2015; originally announced April 2015.

Comments: 5 pages, 2 figures, accepted in Sampling Theory and Applications (SampTA) 2015

Renewable build-up pathways for the US: Generation costs are not system costs

Authors: Sarah Becker, Bethany A. Frew, Gorm B. Andresen, Mark Z. Jacobson, Stefan Schramm, Martin Greiner

Abstract: The transition to a future electricity system based primarily on wind and solar PV is examined for all regions in the contiguous US. We present optimized pathways for the build-up of wind and solar power for least backup energy needs as well as for least cost obtained with a simplified, lightweight model based on long-term high resolution weather-determined generation data. In the absence of stora… ▽ More The transition to a future electricity system based primarily on wind and solar PV is examined for all regions in the contiguous US. We present optimized pathways for the build-up of wind and solar power for least backup energy needs as well as for least cost obtained with a simplified, lightweight model based on long-term high resolution weather-determined generation data. In the absence of storage, the pathway which achieves the best match of generation and load, thus resulting in the least backup energy requirements, generally favors a combination of both technologies, with a wind/solar PV energy mix of about 80/20 in a fully renewable scenario. The least cost development is seen to start with 100% of the technology with the lowest average generation costs first, but with increasing renewable installations, economically unfavorable excess generation pushes it toward the minimal backup pathway. Surplus generation and the entailed costs can be reduced significantly by combining wind and solar power, and/or absorbing excess generation, for example with storage or transmission, or by coupling the electricity system to other energy sectors. △ Less

Submitted 16 December, 2014; originally announced December 2014.

Comments: 11 pages, 6 figures

Journal ref: Energy 81, p. 437-445 (Mar 2015)

Convex Optimization for Big Data

Authors: Volkan Cevher, Stephen Becker, Mark Schmidt

Abstract: This article reviews recent advances in convex optimization algorithms for Big Data, which aim to reduce the computational, storage, and communications bottlenecks. We provide an overview of this emerging field, describe contemporary approximation techniques like first-order methods and randomization for scalability, and survey the important role of parallel and distributed computation. The new Bi… ▽ More This article reviews recent advances in convex optimization algorithms for Big Data, which aim to reduce the computational, storage, and communications bottlenecks. We provide an overview of this emerging field, describe contemporary approximation techniques like first-order methods and randomization for scalability, and survey the important role of parallel and distributed computation. The new Big Data algorithms are based on surprisingly simple principles and attain staggering accelerations even on classical problems. △ Less

Submitted 4 November, 2014; originally announced November 2014.

Comments: 23 pages, 4 figurs, 8 algorithms

Journal ref: IEEE Signal Processing Magazine, Vol. 31(5), pages 32--43, 2014

ls1 mardyn: The massively parallel molecular dynamics code for large systems

Authors: Christoph Niethammer, Stefan Becker, Martin Bernreuther, Martin Buchholz, Wolfgang Eckhardt, Alexander Heinecke, Stephan Werth, Hans-Joachim Bungartz, Colin W. Glass, Hans Hasse, Jadran Vrabec, Martin Horsch

Abstract: The molecular dynamics simulation code ls1 mardyn is presented. It is a highly scalable code, optimized for massively parallel execution on supercomputing architectures, and currently holds the world record for the largest molecular simulation with over four trillion particles. It enables the application of pair potentials to length and time scales which were previously out of scope for molecular… ▽ More The molecular dynamics simulation code ls1 mardyn is presented. It is a highly scalable code, optimized for massively parallel execution on supercomputing architectures, and currently holds the world record for the largest molecular simulation with over four trillion particles. It enables the application of pair potentials to length and time scales which were previously out of scope for molecular dynamics simulation. With an efficient dynamic load balancing scheme, it delivers high scalability even for challenging heterogeneous configurations. Presently, multi-center rigid potential models based on Lennard-Jones sites, point charges and higher-order polarities are supported. Due to its modular design, ls1 mardyn can be extended to new physical models, methods, and algorithms, allowing future users to tailor it to suit their respective needs. Possible applications include scenarios with complex geometries, e.g. for fluids at interfaces, as well as non-equilibrium molecular dynamics simulation of heat and mass transfer. △ Less

Submitted 20 August, 2014; originally announced August 2014.

A variational approach to stable principal component pursuit

Authors: Aleksandr Aravkin, Stephen Becker, Volkan Cevher, Peder Olsen

Abstract: We introduce a new convex formulation for stable principal component pursuit (SPCP) to decompose noisy signals into low-rank and sparse representations. For numerical solutions of our SPCP formulation, we first develop a convex variational framework and then accelerate it with quasi-Newton methods. We show, via synthetic and real data experiments, that our approach offers advantages over the class… ▽ More We introduce a new convex formulation for stable principal component pursuit (SPCP) to decompose noisy signals into low-rank and sparse representations. For numerical solutions of our SPCP formulation, we first develop a convex variational framework and then accelerate it with quasi-Newton methods. We show, via synthetic and real data experiments, that our approach offers advantages over the classical SPCP formulations in scalability and practical parameter selection. △ Less

Submitted 4 June, 2014; originally announced June 2014.

Comments: 10 pages, 5 figures

MSC Class: 90C06; 81P50; 65K10; 62F35; 47N30

Features of a fully renewable US electricity system: Optimized mixes of wind and solar PV and transmission grid extensions

Authors: Sarah Becker, Bethany A. Frew, Gorm B. Andresen, Timo Zeyer, Stefan Schramm, Martin Greiner, Mark Z. Jacobson

Abstract: Wind and solar PV generation data for the entire contiguous US are calculated, on the basis of 32 years of weather data with temporal resolution of one hour and spatial resolution of 40x40km$^2$, assuming site-suitability-based as well as stochastic wind and solar PV capacity distributions throughout the country. These data are used to investigate a fully renewable electricity system, resting prim… ▽ More Wind and solar PV generation data for the entire contiguous US are calculated, on the basis of 32 years of weather data with temporal resolution of one hour and spatial resolution of 40x40km$^2$, assuming site-suitability-based as well as stochastic wind and solar PV capacity distributions throughout the country. These data are used to investigate a fully renewable electricity system, resting primarily upon wind and solar PV power. We find that the seasonal optimal mix of wind and solar PV comes at around 80% solar PV share, owing to the US summer load peak. By picking this mix, long-term storage requirements can be more than halved compared to a wind only mix. The daily optimal mix lies at about 80% wind share due to the nightly gap in solar PV production. Picking this mix instead of solar only reduces backup energy needs by about 50%. Furthermore, we calculate shifts in FERC (Federal Energy Regulatory Commission)-level LCOE (Levelized Costs Of Electricity) for wind and solar PV due to their differing resource quality and fluctuation patterns. LCOE vary by up to 35% due to regional conditions, and LCOE-optimal mixes turn out to largely follow resource quality. A transmission network enhancement among FERC regions is constructed to transfer high penetrations of solar and wind across FERC boundaries, based on a novel least-cost optimization approach. △ Less

Submitted 12 February, 2014; originally announced February 2014.

Comments: 19 pages, 18 figures

Journal ref: Energy 72, 443-458 (Aug 2014)

What can transmission do for a fully renewable Europe?

Authors: Sarah Becker, Rolando A. Rodriguez, Gorm B. Andresen, Martin O. W. Greiner, Stefan Schramm

Abstract: Our research is centred around the question how to best integrate the variable renewable energy sources (VRES), wind power and solar photovoltaics, into the European electricity grid. The future electricity supply will be based to a large extend on these fluctuating resources. We have conducted a study, extrapolating national historical and targeted wind and solar power penetrations in Europe up t… ▽ More Our research is centred around the question how to best integrate the variable renewable energy sources (VRES), wind power and solar photovoltaics, into the European electricity grid. The future electricity supply will be based to a large extend on these fluctuating resources. We have conducted a study, extrapolating national historical and targeted wind and solar power penetrations in Europe up to 100% VRES (R.A. Rodriguez et al, Renewable Energy 63, p. 467, Mar 2014 and S. Becker et al, Energy 64, p. 404, Jan 2014). A high share of VRES means large fluctuations in the generation, causing overproduction and deficits. One way to reduce such mismatches is power transmission spatially smoothing out the fluctuations. This has the potential to reduce the remaining shortages by sharing the surplus production of others. We find that shortages can at maximum be reduced by 40% in the hypothetical case of unlimited transmission capacities across all of Europe. A more realistic extension of the transmission grid, roughly quadrupling today's installation, turns out to be sufficient to harvest 90% of this potential benefit. Finally, the import and export of single countries is investigated. We conclude that a country's load size as well as its position in the network are the determining factors for its import/export opportunities. △ Less

Submitted 17 January, 2014; originally announced January 2014.

Comments: Proceedings of the 8th SDEWES conference, Sep 2013, Dubrovnik

The Propagation-Separation Approach: Consequences of model misspecification

Authors: Saskia Becker

Abstract: The article presents new results on the Propagation-Separation Approach by Polzehl and Spokoiny [2006]. This iterative procedure provides a unified approach for nonparametric estimation, sup- posing a local parametric model. The adaptivity of the estimator ensures sensitivity to structural changes. Originally, an additional memory step was included into the algorithm, where most of the theoretical… ▽ More The article presents new results on the Propagation-Separation Approach by Polzehl and Spokoiny [2006]. This iterative procedure provides a unified approach for nonparametric estimation, sup- posing a local parametric model. The adaptivity of the estimator ensures sensitivity to structural changes. Originally, an additional memory step was included into the algorithm, where most of the theoretical prop- erties were based on. However, in practice, a simplified version of the algorithm is used, where the mem- ory step is omitted. Hence, we aim to justify this simplified procedure by means of a theoretical study and numerical simulations. In our previous study [Becker and Mathé, 2013], we analyzed the simplified Propagation-Separation Approach, supposing piecewise constant parameter functions with sharp discon- tinuities. Here, we consider the case of a misspecified model. △ Less

Submitted 30 November, 2013; originally announced December 2013.

Comments: 31 pages, 8 figures

Report number: WIAS Preprint 1877 MSC Class: 62G05

An exponential Wagner-Platen type scheme for SPDEs

Authors: Sebastian Becker, Arnulf Jentzen, Peter E. Kloeden

Abstract: The strong numerical approximation of semilinear stochastic partial differential equations (SPDEs) driven by infinite dimensional Wiener processes is investigated. There are a number of results in the literature that show that Euler-type approximation methods converge strongly, under suitable assumptions, to the exact solutions of such SPDEs with strong order 1/2 or at least with strong order 1/2… ▽ More The strong numerical approximation of semilinear stochastic partial differential equations (SPDEs) driven by infinite dimensional Wiener processes is investigated. There are a number of results in the literature that show that Euler-type approximation methods converge strongly, under suitable assumptions, to the exact solutions of such SPDEs with strong order 1/2 or at least with strong order 1/2 - epsilon where epsilon > 0 is arbitrarily small. Recent results extend these results and show that Milstein-type approximation methods converge, under suitable assumptions, to the exact solutions of such SPDEs with strong order 1 - epsilon. It has also been shown that splitting-up approximation methods converge, under suitable assumptions, with strong order 1 to the exact solutions of such SPDEs. In this article an exponential Wagner-Platen type numerical approximation method for such SPDEs is proposed and shown to converge, under suitable assumptions, with strong order 3/2 - epsilon to the exact solutions of such SPDEs. △ Less

Submitted 18 September, 2013; originally announced September 2013.

MSC Class: 65C30; 60H35; 60H15; 35R60

Journal ref: SIAM J. Numer. Anal. 54 (2016), no. 4, 2389-2426

Wave front adaptation using a deformable mirror for adiabatic nanofocusing along an ultrasharp gold taper

Authors: Slawa Schmidt, Pascal Engelke, Bjoern Piglosiewicz, Martin Esmann, Simon F. Becker, Kyungwan Yoo, Namkyoo Park, Christoph Lienau, Petra Gross

Abstract: We describe and demonstrate the use of an adaptive wave front optimization scheme for enhancing the efficiency of adiabatic nanofocusing of surface plasmon polariton (SPP) waves along an ultrasharp conical gold taper. Adiabatic nanofocusing is an emerging and promising scheme for controlled focusing of far field light into nanometric volumes. It comprises three essential steps: SPP excitation by c… ▽ More We describe and demonstrate the use of an adaptive wave front optimization scheme for enhancing the efficiency of adiabatic nanofocusing of surface plasmon polariton (SPP) waves along an ultrasharp conical gold taper. Adiabatic nanofocusing is an emerging and promising scheme for controlled focusing of far field light into nanometric volumes. It comprises three essential steps: SPP excitation by coupling far field light to an SPP waveguide, SPP propagation along the waveguide and adiabatic SPP nanofocusing towards a geometric singularity. For commonly used complex waveguide geometries, such as, e.g., conical metal tapers, a realistic modeling and efficiency optimization is challenging. Here, we use a deformable mirror to adaptively control the wave front of the incident far field light. We demonstrate an eight-fold enhancement in nanofocusing efficiency and analyze the shape of the resulting optimized wave front. The introduced wave front optimization scheme is of general interest for guiding and controlling light on the nanoscale. △ Less

Submitted 3 September, 2013; originally announced September 2013.

Transmission grid extensions during the build-up of a fully renewable pan-European electricity supply

Authors: Sarah Becker, Rolando A. Rodriguez, Gorm B. Andresen, Stefan Schramm, Martin Greiner

Abstract: Spatio-temporal generation patterns for wind and solar photovoltaic power in Europe are used to investigate the future rise in transmission needs with an increasing penetration of these variable renewable energy sources (VRES) on the pan-European electricity system. VRES growth predictions according to the official National Renewable Energy Action Plans of the EU countries are used and extrapolate… ▽ More Spatio-temporal generation patterns for wind and solar photovoltaic power in Europe are used to investigate the future rise in transmission needs with an increasing penetration of these variable renewable energy sources (VRES) on the pan-European electricity system. VRES growth predictions according to the official National Renewable Energy Action Plans of the EU countries are used and extrapolated logistically up to a fully VRES-supplied power system. We find that kee** today's international net transfer capacities (NTCs) fixed over the next forty years reduces the final need for backup energy by 13% when compared to the situation with no NTCs. An overall doubling of today's NTCs will lead to a 26% reduction, and an overall quadrupling to a 33% reduction. The remaining need for backup energy is due to correlations in the generation patterns, and cannot be further reduced by transmission. The main investments in transmission lines are due during the ramp-up of VRES from 15% (as planned for 2020) to 80%. Additionally, our results show how the optimal mix between wind and solar energy shifts from about 70% to 80% wind share as the transmission grid is enhanced. Finally, we exemplify how reinforced transmission affects the import and export opportunities of single countries during the VRES ramp-up. △ Less

Submitted 5 July, 2013; originally announced July 2013.

Journal ref: Energy 64 404 (Jan 2014)

Transmission needs across a fully renewable European power system

Authors: Rolando A. Rodriguez, Sarah Becker, Gorm B. Andresen, Dominik Heide, Martin Greiner

Abstract: The residual load and excess power generation of 27 European countries with a 100% penetration of variable renewable energy sources are explored in order to quantify the benefit of power transmission between countries. Estimates are based on extensive weather data, which allows for modelling of hourly mismatches between the demand and renewable generation from wind and solar photovoltaics. For sep… ▽ More The residual load and excess power generation of 27 European countries with a 100% penetration of variable renewable energy sources are explored in order to quantify the benefit of power transmission between countries. Estimates are based on extensive weather data, which allows for modelling of hourly mismatches between the demand and renewable generation from wind and solar photovoltaics. For separated countries, balancing is required to cover around 24% of the total annual energy consumption. This number can be reduced down to 15% once all countries are networked together with uncon- strained interconnectors. The reduction represents the maximum possible benefit of transmission for the countries. The total Net Transfer Capacity of the unconstrained interconnectors is roughly twelve times larger than current values. However, constrained interconnector capacities six times larger than the current values are found to provide 97% of the maximum possible benefit of cooperation. This motivates a detailed investigation of several constrained transmission capacity layouts to determine the export and import capabilities of countries participating in a fully renewable European electricity system. △ Less

Submitted 5 June, 2013; originally announced June 2013.

Journal ref: Renewable Energy 63, 467 (Mar 2014)

An Algorithm for Splitting Parallel Sums of Linearly Composed Monotone Operators, with Applications to Signal Recovery

Authors: Stephen Becker, Patrick L. Combettes

Abstract: We present a new primal-dual splitting algorithm for structured monotone inclusions in Hilbert spaces and analyze its asymptotic behavior. A novelty of our framework, which is motivated by image recovery applications, is to consider inclusions that combine a variety of monotonicity-preserving operations such as sums, linear compositions, parallel sums, and a new notion of parallel composition. The… ▽ More We present a new primal-dual splitting algorithm for structured monotone inclusions in Hilbert spaces and analyze its asymptotic behavior. A novelty of our framework, which is motivated by image recovery applications, is to consider inclusions that combine a variety of monotonicity-preserving operations such as sums, linear compositions, parallel sums, and a new notion of parallel composition. The special case of minimization problems is studied in detail, and applications to signal recovery are discussed. Numerical simulations are provided to illustrate the implementation of the algorithm. △ Less

Submitted 24 May, 2013; originally announced May 2013.

MSC Class: Primary 47H05; Secondary 65K05; 90C25

Journal ref: Journal of Nonlinear and Convex Analysis, vol. 15, no. 1, pp. 137--159, Jan. 2014

Molecular modelling and simulation of electrolyte solutions, biomolecules, and wetting of component surfaces

Authors: Martin Horsch, Stefan Becker, Juan Manuel Castillo, Stephan Deublein, Agnes Fröscher, Steffen Reiser, Stephan Werth, Jadran Vrabec, Hans Hasse

Abstract: Massively-parallel molecular dynamics simulation is applied to systems containing electrolytes, vapour-liquid interfaces, and biomolecules in contact with water-oil interfaces. Novel molecular models of alkali halide salts are presented and employed for the simulation of electrolytes in aqueous solution. The enzymatically catalysed hydroxylation of oleic acid is investigated by molecular dynamics… ▽ More Massively-parallel molecular dynamics simulation is applied to systems containing electrolytes, vapour-liquid interfaces, and biomolecules in contact with water-oil interfaces. Novel molecular models of alkali halide salts are presented and employed for the simulation of electrolytes in aqueous solution. The enzymatically catalysed hydroxylation of oleic acid is investigated by molecular dynamics simulation taking the internal degrees of freedom of the macromolecules into account. Thereby, Ewald summation methods are used to compute the long range electrostatic interactions. In systems with a phase boundary, the dispersive interaction, which is modelled by the Lennard-Jones potential here, has a more significant long range contribution than in homogeneous systems. This effect is accounted for by implementing the Janecek cutoff correction scheme. On this basis, the HPC infrastructure at the Steinbuch Centre for Computing was accessed and efficiently used, yielding new insights on the molecular systems under consideration. △ Less

Submitted 17 May, 2013; originally announced May 2013.

k-space Imaging of the Eigenmodes of Sharp Gold Tapers for Scanning Near-Field Optical Microscopy

Authors: Martin Esmann, Simon F. Becker, Bernard B. da Cunha, Jens H. Brauer, Ralf Vogelgesang, Petra Gross, Christoph Lienau

Abstract: We investigate the radiation patterns of sharp conical gold tapers, designed as adiabatic nanofocusing probes for scanning near-field optical microscopy (SNOM). Field calculations show that only the lowest order eigenmode of such a taper can reach the very apex and thus induce the generation of strongly enhanced near-field signals. Higher order modes are coupled into the far field at finite distan… ▽ More We investigate the radiation patterns of sharp conical gold tapers, designed as adiabatic nanofocusing probes for scanning near-field optical microscopy (SNOM). Field calculations show that only the lowest order eigenmode of such a taper can reach the very apex and thus induce the generation of strongly enhanced near-field signals. Higher order modes are coupled into the far field at finite distances from the apex. Here, we demonstrate experimentally how to distinguish and separate between the lowest and higher order eigenmodes of such a metallic taper by filtering in the spatial frequency domain. Our approach has the potential to considerably improve the signal-to-background ratio in spectroscopic experiments on the nanoscale. △ Less

Submitted 27 September, 2013; v1 submitted 22 April, 2013; originally announced April 2013.

Optimization of FASTEST-3D for Modern Multicore Systems

Authors: Christoph Scheit, Georg Hager, Jan Treibig, Stefan Becker, Gerhard Wellein

Abstract: FASTEST-3D is an MPI-parallel finite-volume flow solver based on block-structured meshes that has been developed at the University of Erlangen-Nuremberg since the early 1990s. It can be used to solve the laminar or turbulent incompressible Navier-Stokes equations. Up to now its scalability was strongly limited by a rather rigid communication infrastructure, which led to a dominance of MPI time alr… ▽ More FASTEST-3D is an MPI-parallel finite-volume flow solver based on block-structured meshes that has been developed at the University of Erlangen-Nuremberg since the early 1990s. It can be used to solve the laminar or turbulent incompressible Navier-Stokes equations. Up to now its scalability was strongly limited by a rather rigid communication infrastructure, which led to a dominance of MPI time already at small process counts. This paper describes several optimizations to increase the performance, scalability, and flexibility of FASTEST-3D. First, a node-level performance analysis is carried out in order to pinpoint the main bottlenecks and identify sweet spots for energy-efficient execution. In addition, a single-precision version of the solver for the linear equation system arising from the discretization of the governing equations is devised, which significantly increases the single-core performance. Then the communication mechanisms in FASTEST-3D are analyzed and a new communication strategy based on non-blocking calls is implemented. Performance results with the revised version show significantly increased single-node performance and considerably improved communication patterns along with much better parallel scalability. In this context we discuss the concept of "acceptable parallel efficiency" and how it influences the real gain of the optimizations. Scaling measurements are carried out on a modern petascale system. The obtained improvements are of major importance for the use of FASTEST-3D on current high-performance computer clusters and will help to perform simulations with much higher spatial and temporal resolution to tackle turbulent flow in technical applications. △ Less

Submitted 19 March, 2013; originally announced March 2013.

Comments: 10 pages, 15 figures

Randomized Low-Memory Singular Value Projection

Authors: Stephen Becker, Volkan Cevher, Anastasios Kyrillidis

Abstract: Affine rank minimization algorithms typically rely on calculating the gradient of a data error followed by a singular value decomposition at every iteration. Because these two steps are expensive, heuristic approximations are often used to reduce computational burden. To this end, we propose a recovery scheme that merges the two steps with randomized approximations, and as a result, operates on sp… ▽ More Affine rank minimization algorithms typically rely on calculating the gradient of a data error followed by a singular value decomposition at every iteration. Because these two steps are expensive, heuristic approximations are often used to reduce computational burden. To this end, we propose a recovery scheme that merges the two steps with randomized approximations, and as a result, operates on space proportional to the degrees of freedom in the problem. We theoretically establish the estimation guarantees of the algorithm as a function of approximation tolerance. While the theoretical approximation requirements are overly pessimistic, we demonstrate that in practice the algorithm performs well on the quantum tomography recovery problem. △ Less

Submitted 1 June, 2013; v1 submitted 1 March, 2013; originally announced March 2013.

Comments: 13 pages. This version has a revised theorem and new numerical experiments

MSC Class: 90C06; 81P50

A new perspective on the Propagation-Separation approach: Taking advantage of the propagation condition

Authors: Saskia Becker, Peter Mathé

Abstract: The Propagation-Separation approach is an iterative procedure for pointwise estimation of local constant and local polynomial functions. The estimator is defined as a weighted mean of the observations with data-driven weights. Within homogeneous regions it ensures a similar behavior as non-adaptive smoothing (propagation), while avoiding smoothing among distinct regions (separation). In order to e… ▽ More The Propagation-Separation approach is an iterative procedure for pointwise estimation of local constant and local polynomial functions. The estimator is defined as a weighted mean of the observations with data-driven weights. Within homogeneous regions it ensures a similar behavior as non-adaptive smoothing (propagation), while avoiding smoothing among distinct regions (separation). In order to enable a proof of stability of estimates, the authors of the original study introduced an additional memory step aggregating the estimators of the successive iteration steps. Here, we study theoretical properties of the simplified algorithm, where the memory step is omitted. In particular, we introduce a new strategy for the choice of the adaptation parameter yielding propagation and stability for local constant functions with sharp discontinuities. △ Less

Submitted 5 February, 2013; originally announced February 2013.

Comments: 28 pages, 5 figures

MSC Class: 62G05

Direct numerical integration for multi-loop integrals

Authors: Sebastian Becker, Stefan Weinzierl

Abstract: We present a method to construct a suitable contour deformation in loop momentum space for multi-loop integrals. This contour deformation can be used to perform the integration for multi-loop integrals numerically. The integration can be performed directly in loop momentum space without the introduction of Feynman or Schwinger parameters. The method can be applied to finite multi-loop integrals an… ▽ More We present a method to construct a suitable contour deformation in loop momentum space for multi-loop integrals. This contour deformation can be used to perform the integration for multi-loop integrals numerically. The integration can be performed directly in loop momentum space without the introduction of Feynman or Schwinger parameters. The method can be applied to finite multi-loop integrals and to divergent multi-loop integrals with suitable subtraction terms. The algorithm extends techniques from the one-loop case to the multi-loop case. Examples at two and three loops are discussed explicitly. △ Less

Submitted 18 March, 2013; v1 submitted 2 November, 2012; originally announced November 2012.

Comments: 20 pages, v2: version to be published, v3: acknowledgement added

Numerical evaluation of NLO multiparton processes

Authors: S. Becker, D. Goetz, C. Reuschle, C. Schwan, S. Weinzierl

Abstract: We discuss an algorithm for the numerical evaluation of NLO multiparton processes. We focus hereby on the virtual part of the NLO calculation, i.e. on evaluating the one-loop integration numerically. We employ and extend the ideas of the subtraction method to the virtual part and we use subtraction terms for the soft, collinear and ultraviolet regions, which allows us to evaluate the loop integral… ▽ More We discuss an algorithm for the numerical evaluation of NLO multiparton processes. We focus hereby on the virtual part of the NLO calculation, i.e. on evaluating the one-loop integration numerically. We employ and extend the ideas of the subtraction method to the virtual part and we use subtraction terms for the soft, collinear and ultraviolet regions, which allows us to evaluate the loop integral numerically in four dimensions. A second ingredient is a method to deform the integration contour of the loop integration into the complex plane. The algorithm is derived on the level of the primitive amplitudes, where we utilise recursive relations to generate the corresponding one-loop off-shell currents. We discuss the numerical behavior of the approach and the application to the leading colour contribution in e+ e- --> n jets, with n up to seven. △ Less

Submitted 13 September, 2012; originally announced September 2012.

Comments: 10 pages, talk given at Loops and Legs 2012

Direct contour deformation with arbitrary masses in the loop

Authors: Sebastian Becker, Stefan Weinzierl

Abstract: We present a method, which constructs a suitable deformation vector in loop momentum space, when the loop integration is done numerically with the help of the subtraction method. The method presented here extends previously discussed techniques from the massless case to the general case of arbitrary masses in the loop. We present a method, which constructs a suitable deformation vector in loop momentum space, when the loop integration is done numerically with the help of the subtraction method. The method presented here extends previously discussed techniques from the massless case to the general case of arbitrary masses in the loop. △ Less

Submitted 17 September, 2012; v1 submitted 20 August, 2012; originally announced August 2012.

Comments: 18 pages, version to be published

Sparse projections onto the simplex

Authors: Anastasios Kyrillidis, Stephen Becker, Volkan Cevher and, Christoph Koch

Abstract: Most learning methods with rank or sparsity constraints use convex relaxations, which lead to optimization with the nuclear norm or the $\ell_1$-norm. However, several important learning applications cannot benefit from this approach as they feature these convex norms as constraints in addition to the non-convex rank and sparsity constraints. In this setting, we derive efficient sparse projections… ▽ More Most learning methods with rank or sparsity constraints use convex relaxations, which lead to optimization with the nuclear norm or the $\ell_1$-norm. However, several important learning applications cannot benefit from this approach as they feature these convex norms as constraints in addition to the non-convex rank and sparsity constraints. In this setting, we derive efficient sparse projections onto the simplex and its extension, and illustrate how to use them to solve high-dimensional learning problems in quantum tomography, sparse density estimation and portfolio selection with non-convex constraints. △ Less

Submitted 10 April, 2013; v1 submitted 7 June, 2012; originally announced June 2012.

Comments: 9 Pages

A quasi-Newton proximal splitting method

Authors: Stephen Becker, M. Jalal Fadili

Abstract: A new result in convex analysis on the calculation of proximity operators in certain scaled norms is derived. We describe efficient implementations of the proximity calculation for a useful class of functions; the implementations exploit the piece-wise linear nature of the dual problem. The second part of the paper applies the previous result to acceleration of convex minimization problems, and le… ▽ More A new result in convex analysis on the calculation of proximity operators in certain scaled norms is derived. We describe efficient implementations of the proximity calculation for a useful class of functions; the implementations exploit the piece-wise linear nature of the dual problem. The second part of the paper applies the previous result to acceleration of convex minimization problems, and leads to an elegant quasi-Newton method. The optimization method compares favorably against state-of-the-art alternatives. The algorithm has extensive applications including signal processing, sparse recovery and machine learning and classification. △ Less

Submitted 20 June, 2012; v1 submitted 6 June, 2012; originally announced June 2012.

MSC Class: 90C53; 90C06; 90C25; 90C30; 62J07; 47H05

Journal ref: NIPS (2012), pp. 2627--2635

Efficiency improvements for the numerical computation of NLO corrections

Authors: Sebastian Becker, Christian Reuschle, Stefan Weinzierl

Abstract: In this paper we discuss techniques, which lead to a significant improvement of the efficiency of the Monte Carlo integration, when one-loop QCD amplitudes are calculated numerically with the help of the subtraction method and contour deformation. The techniques discussed are: holomorphic and non-holomorphic division into sub-channels, optimisation of the integration contour, improvement of the ul… ▽ More In this paper we discuss techniques, which lead to a significant improvement of the efficiency of the Monte Carlo integration, when one-loop QCD amplitudes are calculated numerically with the help of the subtraction method and contour deformation. The techniques discussed are: holomorphic and non-holomorphic division into sub-channels, optimisation of the integration contour, improvement of the ultraviolet subtraction terms, importance sampling and antithetic variates in loop momentum space, recurrence relations. △ Less

Submitted 25 June, 2012; v1 submitted 9 May, 2012; originally announced May 2012.

Comments: 34 pages, version to be published

Spin properties of 2D semiconductors probed by scanning tunneling microscopy

Authors: M. Morgenstern, A. Georgi, C. Straßer, C. R. Ast, S. Becker, M. Liebmann

Abstract: The interrelation between spin and charge in semiconductors leads to interesting effects, e.g., the Rashba-type spin-orbit splitting or the exchange enhancement. These properties are proposed to be used in applications such as spin transistors or spin qubits. Probing them on the local scale with the ultimate spatial resolution of the scanning tunneling microscope addresses their susceptibility to… ▽ More The interrelation between spin and charge in semiconductors leads to interesting effects, e.g., the Rashba-type spin-orbit splitting or the exchange enhancement. These properties are proposed to be used in applications such as spin transistors or spin qubits. Probing them on the local scale with the ultimate spatial resolution of the scanning tunneling microscope addresses their susceptibility to disorder directly. Here we review the results obtained on two-dimensional semiconductor systems (2DES). We describe the preparation and characterization of an adequate 2DES which can be probed by scanning tunneling microscopy. It is shown how the electron density and the disorder within the 2DES can be tuned and measured. The observed local density of states of weakly and strongly disordered systems is discussed in detail. It is shown that the weakly disordered 2DES exhibits quantum Hall effect in magnetic field. The corresponding local density of states across a quantum Hall transition is mapped showing the development from localized states to extended states and back to localized states in real space. Decoupling the 2DES from screening electrons of the bulk of the III-V semiconductor leads to a measurable exchange enhancement of up to 0.7 meV which depends on the local spin polarization of the 2DES. At stronger confinement potential, i.e. larger do**, the Rashba spin splitting with $α$ as large as $7\cdot 10^{-11}$eVm is observed as a beating in the density of states in magnetic field. The Rashba spin splitting varies with position by about $\pm 50$% being largest at potential hills. △ Less

Submitted 17 April, 2012; originally announced April 2012.

Comments: Review article, 25 pages

Multiparton NLO corrections by numerical methods

Authors: S. Becker, D. Goetz, C. Reuschle, C. Schwan, S. Weinzierl

Abstract: In this talk we discuss an algorithm for the numerical calculation of one-loop QCD amplitudes and present results at next-to-leading order for jet observables in electron-positron annihilation calculated with the above-mentioned method. The algorithm consists of subtraction terms, approximating the soft, collinear and ultraviolet divergences of QCD one-loop amplitudes, as well as a method to defor… ▽ More In this talk we discuss an algorithm for the numerical calculation of one-loop QCD amplitudes and present results at next-to-leading order for jet observables in electron-positron annihilation calculated with the above-mentioned method. The algorithm consists of subtraction terms, approximating the soft, collinear and ultraviolet divergences of QCD one-loop amplitudes, as well as a method to deform the integration contour for the loop integration into the complex plane to match Feynman's i delta rule. The algorithm is formulated at the amplitude level and does not rely on Feynman graphs. Therefore all ingredients of the algorithm can be calculated efficiently using recurrence relations. The application of this method to the leading-colour contribution of e+ e- --> n jets, with n up to seven, demonstrates the efficiency of the approach. △ Less

Submitted 15 December, 2011; originally announced December 2011.

Comments: 8 pages, talk given at Radcor2011

NLO results for five, six and seven jets in electron-positron annihilation

Authors: Sebastian Becker, Daniel Goetz, Christian Reuschle, Christopher Schwan, Stefan Weinzierl

Abstract: We present next-to-leading order corrections in the leading colour approximation for jet rates in electron-positron annihilation up to seven jets. The results for the two-, three-, and four-jet rates agree with known results. The NLO jet rates have been known previously only up to five jets. The results for the six- and seven-jet rate are new. The results are obtained by a new and efficient method… ▽ More We present next-to-leading order corrections in the leading colour approximation for jet rates in electron-positron annihilation up to seven jets. The results for the two-, three-, and four-jet rates agree with known results. The NLO jet rates have been known previously only up to five jets. The results for the six- and seven-jet rate are new. The results are obtained by a new and efficient method based on subtraction and numerical integration. △ Less

Submitted 7 November, 2011; originally announced November 2011.

Comments: 5 pages

Dynamical Behavior Near a Liquid-Liquid Phase Transition in Simulations of Supercooled Water

Authors: Peter H. Poole, Stephen R. Becker, Francesco Sciortino, Francis W. Starr

Abstract: We examine the behavior of the diffusion coefficient of the ST2 model of water over a broad region of the phase diagram via molecular dynamics simulations. The ST2 model has an accessible liquid-liquid transition between low-density and high-density phases, making the model an ideal candidate to explore the impacts of the liquid-liquid transition on dynamics. We locate characteristic dynamical loc… ▽ More We examine the behavior of the diffusion coefficient of the ST2 model of water over a broad region of the phase diagram via molecular dynamics simulations. The ST2 model has an accessible liquid-liquid transition between low-density and high-density phases, making the model an ideal candidate to explore the impacts of the liquid-liquid transition on dynamics. We locate characteristic dynamical loci in the phase diagram and compare them with the previously investigated thermodynamic loci. The low-density liquid phase shows a crossover from non-Arrhenius to Arrhenius behavior, signaling the onset of a crossover from fragile-to-strong behavior. We explain this crossover in terms of the asymptotic approach of the low-density liquid to a random tetrahedral network, and show that the temperature dependence of the diffusion coefficient over a wide temperature range can be simply related to the concentration of defects in the network. Our findings thus confirm that the low-density phase of ST2 water is a well-defined metastable liquid. △ Less

Submitted 26 May, 2011; originally announced May 2011.

Comments: 21 pages, 9 figures

Journal ref: J. Phys. Chem. B, 115, 14176-14183 (2011)

Probing electron-electron interaction in quantum Hall systems with scanning tunneling spectroscopy

Authors: S. Becker, C. Karrasch, T. Mashoff, M. Pratzer, M. Liebmann, V. Meden, M. Morgenstern

Abstract: Using low-temperature scanning tunneling spectroscopy applied to the Cs-induced two-dimensional electron system (2DES) on p-type InSb(110), we probe electron-electron interaction effects in the quantum Hall regime. The 2DES is decoupled from p-doped bulk states and exhibits spreading resistance within the insulating quantum Hall phases. In quantitative agreement with calculations we find an exchan… ▽ More Using low-temperature scanning tunneling spectroscopy applied to the Cs-induced two-dimensional electron system (2DES) on p-type InSb(110), we probe electron-electron interaction effects in the quantum Hall regime. The 2DES is decoupled from p-doped bulk states and exhibits spreading resistance within the insulating quantum Hall phases. In quantitative agreement with calculations we find an exchange enhancement of the spin splitting. Moreover, we observe that both the spatially averaged as well as the local density of states feature a characteristic Coulomb gap at the Fermi level. These results show that electron-electron interaction effects can be probed down to a resolution below all relevant length scales. △ Less

Submitted 15 April, 2011; v1 submitted 9 December, 2010; originally announced December 2010.

Comments: supplementary movie in ancillary files

Journal ref: Phys. Rev. Lett. 106, 156805 (2011)

Regularization of statistical inverse problems and the Bakushinskii veto

Authors: Saskia Becker

Abstract: In the deterministic context Bakushinskii's theorem excludes the existence of purely data driven convergent regularization for ill-posed problems. We will prove in the present work that in the statistical setting we can either construct a counter example or develop an equivalent formulation depending on the considered class of probability distributions. Hence, Bakushinskii's theorem does not gener… ▽ More In the deterministic context Bakushinskii's theorem excludes the existence of purely data driven convergent regularization for ill-posed problems. We will prove in the present work that in the statistical setting we can either construct a counter example or develop an equivalent formulation depending on the considered class of probability distributions. Hence, Bakushinskii's theorem does not generalize to the statistical context, although this has often been assumed in the past. To arrive at this conclusion, we will deduce from the classic theory new concepts for a general study of statistical inverse problems and perform a systematic clarification of the key ideas of statistical regularization. △ Less

Submitted 16 November, 2010; originally announced November 2010.

Comments: 20 pages

MSC Class: 62; 60

Journal ref: Inverse Problems 27 (2011) 115010

Numerical NLO QCD calculations

Authors: Sebastian Becker, Christian Reuschle, Stefan Weinzierl

Abstract: We present an algorithm for the numerical calculation of one-loop QCD amplitudes. The algorithm consists of subtraction terms, approximating the soft, collinear and ultraviolet divergences of one-loop amplitudes and a method to deform the integration contour for the loop integration into the complex space. The algorithm is formulated at the amplitude level and does not rely on Feynman graphs. Ther… ▽ More We present an algorithm for the numerical calculation of one-loop QCD amplitudes. The algorithm consists of subtraction terms, approximating the soft, collinear and ultraviolet divergences of one-loop amplitudes and a method to deform the integration contour for the loop integration into the complex space. The algorithm is formulated at the amplitude level and does not rely on Feynman graphs. Therefore all required ingredients can be calculated efficiently using recurrence relations. The algorithm applies to massless partons as well as to massive partons. △ Less

Submitted 22 November, 2010; v1 submitted 20 October, 2010; originally announced October 2010.

Comments: 62 pages, version to be published

Journal ref: JHEP 1012:013,2010

Templates for Convex Cone Problems with Applications to Sparse Signal Recovery

Authors: Stephen R. Becker, Emmanuel J. Candès, Michael Grant

Abstract: This paper develops a general framework for solving a variety of convex cone problems that frequently arise in signal processing, machine learning, statistics, and other fields. The approach works as follows: first, determine a conic formulation of the problem; second, determine its dual; third, apply smoothing; and fourth, solve using an optimal first-order method. A merit of this approach is its… ▽ More This paper develops a general framework for solving a variety of convex cone problems that frequently arise in signal processing, machine learning, statistics, and other fields. The approach works as follows: first, determine a conic formulation of the problem; second, determine its dual; third, apply smoothing; and fourth, solve using an optimal first-order method. A merit of this approach is its flexibility: for example, all compressed sensing problems can be solved via this approach. These include models with objective functionals such as the total-variation norm, ||Wx||_1 where W is arbitrary, or a combination thereof. In addition, the paper also introduces a number of technical contributions such as a novel continuation scheme, a novel approach for controlling the step size, and some new results showing that the smooth and unsmoothed problems are sometimes formally equivalent. Combined with our framework, these lead to novel, stable and computationally efficient algorithms. For instance, our general implementation is competitive with state-of-the-art methods for solving intensively studied problems such as the LASSO. Further, numerical experiments show that one can solve the Dantzig selector problem, for which no efficient large-scale solvers exist, in a few hundred iterations. Finally, the paper is accompanied with a software release. This software is not a single, monolithic solver; rather, it is a suite of programs and routines designed to serve as building blocks for constructing complete algorithms. △ Less

Submitted 19 December, 2011; v1 submitted 10 September, 2010; originally announced September 2010.

Comments: The TFOCS software is available at http://tfocs.stanford.edu This version has updated references

MSC Class: 90C05; 90C06; 90C25; 62J077

Journal ref: Mathematical Programming Computation, Volume 3, Number 3, 165-218, 2011

Infrared singularities in one-loop amplitudes

Authors: M. Assadsolimani, S. Becker, Ch. Reuschle, S. Weinzierl

Abstract: In this talk we discuss a purely numerical approach to next-to-leading order calculations in QCD. We present a simple formula, which provides a local infrared subtraction term for the integrand of a one-loop amplitude. In addition we briefly comment on local ultraviolet subtraction terms and on the required deformation of the contour of integration. In this talk we discuss a purely numerical approach to next-to-leading order calculations in QCD. We present a simple formula, which provides a local infrared subtraction term for the integrand of a one-loop amplitude. In addition we briefly comment on local ultraviolet subtraction terms and on the required deformation of the contour of integration. △ Less

Submitted 23 June, 2010; originally announced June 2010.

Comments: 6 pages, talk given at the conference "Loops and Legs", Woerlitz, 2010

Journal ref: Nucl.Phys.Proc.Suppl.205-206:224-229,2010