Showing 1–50 of 57 results for author: Freund, R

Hardware Realization of Neuromorphic Computing with a 4-Port Photonic Reservoir for Modulation Format Identification

Authors: Enes Şeker, Rijil Thomas, Guillermo von Hünefeld, Stephan Suckow, Mahdi Kaveh, Gregor Ronniger, Pooyan Safari, Isaac Sackey, David Stahl, Colja Schubert, Johannes Karl Fischer, Ronald Freund, Max C. Lemme

Abstract: The fields of machine learning and artificial intelligence drive researchers to explore energy-efficient, brain-inspired new hardware. Reservoir computing encompasses recurrent neural networks for sequential data processing and matches the performance of other recurrent networks with less training and lower costs. However, traditional software-based neural networks suffer from high energy consumpt… ▽ More The fields of machine learning and artificial intelligence drive researchers to explore energy-efficient, brain-inspired new hardware. Reservoir computing encompasses recurrent neural networks for sequential data processing and matches the performance of other recurrent networks with less training and lower costs. However, traditional software-based neural networks suffer from high energy consumption due to computational demands and massive data transfer needs. Photonic reservoir computing overcomes this challenge with energy-efficient neuromorphic photonic integrated circuits or NeuroPICs. Here, we introduce a reservoir NeuroPIC used for modulation format identification in C-band telecommunication network monitoring. It is built on a silicon-on-insulator platform with a 4-port reservoir architecture consisting of a set of physical nodes connected via delay lines. We comprehensively describe the NeuroPIC design and fabrication, experimentally demonstrate its performance, and compare it with simulations. The NeuroPIC incorporates non-linearity through a simple digital readout and achieves close to 100% accuracy in identifying several configurations of quadrature amplitude modulation formats transmitted over 20 km of optical fiber at 32 GBaud symbol rate. The NeuroPIC performance is robust against fabrication imperfections like waveguide propagation loss, phase randomization, etc. and delay line length variations. Furthermore, the experimental results exceeded numerical simulations, which we attribute to enhanced signal interference in the experimental NeuroPIC output. Our energy-efficient photonic approach has the potential for high-speed temporal data processing in a variety of applications. △ Less

Submitted 19 June, 2024; originally announced June 2024.

Comments: 32 pages, including supporting information

The Role of Level-Set Geometry on the Performance of PDHG for Conic Linear Optimization

Authors: Zikai Xiong, Robert M. Freund

Abstract: We consider solving huge-scale instances of (convex) conic linear optimization problems, at the scale where matrix-factorization-free methods are attractive or necessary. The restarted primal-dual hybrid gradient method (rPDHG) -- with heuristic enhancements and GPU implementation -- has been very successful in solving huge-scale linear programming (LP) problems; however its application to more ge… ▽ More We consider solving huge-scale instances of (convex) conic linear optimization problems, at the scale where matrix-factorization-free methods are attractive or necessary. The restarted primal-dual hybrid gradient method (rPDHG) -- with heuristic enhancements and GPU implementation -- has been very successful in solving huge-scale linear programming (LP) problems; however its application to more general conic convex optimization problems is not so well-studied. We analyze the theoretical and practical performance of rPDHG for general (convex) conic linear optimization, and LP as a special case thereof. We show a relationship between the geometry of the primal-dual (sub-)level sets $W_\varepsilon$ and the convergence rate of rPDHG. Specifically, we prove a bound on the convergence rate of rPDHG that improves when there is a primal-dual (sub-)level set $W_\varepsilon$ for which (i) $W_\varepsilon$ is close to the optimal solution set (in Hausdorff distance), and (ii) the ratio of the diameter to the "conic radius" of $W_\varepsilon$ is small. And in the special case of LP problems, the performance of rPDHG is bounded only by this ratio applied to the (sub-)level set corresponding to the best non-optimal extreme point. Depending on the problem instance, this ratio can take on extreme values and can result in poor performance of rPDHG both in theory and in practice. To address this issue, we show how central-path-based linear transformations -- including conic rescaling -- can markedly enhance the convergence rate of rPDHG. Furthermore, we present computational results that demonstrate how such rescalings can accelerate convergence to high-accuracy solutions, and lead to more efficient methods for huge-scale linear optimization problems. △ Less

Submitted 23 June, 2024; v1 submitted 3 June, 2024; originally announced June 2024.

Comments: 68 pages, 10 figures, 3 tables

Clock offset recovery with sublinear complexity enables synchronization on low-level hardware for quantum key distribution

Authors: Jan Krause, Nino Walenta, Jonas Hilt, Ronald Freund

Abstract: We introduce iQSync, a clock offset recovery method designed for implementation on low-level hardware, such as FPGAs or microcontrollers, for quantum key distribution (QKD). iQSync requires minimal memory, only a simple instruction set (e.g. no floating-point operations), and can be evaluated with sublinear time complexity, typically involving no more than a few thousand iterations of a simple loo… ▽ More We introduce iQSync, a clock offset recovery method designed for implementation on low-level hardware, such as FPGAs or microcontrollers, for quantum key distribution (QKD). iQSync requires minimal memory, only a simple instruction set (e.g. no floating-point operations), and can be evaluated with sublinear time complexity, typically involving no more than a few thousand iterations of a simple loop. Furthermore, iQSync allows for a precise clock offset recovery within few seconds, even for large offsets, and is well suited for scenarios with high channel loss and low signal-to-noise ratio, irrespective of the prepare-and-measure QKD protocol used. We implemented the method on our QKD platform, demonstrating its performance and conformity with analytically derived success probabilities for channel attenuations exceeding 70 dB. △ Less

Submitted 8 April, 2024; v1 submitted 5 April, 2024; originally announced April 2024.

Comments: 10 pages, 7 figures, 2 tables. Example Python implementation and full link simulation in Ancillary Files

Quantum dynamical maps for single-qubit gates under non-Markovian phase noise

Authors: J. M. Sánchez Velázquez, A. Steiner, R. Freund, M. Guevara-Bertsch, Ch. D. Marciniak, T. Monz, A. Bermudez

Abstract: Noise is both ubiquitous and generally deleterious in settings where precision is required. This is especially true in the quantum technology sector where system utility typically decays rapidly under its influence. Understanding the noise in quantum devices is thus a prerequisite for efficient strategies to mitigate or even eliminate its harmful effects. However, this requires resources that are… ▽ More Noise is both ubiquitous and generally deleterious in settings where precision is required. This is especially true in the quantum technology sector where system utility typically decays rapidly under its influence. Understanding the noise in quantum devices is thus a prerequisite for efficient strategies to mitigate or even eliminate its harmful effects. However, this requires resources that are often prohibitive, such that the typically-used noise models rely on simplifications that sometimes depart from experimental reality. Here we derive a compact microscopic error model for single-qubit gates that only requires a single experimental input -the noise power spectral density. Our model goes beyond standard depolarizing or Pauli-twirled noise models, explicitly including non-Clifford and non-Markovian contributions to the dynamical error map. We gauge our predictions for experimentally relevant metrics against established characterization techniques run on a trapped-ion quantum computer. In particular, we find that experimental estimates of average gate errors measured through randomized benchmarking and reconstructed via quantum process tomography are tightly lower-bounded by our analytical estimates, while the depolarizing model overestimates the gate error. Our noise modeling including non-Markovian contributions can be readily applied to established frameworks such as dynamical decoupling and dynamically-corrected gates, or to provide more realistic thresholds for quantum error correction. △ Less

Submitted 19 March, 2024; v1 submitted 22 February, 2024; originally announced February 2024.

Comments: 29 pages, 7 figures

Computational Guarantees for Restarted PDHG for LP based on "Limiting Error Ratios" and LP Sharpness

Authors: Zikai Xiong, Robert Michael Freund

Abstract: In recent years, there has been growing interest in solving linear optimization problems - or more simply "LP" - using first-order methods. The restarted primal-dual hybrid gradient method (PDHG) - together with some heuristic techniques - has emerged as a powerful tool for solving huge-scale LPs. However, the theoretical understanding of it and the validation of various heuristic implementation t… ▽ More In recent years, there has been growing interest in solving linear optimization problems - or more simply "LP" - using first-order methods. The restarted primal-dual hybrid gradient method (PDHG) - together with some heuristic techniques - has emerged as a powerful tool for solving huge-scale LPs. However, the theoretical understanding of it and the validation of various heuristic implementation techniques are still very limited. Existing complexity analyses have relied on the Hoffman constant of the LP KKT system, which is known to be overly conservative, difficult to compute (and hence difficult to empirically validate), and fails to offer insight into instance-specific characteristics of the LP problems. These limitations have limited the capability to discern which characteristics of LP instances lead to easy versus difficult LP. With the goal of overcoming these limitations, in this paper we introduce and develop two purely geometry-based condition measures for LP instances: the "limiting error ratio" and the LP sharpness. We provide new computational guarantees for the restarted PDHG based on these two condition measures. For the limiting error ratio, we provide a computable upper bound and show its relationship with the data instance's proximity to infeasibility under perturbation. For the LP sharpness, we prove its equivalence to the stability of the LP optimal solution set under perturbation of the objective function. We validate our computational guarantees in terms of these condition measures via specially constructed instances. Conversely, our computational guarantees validate the practical efficacy of certain heuristic techniques (row preconditioners and step-size tuning) that improve computational performance in practice. Finally, we present computational experiments on LP relaxations from the MIPLIB dataset that demonstrate the promise of various implementation strategies. △ Less

Submitted 29 April, 2024; v1 submitted 22 December, 2023; originally announced December 2023.

On the Relation Between LP Sharpness and Limiting Error Ratio and Complexity Implications for Restarted PDHG

Authors: Zikai Xiong, Robert M. Freund

Abstract: There has been a recent surge in development of first-order methods (FOMs) for solving huge-scale linear programming (LP) problems. The attractiveness of FOMs for LP stems in part from the fact that they avoid costly matrix factorization computation. However, the efficiency of FOMs is significantly influenced - both in theory and in practice - by certain instance-specific LP condition measures. Xi… ▽ More There has been a recent surge in development of first-order methods (FOMs) for solving huge-scale linear programming (LP) problems. The attractiveness of FOMs for LP stems in part from the fact that they avoid costly matrix factorization computation. However, the efficiency of FOMs is significantly influenced - both in theory and in practice - by certain instance-specific LP condition measures. Xiong and Freund recently showed that the performance of the restarted primal-dual hybrid gradient method (PDHG) is predominantly determined by two specific condition measures: LP sharpness and Limiting Error Ratio. In this paper we examine the relationship between these two measures, particularly in the case when the optimal solution is unique (which is generic - at least in theory), and we present an upper bound on the Limiting Error Ratio involving the reciprocal of the LP sharpness. This shows that in LP instances where there is a dual nondegenerate optimal solution, the computational complexity of restarted PDHG can be characterized solely in terms of LP sharpness and the distance to optimal solutions, and simplifies the theoretical complexity upper bound of restarted PDHG for these instances. △ Less

Submitted 27 December, 2023; v1 submitted 21 December, 2023; originally announced December 2023.

A self-referenced optical phase noise analyzer for quantum technologies

Authors: Robert Freund, Christian D. Marciniak, Thomas Monz

Abstract: Second generation quantum technologies aim to outperform classical alternatives by utilizing engineered quantum systems. Maintaining the coherence required to enable any quantum advantage requires detailed knowledge and control over the noise the hosting system is subjected to. Characterizing noise processes via their power spectral density is routinely done throughout science and technology and c… ▽ More Second generation quantum technologies aim to outperform classical alternatives by utilizing engineered quantum systems. Maintaining the coherence required to enable any quantum advantage requires detailed knowledge and control over the noise the hosting system is subjected to. Characterizing noise processes via their power spectral density is routinely done throughout science and technology and can be a demanding task. Determining the phase noise power spectrum in leading quantum technology platforms, for example, can be either outside the reach of many phase noise analyzers, or be prohibitively expensive. In this work, we present and characterize a cost-effective optical phase noise analyzer for quantum technology applications. Using this setup we compare two $\approx1\ \rm{Hz}$ linewidth ultra-stable oscillators near $729\ \rm{nm}$, using them as references to determine and discuss the noise floor achieved in this measurement apparatus with a focus on limitations and their tradeoffs. The achieved noise floor in this implementation of a low-cost, all-stock component, low-complexity phase noise analyzer compares favourably to commercial offerings. This setup can find application in particular without a more stable reference or operational quantum system as sensor as would be the case for many component manufacturers. △ Less

Submitted 29 May, 2024; v1 submitted 12 October, 2023; originally announced October 2023.

Comments: 9 pages, 6 figures

Proceedings of the 13th International Workshop on Non-Classical Models of Automata and Applications

Authors: Benedek Nagy, Rudolf Freund

Abstract: The Thirteenth International Workshop on Non-Classical Models of Automata and Applications (NCMA 2023) was held in Famagusta, North Cyprus, on September 18 and 19, 2023, organized by the Eastern Mediterranean University. The NCMA workshop series was established in 2009 as an annual event for researchers working on non-classical and classical models of automata, grammars or related devices. Such mo… ▽ More The Thirteenth International Workshop on Non-Classical Models of Automata and Applications (NCMA 2023) was held in Famagusta, North Cyprus, on September 18 and 19, 2023, organized by the Eastern Mediterranean University. The NCMA workshop series was established in 2009 as an annual event for researchers working on non-classical and classical models of automata, grammars or related devices. Such models are investigated both as theoretical models and as formal models for applications from various points of view. △ Less

Submitted 13 September, 2023; originally announced September 2023.

Journal ref: EPTCS 388, 2023

A P Systems Variant for Reasoning about Sequential Controllability of Boolean Networks

Authors: Artiom Alhazov, Vincent Ferrari-Dominguez, Rudolf Freund, Nicolas Glade, Sergiu Ivanov

Abstract: A Boolean network is a discrete dynamical system operating on vectors of Boolean variables. The action of a Boolean network can be conveniently expressed as a system of Boolean update functions, computing the new values for each component of the Boolean vector as a function of the other components. Boolean networks are widely used in modelling biological systems that can be seen as consisting of e… ▽ More A Boolean network is a discrete dynamical system operating on vectors of Boolean variables. The action of a Boolean network can be conveniently expressed as a system of Boolean update functions, computing the new values for each component of the Boolean vector as a function of the other components. Boolean networks are widely used in modelling biological systems that can be seen as consisting of entities which can be activated or deactivated, expressed or inhibited, on or off. P systems on the other hand are classically introduced as a model of hierarchical multiset rewriting. However, over the years the community has proposed a wide range of P system variants including diverse ingredients suited for various needs. In this work, we propose a new variant -- Boolean P systems -- specifically designed for reasoning about sequential controllability of Boolean networks, and use it to first establish a crisp formalization of the problem, and then to prove that the problem of sequential controllability is PSPACE-complete. We further claim that Boolean P systems are a demonstration of how P systems can be used to construct ad hoc formalisms, custom-tailored for reasoning about specific problems, and providing new advantageous points of view. △ Less

Submitted 28 February, 2023; originally announced March 2023.

Comments: arXiv admin note: substantial text overlap with arXiv:2208.14723

Nonlinear conjugate gradient methods: worst-case convergence rates via computer-assisted analyses

Authors: Shuvomoy Das Gupta, Robert M. Freund, Xu Andy Sun, Adrien Taylor

Abstract: We propose a computer-assisted approach to the analysis of the worst-case convergence of nonlinear conjugate gradient methods (NCGMs). Those methods are known for their generally good empirical performances for large-scale optimization, while having relatively incomplete analyses. Using our computer-assisted approach, we establish novel complexity bounds for the Polak-Ribière-Polyak (PRP) and the… ▽ More We propose a computer-assisted approach to the analysis of the worst-case convergence of nonlinear conjugate gradient methods (NCGMs). Those methods are known for their generally good empirical performances for large-scale optimization, while having relatively incomplete analyses. Using our computer-assisted approach, we establish novel complexity bounds for the Polak-Ribière-Polyak (PRP) and the Fletcher-Reeves (FR) NCGMs for smooth strongly convex minimization. In particular, we construct mathematical proofs that establish the first non-asymptotic convergence bound for FR (which is historically the first developed NCGM), and a much improved non-asymptotic convergence bound for PRP. Additionally, we provide simple adversarial examples on which these methods do not perform better than gradient descent with exact line search, leaving very little room for improvements on the same class of problems. △ Less

Submitted 18 April, 2024; v1 submitted 4 January, 2023; originally announced January 2023.

Comments: 48 pages, 6 figures, 9 tables

P versus B: P Systems as a Formal Framework for Controllability of Boolean Networks

Authors: Artiom Alhazov, Rudolf Freund, Sergiu Ivanov

Abstract: Membrane computing and P systems are a paradigm of massively parallel natural computing introduced by Gheorghe Păun in 1999, inspired by the structure of the living cell and by its biochemical reactions. In spite of this explicit biological motivation, P systems have not been extensively used in modelling real-world systems. To confirm this intuition, we establish a state of the art investigatio… ▽ More Membrane computing and P systems are a paradigm of massively parallel natural computing introduced by Gheorghe Păun in 1999, inspired by the structure of the living cell and by its biochemical reactions. In spite of this explicit biological motivation, P systems have not been extensively used in modelling real-world systems. To confirm this intuition, we establish a state of the art investigation comparing the use of P systems to that of Boolean networks in this line of research. We then propose to use P systems as a tool for setting up formal frameworks to reason about other formalisms, and we introduce Boolean P systems, specifically tailored for capturing sequential controllability of Boolean networks. We show how to tackle some technical challenges and prove that sequential controllability properly embeds in the framework of Boolean P systems. △ Less

Submitted 31 August, 2022; originally announced August 2022.

Comments: In Proceedings NCMA 2022, arXiv:2208.13015

Journal ref: EPTCS 367, 2022, pp. 28-48

Using Taylor-Approximated Gradients to Improve the Frank-Wolfe Method for Empirical Risk Minimization

Authors: Zikai Xiong, Robert M. Freund

Abstract: The Frank-Wolfe method has become increasingly useful in statistical and machine learning applications, due to the structure-inducing properties of the iterates, and especially in settings where linear minimization over the feasible set is more computationally efficient than projection. In the setting of Empirical Risk Minimization -- one of the fundamental optimization problems in statistical and… ▽ More The Frank-Wolfe method has become increasingly useful in statistical and machine learning applications, due to the structure-inducing properties of the iterates, and especially in settings where linear minimization over the feasible set is more computationally efficient than projection. In the setting of Empirical Risk Minimization -- one of the fundamental optimization problems in statistical and machine learning -- the computational effectiveness of Frank-Wolfe methods typically grows linearly in the number of data observations $n$. This is in stark contrast to the case for typical stochastic projection methods. In order to reduce this dependence on $n$, we look to second-order smoothness of typical smooth loss functions (least squares loss and logistic loss, for example) and we propose amending the Frank-Wolfe method with Taylor series-approximated gradients, including variants for both deterministic and stochastic settings. Compared with current state-of-the-art methods in the regime where the optimality tolerance $\varepsilon$ is sufficiently small, our methods are able to simultaneously reduce the dependence on large $n$ while obtaining optimal convergence rates of Frank-Wolfe methods, in both the convex and non-convex settings. We also propose a novel adaptive step-size approach for which we have computational guarantees. Last of all, we present computational experiments which show that our methods exhibit very significant speed-ups over existing methods on real-world datasets for both convex and non-convex binary classification problems. △ Less

Submitted 21 November, 2023; v1 submitted 29 August, 2022; originally announced August 2022.

Comments: 30 pages, 2 figures

Demonstration of latency-aware 5G network slicing on optical metro networks

Authors: B. Shariati, L. Velasco, J. -J. Pedreño-Manresa, A. Dochhan, R. Casellas, A. Muqaddas, O. González de Dios, L. Luque Canto, B. Lent, J. E. López de Vergara, S. López-Buedo, F. Moreno, P. Pavón, M. Ruiz, S. K. Patri, A. Giorgetti, F. Cugini, A. Sgambelluri, R. Nejabati, D. Simeonidou, R. -P. Braun, A. Autenrieth, J. -P. Elbers, J. K. Fischer, R. Freund

Abstract: The H2020 METRO-HAUL European project has architected a latency-aware, cost-effective, agile, and programmable optical metro network. This includes the design of semidisaggregated metro nodes with compute and storage capabilities, which interface effectively with both 5G access and multi-Tbit/s elastic optical networks in the core. In this paper, we report the automated deployment of 5G services,… ▽ More The H2020 METRO-HAUL European project has architected a latency-aware, cost-effective, agile, and programmable optical metro network. This includes the design of semidisaggregated metro nodes with compute and storage capabilities, which interface effectively with both 5G access and multi-Tbit/s elastic optical networks in the core. In this paper, we report the automated deployment of 5G services, in particular, a public safety video surveillance use case employing low-latency object detection and tracking using on-camera and on-the-edge analytics. The demonstration features flexible deployment of network slice instances, implemented in terms of European Telecommunications Standards Institute (ETSI) network function virtualization network services. We summarize the key findings in a detailed analysis of end-to-end quality of service, service setup time, and soft-failure detection time. The results show that the round-trip time over an 80 km link is under 800s and the service deployment time is under 180s. △ Less

Submitted 21 February, 2022; originally announced February 2022.

Comments: 10 pages

Journal ref: Journal of Optical Communication and Networking, 14, A81-A90 (2022)

Time-frequency Quantum Key Distribution over a Free-Space Optical Link

Authors: Jasper Rödiger, Nicolas Perlot, Oliver Benson, Ronald Freund

Abstract: We present an implementation of the time-frequency (TF) quantum key distribution (QKD) protocol realized mainly with standard telecommunication components at 1550 nm. TF-QKD is implemented with modulations in time and frequency, namely pulse position modulation (PPM) and frequency shift keying (FSK). The time-frequency uncertainty relation ensures the security of the protocol. We further demonstra… ▽ More We present an implementation of the time-frequency (TF) quantum key distribution (QKD) protocol realized mainly with standard telecommunication components at 1550 nm. TF-QKD is implemented with modulations in time and frequency, namely pulse position modulation (PPM) and frequency shift keying (FSK). The time-frequency uncertainty relation ensures the security of the protocol. We further demonstrate free-space optical QKD transmission over a 388-m distance. Since the QKD setup is single-mode fiber (SMF) -based, precise coupling in and out of the SMFs is crucial. Thus, we implemented an optical tracking system. The QKD signal is wavelength-multiplexed with a strong beacon for optical tracking. Strong spectral filtering is necessary to separate beacon and QKD signal. Together with spatial filtering caused by the SMF most background light is filtered, enabling daylight QKD transmission. △ Less

Submitted 8 December, 2021; originally announced December 2021.

A Latency-Aware Real-Time Video Surveillance Demo: Network Slicing for Improving Public Safety

Authors: B. Shariati, J. J. Pedreno-Manresa, A. Dochhan, A. S. Muqaddas, R. Casellas, O. González de Dios, L. L. Canto, B. Lent, J. E. López de Vergara, S. López-Buedo, F. J. Moreno, P. Pavón, L. Velasco, S. Patri, A. Giorgetti, F. Cugini, A. Sgambelluri, R. Nejabati, D. Simeonidou, R, -P, Braun, A. Autenrieth, J. -P. Elbers, J. K. Fischer , et al. (1 additional authors not shown)

Abstract: We report the automated deployment of 5G services across a latency-aware, semidisaggregated, and virtualized metro network. We summarize the key findings in a detailed analysis of end-to-end latency, service setup time, and soft-failure detection time. We report the automated deployment of 5G services across a latency-aware, semidisaggregated, and virtualized metro network. We summarize the key findings in a detailed analysis of end-to-end latency, service setup time, and soft-failure detection time. △ Less

Submitted 6 July, 2021; originally announced July 2021.

Comments: The research leading to these results has received funding from the EC and BMBF through the METRO-HAUL project (G.A. No. 761727) and OTB-5G+ project (reference No. 16KIS0979K)

Journal ref: Proceedings of the Optical Fiber Communication Conference and Exhibition (OFC2021)

All-Indoor Optical Customer Premises Equipment for Fixed Wireless Access

Authors: Dominic Schulz, Julian Hohmann, Peter Hellwig, Christoph Kottke, Ronald Freund, Volker Jungnickel, Ralf-Peter Braun, Frank Geilhardt

Abstract: We demonstrate an LED-based optical wireless link for fixed wireless access applications, at data rates of 1.5 Gbit/s over 50 m. Transmission between indoor equipment and outdoor access point is possible through metal-coated insulation glass. We demonstrate an LED-based optical wireless link for fixed wireless access applications, at data rates of 1.5 Gbit/s over 50 m. Transmission between indoor equipment and outdoor access point is possible through metal-coated insulation glass. △ Less

Submitted 26 May, 2021; originally announced July 2021.

Comments: 3 pages, 2 figures, Optical Fiber Communication Conference 2021

ACM Class: B.4.1

Analysis of the Frank-Wolfe Method for Convex Composite Optimization involving a Logarithmically-Homogeneous Barrier

Authors: Renbo Zhao, Robert M. Freund

Abstract: We present and analyze a new generalized Frank-Wolfe method for the composite optimization problem $(P):{\min}_{x\in\mathbb{R}^n}\; f(\mathsf{A} x) + h(x)$, where $f$ is a $θ$-logarithmically-homogeneous self-concordant barrier, $\mathsf{A}$ is a linear operator and the function $h$ has bounded domain but is possibly non-smooth. We show that our generalized Frank-Wolfe method requires… ▽ More We present and analyze a new generalized Frank-Wolfe method for the composite optimization problem $(P):{\min}_{x\in\mathbb{R}^n}\; f(\mathsf{A} x) + h(x)$, where $f$ is a $θ$-logarithmically-homogeneous self-concordant barrier, $\mathsf{A}$ is a linear operator and the function $h$ has bounded domain but is possibly non-smooth. We show that our generalized Frank-Wolfe method requires $O((δ_0 + θ+ R_h)\ln(δ_0) + (θ+ R_h)^2/\varepsilon)$ iterations to produce an $\varepsilon$-approximate solution, where $δ_0$ denotes the initial optimality gap and $R_h$ is the variation of $h$ on its domain. This result establishes certain intrinsic connections between $θ$-logarithmically homogeneous barriers and the Frank-Wolfe method. When specialized to the $D$-optimal design problem, we essentially recover the complexity obtained by Khachiyan using the Frank-Wolfe method with exact line-search. We also study the (Fenchel) dual problem of $(P)$, and we show that our new method is equivalent to an adaptive-step-size mirror descent method applied to the dual problem. This enables us to provide iteration complexity bounds for the mirror descent method despite even though the dual objective function is non-Lipschitz and has unbounded domain. In addition, we present computational experiments that point to the potential usefulness of our generalized Frank-Wolfe method on Poisson image de-blurring problems with TV regularization, and on simulated PET problem instances. △ Less

Submitted 5 December, 2021; v1 submitted 18 October, 2020; originally announced October 2020.

Comments: See Version 1 (v1) for the analysis of the Frank-Wolfe method with adaptive step-size applied to the Hölder smooth functions

Stochastic Frank-Wolfe for Constrained Finite-Sum Minimization

Authors: Geoffrey Négiar, Gideon Dresdner, Alicia Tsai, Laurent El Ghaoui, Francesco Locatello, Robert M. Freund, Fabian Pedregosa

Abstract: We propose a novel Stochastic Frank-Wolfe (a.k.a. conditional gradient) algorithm for constrained smooth finite-sum minimization with a generalized linear prediction/structure. This class of problems includes empirical risk minimization with sparse, low-rank, or other structured constraints. The proposed method is simple to implement, does not require step-size tuning, and has a constant per-itera… ▽ More We propose a novel Stochastic Frank-Wolfe (a.k.a. conditional gradient) algorithm for constrained smooth finite-sum minimization with a generalized linear prediction/structure. This class of problems includes empirical risk minimization with sparse, low-rank, or other structured constraints. The proposed method is simple to implement, does not require step-size tuning, and has a constant per-iteration cost that is independent of the dataset size. Furthermore, as a byproduct of the method we obtain a stochastic estimator of the Frank-Wolfe gap that can be used as a stop** criterion. Depending on the setting, the proposed method matches or improves on the best computational guarantees for Stochastic Frank-Wolfe algorithms. Benchmarks on several datasets highlight different regimes in which the proposed method exhibits a faster empirical convergence than related methods. Finally, we provide an implementation of all considered methods in an open-source package. △ Less

Submitted 8 September, 2022; v1 submitted 26 February, 2020; originally announced February 2020.

Comments: Proceedings of the 37th International Conference on Machine Learning, 2020

An Oblivious Ellipsoid Algorithm for Solving a System of (In)Feasible Linear Inequalities

Authors: Jourdain Lamperski, Robert M. Freund, Michael J. Todd

Abstract: The ellipsoid algorithm is a fundamental algorithm for computing a solution to the system of $m$ linear inequalities in $n$ variables $(P): A^{\top}x \le u$ when its set of solutions has positive volume. However, when $(P)$ is infeasible, the ellipsoid algorithm has no mechanism for proving that $(P)$ is infeasible. This is in contrast to the other two fundamental algorithms for tackling $(P)$, na… ▽ More The ellipsoid algorithm is a fundamental algorithm for computing a solution to the system of $m$ linear inequalities in $n$ variables $(P): A^{\top}x \le u$ when its set of solutions has positive volume. However, when $(P)$ is infeasible, the ellipsoid algorithm has no mechanism for proving that $(P)$ is infeasible. This is in contrast to the other two fundamental algorithms for tackling $(P)$, namely the simplex method and interior-point methods, each of which can be easily implemented in a way that either produces a solution of $(P)$ or proves that $(P)$ is infeasible by producing a solution to the alternative system $\mathrm{({\it Alt})}: Aλ= 0$, $u^{\top}λ< 0$, $λ\ge 0$. This paper develops an Oblivious Ellipsoid Algorithm (OEA) that either produces a solution of $(P)$ or produces a solution of $\mathrm{({\it Alt})}$. Depending on the dimensions and on other natural condition measures, the computational complexity of the basic OEA may be worse than, the same as, or better than that of the standard ellipsoid algorithm. We also present two modified versions of OEA, whose computational complexity is superior to that of OEA when $n \ll m$. This is achieved in the first modified version by proving infeasibility without actually producing a solution of $\mathrm{({\it Alt})}$, and in the second modified version by using more memory. △ Less

Submitted 28 December, 2020; v1 submitted 7 October, 2019; originally announced October 2019.

Comments: 49 pages, 2 figures

MSC Class: 90C05; 90C60; 68Q25

Condition Number Analysis of Logistic Regression, and its Implications for Standard First-Order Solution Methods

Authors: Robert M. Freund, Paul Grigas, Rahul Mazumder

Abstract: Logistic regression is one of the most popular methods in binary classification, wherein estimation of model parameters is carried out by solving the maximum likelihood (ML) optimization problem, and the ML estimator is defined to be the optimal solution of this problem. It is well known that the ML estimator exists when the data is non-separable, but fails to exist when the data is separable. Fir… ▽ More Logistic regression is one of the most popular methods in binary classification, wherein estimation of model parameters is carried out by solving the maximum likelihood (ML) optimization problem, and the ML estimator is defined to be the optimal solution of this problem. It is well known that the ML estimator exists when the data is non-separable, but fails to exist when the data is separable. First-order methods are the algorithms of choice for solving large-scale instances of the logistic regression problem. In this paper, we introduce a pair of condition numbers that measure the degree of non-separability or separability of a given dataset in the setting of binary classification, and we study how these condition numbers relate to and inform the properties and the convergence guarantees of first-order methods. When the training data is non-separable, we show that the degree of non-separability naturally enters the analysis and informs the properties and convergence guarantees of two standard first-order methods: steepest descent (for any given norm) and stochastic gradient descent. Expanding on the work of Bach, we also show how the degree of non-separability enters into the analysis of linear convergence of steepest descent (without needing strong convexity), as well as the adaptive convergence of stochastic gradient descent. When the training data is separable, first-order methods rather curiously have good empirical success, which is not well understood in theory. In the case of separable data, we demonstrate how the degree of separability enters into the analysis of $\ell_2$ steepest descent and stochastic gradient descent for delivering approximate-maximum-margin solutions with associated computational guarantees as well. This suggests that first-order methods can lead to statistically meaningful solutions in the separable case, even though the ML solution does not exist. △ Less

Submitted 19 October, 2018; originally announced October 2018.

Comments: 38 pages

Generalized Stochastic Frank-Wolfe Algorithm with Stochastic "Substitute" Gradient for Structured Convex Optimization

Authors: Haihao Lu, Robert M. Freund

Abstract: The stochastic Frank-Wolfe method has recently attracted much general interest in the context of optimization for statistical and machine learning due to its ability to work with a more general feasible region. However, there has been a complexity gap in the guaranteed convergence rate for stochastic Frank-Wolfe compared to its deterministic counterpart. In this work, we present a new generalized… ▽ More The stochastic Frank-Wolfe method has recently attracted much general interest in the context of optimization for statistical and machine learning due to its ability to work with a more general feasible region. However, there has been a complexity gap in the guaranteed convergence rate for stochastic Frank-Wolfe compared to its deterministic counterpart. In this work, we present a new generalized stochastic Frank-Wolfe method which closes this gap for the class of structured optimization problems encountered in statistical and machine learning characterized by empirical loss minimization with a certain type of ``linear prediction'' property (formally defined in the paper), which is typically present loss minimization problems in practice. Our method also introduces the notion of a ``substitute gradient'' that is a not-necessarily-unbiased sample of the gradient. We show that our new method is equivalent to a particular randomized coordinate mirror descent algorithm applied to the dual problem, which in turn provides a new interpretation of randomized dual coordinate descent in the primal space. Also, in the special case of a strongly convex regularizer our generalized stochastic Frank-Wolfe method (as well as the randomized dual coordinate descent method) exhibits linear convergence. Furthermore, we present computational experiments that indicate that our method outperforms other stochastic Frank-Wolfe methods consistent with the theory developed herein. △ Less

Submitted 4 November, 2019; v1 submitted 19 July, 2018; originally announced July 2018.

Accelerating Greedy Coordinate Descent Methods

Authors: Haihao Lu, Robert M. Freund, Vahab Mirrokni

Abstract: We study ways to accelerate greedy coordinate descent in theory and in practice, where "accelerate" refers either to $O(1/k^2)$ convergence in theory, in practice, or both. We introduce and study two algorithms: Accelerated Semi-Greedy Coordinate Descent (ASCD) and Accelerated Greedy Coordinate Descent (AGCD). While ASCD takes greedy steps in the $x$-updates and randomized steps in the $z$-updates… ▽ More We study ways to accelerate greedy coordinate descent in theory and in practice, where "accelerate" refers either to $O(1/k^2)$ convergence in theory, in practice, or both. We introduce and study two algorithms: Accelerated Semi-Greedy Coordinate Descent (ASCD) and Accelerated Greedy Coordinate Descent (AGCD). While ASCD takes greedy steps in the $x$-updates and randomized steps in the $z$-updates, AGCD is a straightforward extension of standard greedy coordinate descent that only takes greedy steps. On the theory side, our main results are for ASCD: we show that ASCD achieves $O(1/k^2)$ convergence, and it also achieves accelerated linear convergence for strongly convex functions. On the empirical side, we observe that both AGCD and ASCD outperform Accelerated Randomized Coordinate Descent on a variety of instances. In particular, we note that AGCD significantly outperforms the other accelerated coordinate descent methods in numerical tests, in spite of a lack of theoretical guarantees for this method. To complement the empirical study of AGCD, we present a Lyapunov energy function argument that points to an explanation for why a direct extension of the acceleration proof for AGCD does not work; and we also introduce a technical condition under which AGCD is guaranteed to have accelerated convergence. Last of all, we confirm that this technical condition holds in our empirical study. △ Less

Submitted 6 June, 2018; originally announced June 2018.

Detection of intrinsic source structure at ~3 Schwarzschild radii with Millimeter-VLBI observations of SAGITTARIUS A*

Authors: Ru-Sen Lu, Thomas P. Krichbaum, Alan L. Roy, Vincent L. Fish, Sheperd S. Doeleman, Michael D. Johnson, Kazunori Akiyama, Dimitrios Psaltis, Walter Alef, Keiichi Asada, Christopher Beaudoin, Alessandra Bertarini, Lindy Blackburn, Ray Blundell, Geoffrey C. Bower, Christiaan Brinkerink, Avery E. Broderick, Roger Cappallo, Geoffrey B. Crew, Jason Dexter, Matt Dexter, Heino Falcke, Robert Freund, Per Friberg, Christopher H. Greer , et al. (31 additional authors not shown)

Abstract: We report results from very long baseline interferometric (VLBI) observations of the supermassive black hole in the Galactic center, Sgr A*, at 1.3 mm (230 GHz). The observations were performed in 2013 March using six VLBI stations in Hawaii, California, Arizona, and Chile. Compared to earlier observations, the addition of the APEX telescope in Chile almost doubles the longest baseline length in t… ▽ More We report results from very long baseline interferometric (VLBI) observations of the supermassive black hole in the Galactic center, Sgr A*, at 1.3 mm (230 GHz). The observations were performed in 2013 March using six VLBI stations in Hawaii, California, Arizona, and Chile. Compared to earlier observations, the addition of the APEX telescope in Chile almost doubles the longest baseline length in the array, provides additional {\it uv} coverage in the N-S direction, and leads to a spatial resolution of $\sim$30 $μ$as ($\sim$3 Schwarzschild radii) for Sgr A*. The source is detected even at the longest baselines with visibility amplitudes of $\sim$4-13% of the total flux density. We argue that such flux densities cannot result from interstellar refractive scattering alone, but indicate the presence of compact intrinsic source structure on scales of $\sim$3 Schwarzschild radii. The measured nonzero closure phases rule out point-symmetric emission. We discuss our results in the context of simple geometric models that capture the basic characteristics and brightness distributions of disk- and jet-dominated models and show that both can reproduce the observed data. Common to these models are the brightness asymmetry, the orientation, and characteristic sizes, which are comparable to the expected size of the black hole shadow. Future 1.3 mm VLBI observations with an expanded array and better sensitivity will allow a more detailed imaging of the horizon-scale structure and bear the potential for a deep insight into the physical processes at the black hole boundary. △ Less

Submitted 23 May, 2018; originally announced May 2018.

Comments: 11 pages, 5 figures, accepted to ApJ

(Tissue) P Systems with Vesicles of Multisets

Authors: Artiom Alhazov, Rudolf Freund, Sergiu Ivanov, Sergey Verlan

Abstract: We consider tissue P systems working on vesicles of multisets with the very simple operations of insertion, deletion, and substitution of single objects. With the whole multiset being enclosed in a vesicle, sending it to a target cell can be indicated in those simple rules working on the multiset. As derivation modes we consider the sequential mode, where exactly one rule is applied in a derivatio… ▽ More We consider tissue P systems working on vesicles of multisets with the very simple operations of insertion, deletion, and substitution of single objects. With the whole multiset being enclosed in a vesicle, sending it to a target cell can be indicated in those simple rules working on the multiset. As derivation modes we consider the sequential mode, where exactly one rule is applied in a derivation step, and the set maximal mode, where in each derivation step a non-extendable set of rules is applied. With the set maximal mode, computational completeness can already be obtained with tissue P systems having a tree structure, whereas tissue P systems even with an arbitrary communication structure are not computationally complete when working in the sequential mode. Adding polarizations (-1, 0, 1 are sufficient) allows for obtaining computational completeness even for tissue P systems working in the sequential mode. △ Less

Submitted 21 August, 2017; originally announced August 2017.

Comments: In Proceedings AFL 2017, arXiv:1708.06226

ACM Class: F.1.1; F.4.2

Journal ref: EPTCS 252, 2017, pp. 11-25

Numerical Assessment and Optimization of Discrete-Variable Time-Frequency Quantum Key Distribution

Authors: Jasper Rödiger, Nicolas Perlot, Roberto Mottola, Robert Elschner, Carl-Michael Weinert, Oliver Benson, Ronald Freund

Abstract: The discrete variables (DV) time-frequency (TF) quantum key distribution (QKD) protocol is a BB84 like protocol, which utilizes time and frequency as complementary bases. As orthogonal modulations, pulse position modulation (PPM) and frequency shift keying (FSK) are capable of transmitting several bits per symbol, i.e. per photon. However, unlike traditional binary polarization shift keying, PPM a… ▽ More The discrete variables (DV) time-frequency (TF) quantum key distribution (QKD) protocol is a BB84 like protocol, which utilizes time and frequency as complementary bases. As orthogonal modulations, pulse position modulation (PPM) and frequency shift keying (FSK) are capable of transmitting several bits per symbol, i.e. per photon. However, unlike traditional binary polarization shift keying, PPM and FSK do not allow perfectly complementary bases. So information is not completely deleted when the wrong-basis filters are applied. Since a general security proof does not yet exist, we numerically assess DV-TF-QKD. We show that the secret key rate increases with a higher number of symbols per basis. Further we identify the optimal pulse relations in the two bases in terms of key rate and resistance against eavesdrop** attacks. △ Less

Submitted 12 May, 2017; originally announced May 2017.

Comments: 9 Pages, 4 Figures

Journal ref: Physical Review A, 95(5), 052312 (2017)

Relatively-Smooth Convex Optimization by First-Order Methods, and Applications

Authors: Haihao Lu, Robert M. Freund, Yurii Nesterov

Abstract: The usual approach to develo** and analyzing first-order methods for smooth convex optimization assumes that the gradient of the objective function is uniformly smooth with some Lipschitz constant $L$. However, in many settings the differentiable convex function $f(\cdot)$ is not uniformly smooth -- for example in $D$-optimal design where $f(x):=-\ln \det(HXH^T)$, or even the univariate setting… ▽ More The usual approach to develo** and analyzing first-order methods for smooth convex optimization assumes that the gradient of the objective function is uniformly smooth with some Lipschitz constant $L$. However, in many settings the differentiable convex function $f(\cdot)$ is not uniformly smooth -- for example in $D$-optimal design where $f(x):=-\ln \det(HXH^T)$, or even the univariate setting with $f(x) := -\ln(x) + x^2$. Herein we develop a notion of "relative smoothness" and relative strong convexity that is determined relative to a user-specified "reference function" $h(\cdot)$ (that should be computationally tractable for algorithms), and we show that many differentiable convex functions are relatively smooth with respect to a correspondingly fairly-simple reference function $h(\cdot)$. We extend two standard algorithms -- the primal gradient scheme and the dual averaging scheme -- to our new setting, with associated computational guarantees. We apply our new approach to develop a new first-order method for the $D$-optimal design problem, with associated computational complexity analysis. Some of our results have a certain overlap with the recent work \cite{bbt}. △ Less

Submitted 10 October, 2017; v1 submitted 18 October, 2016; originally announced October 2016.

Persistent Asymmetric Structure of Sagittarius A* on Event Horizon Scales

Authors: Vincent L. Fish, Michael D. Johnson, Sheperd S. Doeleman, Avery E. Broderick, Dimitrios Psaltis, Ru-Sen Lu, Kazunori Akiyama, Walter Alef, Juan Carlos Algaba, Keiichi Asada, Christopher Beaudoin, Alessandra Bertarini, Lindy Blackburn, Ray Blundell, Geoffrey C. Bower, Christiaan Brinkerink, Roger Cappallo, Andrew A. Chael, Richard Chamberlin, Chi-Kwan Chan, Geoffrey B. Crew, Jason Dexter, Matt Dexter, Sergio A. Dzib, Heino Falcke , et al. (47 additional authors not shown)

Abstract: The Galactic Center black hole Sagittarius A* (Sgr A*) is a prime observing target for the Event Horizon Telescope (EHT), which can resolve the 1.3 mm emission from this source on angular scales comparable to that of the general relativistic shadow. Previous EHT observations have used visibility amplitudes to infer the morphology of the millimeter-wavelength emission. Potentially much richer sourc… ▽ More The Galactic Center black hole Sagittarius A* (Sgr A*) is a prime observing target for the Event Horizon Telescope (EHT), which can resolve the 1.3 mm emission from this source on angular scales comparable to that of the general relativistic shadow. Previous EHT observations have used visibility amplitudes to infer the morphology of the millimeter-wavelength emission. Potentially much richer source information is contained in the phases. We report on 1.3 mm phase information on Sgr A* obtained with the EHT on a total of 13 observing nights over 4 years. Closure phases, the sum of visibility phases along a closed triangle of interferometer baselines, are used because they are robust against phase corruptions introduced by instrumentation and the rapidly variable atmosphere. The median closure phase on a triangle including telescopes in California, Hawaii, and Arizona is nonzero. This result conclusively demonstrates that the millimeter emission is asymmetric on scales of a few Schwarzschild radii and can be used to break 180-degree rotational ambiguities inherent from amplitude data alone. The stability of the sign of the closure phase over most observing nights indicates persistent asymmetry in the image of Sgr A* that is not obscured by refraction due to interstellar electrons along the line of sight. △ Less

Submitted 17 February, 2016; originally announced February 2016.

Comments: 11 pages, accepted to ApJ

Resolved Magnetic-Field Structure and Variability Near the Event Horizon of Sagittarius A*

Authors: Michael D. Johnson, Vincent L. Fish, Sheperd S. Doeleman, Daniel P. Marrone, Richard L. Plambeck, John F. C. Wardle, Kazunori Akiyama, Keiichi Asada, Christopher Beaudoin, Lindy Blackburn, Ray Blundell, Geoffrey C. Bower, Christiaan Brinkerink, Avery E. Broderick, Roger Cappallo, Andrew A. Chael, Geoffrey B. Crew, Jason Dexter, Matt Dexter, Robert Freund, Per Friberg, Roman Gold, Mark A. Gurwell, Paul T. P. Ho, Mareki Honma , et al. (23 additional authors not shown)

Abstract: Near a black hole, differential rotation of a magnetized accretion disk is thought to produce an instability that amplifies weak magnetic fields, driving accretion and outflow. These magnetic fields would naturally give rise to the observed synchrotron emission in galaxy cores and to the formation of relativistic jets, but no observations to date have been able to resolve the expected horizon-scal… ▽ More Near a black hole, differential rotation of a magnetized accretion disk is thought to produce an instability that amplifies weak magnetic fields, driving accretion and outflow. These magnetic fields would naturally give rise to the observed synchrotron emission in galaxy cores and to the formation of relativistic jets, but no observations to date have been able to resolve the expected horizon-scale magnetic-field structure. We report interferometric observations at 1.3-millimeter wavelength that spatially resolve the linearly polarized emission from the Galactic Center supermassive black hole, Sagittarius A*. We have found evidence for partially ordered fields near the event horizon, on scales of ~6 Schwarzschild radii, and we have detected and localized the intra-hour variability associated with these fields. △ Less

Submitted 3 December, 2015; originally announced December 2015.

Comments: Accepted for publication in Science; includes Supplementary material

New Computational Guarantees for Solving Convex Optimization Problems with First Order Methods, via a Function Growth Condition Measure

Authors: Robert M. Freund, Haihao Lu

Abstract: Motivated by recent work of Renegar, we present new computational methods and associated computational guarantees for solving convex optimization problems using first-order methods. Our problem of interest is the general convex optimization problem $f^* = \min_{x \in Q} f(x)$, where we presume knowledge of a strict lower bound $f_{\mathrm{slb}} < f^*$. [Indeed, $f_{\mathrm{slb}}$ is naturally know… ▽ More Motivated by recent work of Renegar, we present new computational methods and associated computational guarantees for solving convex optimization problems using first-order methods. Our problem of interest is the general convex optimization problem $f^* = \min_{x \in Q} f(x)$, where we presume knowledge of a strict lower bound $f_{\mathrm{slb}} < f^*$. [Indeed, $f_{\mathrm{slb}}$ is naturally known when optimizing many loss functions in statistics and machine learning (least-squares, logistic loss, exponential loss, total variation loss, etc.) as well as in Renegar's transformed version of the standard conic optimization problem; in all these cases one has $f_{\mathrm{slb}} = 0 < f^*$.] We introduce a new functional measure called the growth constant $G$ for $f(\cdot)$, that measures how quickly the level sets of $f(\cdot)$ grow relative to the function value, and that plays a fundamental role in the complexity analysis. When $f(\cdot)$ is non-smooth, we present new computational guarantees for the Subgradient Descent Method and for smoothing methods, that can improve existing computational guarantees in several ways, most notably when the initial iterate $x^0$ is far from the optimal solution set. When $f(\cdot)$ is smooth, we present a scheme for periodically restarting the Accelerated Gradient Method that can also improve existing computational guarantees when $x^0$ is far from the optimal solution set, and in the presence of added structure we present a scheme using parametrically increased smoothing that further improves the associated computational guarantees. △ Less

Submitted 8 November, 2016; v1 submitted 9 November, 2015; originally announced November 2015.

Comments: 1 figure

MSC Class: 90C25

An Extended Frank-Wolfe Method with "In-Face" Directions, and its Application to Low-Rank Matrix Completion

Authors: Robert M. Freund, Paul Grigas, Rahul Mazumder

Abstract: Motivated principally by the low-rank matrix completion problem, we present an extension of the Frank-Wolfe method that is designed to induce near-optimal solutions on low-dimensional faces of the feasible region. This is accomplished by a new approach to generating ``in-face" directions at each iteration, as well as through new choice rules for selecting between in-face and ``regular" Frank-Wolfe… ▽ More Motivated principally by the low-rank matrix completion problem, we present an extension of the Frank-Wolfe method that is designed to induce near-optimal solutions on low-dimensional faces of the feasible region. This is accomplished by a new approach to generating ``in-face" directions at each iteration, as well as through new choice rules for selecting between in-face and ``regular" Frank-Wolfe steps. Our framework for generating in-face directions generalizes the notion of away-steps introduced by Wolfe. In particular, the in-face directions always keep the next iterate within the minimal face containing the current iterate. We present computational guarantees for the new method that trade off efficiency in computing near-optimal solutions with upper bounds on the dimension of minimal faces of iterates. We apply the new method to the matrix completion problem, where low-dimensional faces correspond to low-rank matrices. We present computational results that demonstrate the effectiveness of our methodological approach at producing nearly-optimal solutions of very low rank. On both artificial and real datasets, we demonstrate significant speed-ups in computing very low-rank nearly-optimal solutions as compared to either the Frank-Wolfe method or its traditional away-step variant. △ Less

Submitted 6 November, 2015; originally announced November 2015.

Comments: 25 pages, 3 tables and 2 figues

MSC Class: 90C25 ACM Class: G.1.6

First 230 GHz VLBI Fringes on 3C 279 using the APEX Telescope

Authors: J. Wagner, A. L. Roy, T. P. Krichbaum, W. Alef, A. Bansod, A. Bertarini, R. Güsten, D. Graham, J. Hodgson, R. Märtens, K. Menten, D. Muders, H. Rottmann, G. Tuccari, A. Weiss, G. Wieching, M. Wunderlich, J. A. Zensus, J. P. Araneda, O. Arriagada, M. Cantzler, C. Duran, F. M. Montenegro-Montes, R. Olivares, P. Caro , et al. (30 additional authors not shown)

Abstract: We report about a 230 GHz very long baseline interferometry (VLBI) fringe finder observation of blazar 3C 279 with the APEX telescope in Chile, the phased submillimeter array (SMA), and the SMT of the Arizona Radio Observatory (ARO). We installed VLBI equipment and measured the APEX station position to 1 cm accuracy (1 sigma). We then observed 3C 279 on 2012 May 7 in a 5 hour 230 GHz VLBI track wi… ▽ More We report about a 230 GHz very long baseline interferometry (VLBI) fringe finder observation of blazar 3C 279 with the APEX telescope in Chile, the phased submillimeter array (SMA), and the SMT of the Arizona Radio Observatory (ARO). We installed VLBI equipment and measured the APEX station position to 1 cm accuracy (1 sigma). We then observed 3C 279 on 2012 May 7 in a 5 hour 230 GHz VLBI track with baseline lengths of 2800 M$λ$ to 7200 M$λ$ and a finest fringe spacing of 28.6 micro-arcseconds. Fringes were detected on all baselines with SNRs of 12 to 55 in 420 s. The correlated flux density on the longest baseline was ~0.3 Jy/beam, out of a total flux density of 19.8 Jy. Visibility data suggest an emission region <38 uas in size, and at least two components, possibly polarized. We find a lower limit of the brightness temperature of the inner jet region of about 10^10 K. Lastly, we find an upper limit of 20% on the linear polarization fraction at a fringe spacing of ~38 uas. With APEX the angular resolution of 230 GHz VLBI improves to 28.6 uas. This allows one to resolve the last-photon ring around the Galactic Center black hole event horizon, expected to be 40 uas in diameter, and probe radio jet launching at unprecedented resolution, down to a few gravitational radii in galaxies like M 87. To probe the structure in the inner parsecs of 3C 279 in detail, follow-up observations with APEX and five other mm-VLBI stations have been conducted (March 2013) and are being analyzed. △ Less

Submitted 10 June, 2015; originally announced June 2015.

Comments: accepted for publication in A&A

Journal ref: A&A 581, A32 (2015)

A New Perspective on Boosting in Linear Regression via Subgradient Optimization and Relatives

Authors: Robert M. Freund, Paul Grigas, Rahul Mazumder

Abstract: In this paper we analyze boosting algorithms in linear regression from a new perspective: that of modern first-order methods in convex optimization. We show that classic boosting algorithms in linear regression, namely the incremental forward stagewise algorithm (FS$_\varepsilon$) and least squares boosting (LS-Boost($\varepsilon$)), can be viewed as subgradient descent to minimize the loss functi… ▽ More In this paper we analyze boosting algorithms in linear regression from a new perspective: that of modern first-order methods in convex optimization. We show that classic boosting algorithms in linear regression, namely the incremental forward stagewise algorithm (FS$_\varepsilon$) and least squares boosting (LS-Boost($\varepsilon$)), can be viewed as subgradient descent to minimize the loss function defined as the maximum absolute correlation between the features and residuals. We also propose a modification of FS$_\varepsilon$ that yields an algorithm for the Lasso, and that may be easily extended to an algorithm that computes the Lasso path for different values of the regularization parameter. Furthermore, we show that these new algorithms for the Lasso may also be interpreted as the same master algorithm (subgradient descent), applied to a regularized version of the maximum absolute correlation loss function. We derive novel, comprehensive computational guarantees for several boosting algorithms in linear regression (including LS-Boost($\varepsilon$) and FS$_\varepsilon$) by using techniques of modern first-order methods in convex optimization. Our computational guarantees inform us about the statistical properties of boosting algorithms. In particular they provide, for the first time, a precise theoretical description of the amount of data-fidelity and regularization imparted by running a boosting algorithm with a prespecified learning rate for a fixed but arbitrary number of iterations, for any dataset. △ Less

Submitted 16 May, 2015; originally announced May 2015.

MSC Class: 62J05; 62J07; 90C25

230 GHz VLBI observations of M87: event-horizon-scale structure at the enhanced very-high-energy $\rm γ$-ray state in 2012

Authors: Kazunori Akiyama, Ru-Sen Lu, Vincent L. Fish, Sheperd S. Doeleman, Avery E. Broderick, Jason Dexter, Kazuhiro Hada, Motoki Kino, Hiroshi Nagai, Mareki Honma, Michael D. Johnson, Juan C. Algaba, Keiichi Asada, Christiaan Brinkerink, Ray Blundell, Geoffrey C. Bower, Roger Cappallo, Geoffrey B. Crew, Matt Dexter, Sergio A. Dzib, Robert Freund, Per Friberg, Mark Gurwell, Paul T. P. Ho, Makoto Inoue , et al. (23 additional authors not shown)

Abstract: We report on 230 GHz (1.3 mm) VLBI observations of M87 with the Event Horizon Telescope using antennas on Mauna Kea in Hawaii, Mt. Graham in Arizona and Cedar Flat in California. For the first time, we have acquired 230 GHz VLBI interferometric phase information on M87 through measurement of closure phase on the triangle of long baselines. Most of the measured closure phases are consistent with 0… ▽ More We report on 230 GHz (1.3 mm) VLBI observations of M87 with the Event Horizon Telescope using antennas on Mauna Kea in Hawaii, Mt. Graham in Arizona and Cedar Flat in California. For the first time, we have acquired 230 GHz VLBI interferometric phase information on M87 through measurement of closure phase on the triangle of long baselines. Most of the measured closure phases are consistent with 0$^{\circ}$ as expected by physically-motivated models for 230 GHz structure such as jet models and accretion disk models. The brightness temperature of the event-horizon-scale structure is $\sim 1 \times 10^{10}$ K derived from the compact flux density of $\sim 1$ Jy and the angular size of $\sim 40 $ $\rm μ$as $\sim$ 5.5 $R_{\rm s}$, which is broadly consistent with the peak brightness of the radio cores at 1-86 GHz located within $\sim 10^2$ $R_{\rm s}$. Our observations occurred in the middle of an enhancement in very-high-energy (VHE) $\rm γ$-ray flux, presumably originating in the vicinity of the central black hole. Our measurements, combined with results of multi-wavelength observations, favor a scenario in which the VHE region has an extended size of $\sim$20-60 $R_{\rm s}$. △ Less

Submitted 19 June, 2015; v1 submitted 13 May, 2015; originally announced May 2015.

Comments: 11 pages, 4 figures, accepted to ApJ

Cooperating Distributed Grammar Systems of Finite Index Working in Hybrid Modes

Authors: Henning Fernau, Rudolf Freund, Markus Holzer

Abstract: We study cooperating distributed grammar systems working in hybrid modes in connection with the finite index restriction in two different ways: firstly, we investigate cooperating distributed grammar systems working in hybrid modes which characterize programmed grammars with the finite index restriction; looking at the number of components of such systems, we obtain surprisingly rich lattice struc… ▽ More We study cooperating distributed grammar systems working in hybrid modes in connection with the finite index restriction in two different ways: firstly, we investigate cooperating distributed grammar systems working in hybrid modes which characterize programmed grammars with the finite index restriction; looking at the number of components of such systems, we obtain surprisingly rich lattice structures for the inclusion relations between the corresponding language families. Secondly, we impose the finite index restriction on cooperating distributed grammar systems working in hybrid modes themselves, which leads us to new characterizations of programmed grammars of finite index. △ Less

Submitted 21 May, 2014; originally announced May 2014.

Comments: In Proceedings AFL 2014, arXiv:1405.5272

Journal ref: EPTCS 151, 2014, pp. 246-260

Robust topology optimization of three-dimensional photonic-crystal band-gap structures

Authors: Han Men, Karen Y. K. Lee, Robert M. Freund, Jaime Peraire, Steven G. Johnson

Abstract: We perform full 3D topology optimization (in which "every voxel" of the unit cell is a degree of freedom) of photonic-crystal structures in order to find optimal omnidirectional band gaps for various symmetry groups, including fcc (including diamond), bcc, and simple-cubic lattices. Even without imposing the constraints of any fabrication process, the resulting optimal gaps are only slightly large… ▽ More We perform full 3D topology optimization (in which "every voxel" of the unit cell is a degree of freedom) of photonic-crystal structures in order to find optimal omnidirectional band gaps for various symmetry groups, including fcc (including diamond), bcc, and simple-cubic lattices. Even without imposing the constraints of any fabrication process, the resulting optimal gaps are only slightly larger than previous hand designs, suggesting that current photonic crystals are nearly optimal in this respect. However, optimization can discover new structures, e.g. a new fcc structure with the same symmetry but slightly larger gap than the well known inverse opal, which may offer new degrees of freedom to future fabrication technologies. Furthermore, our band-gap optimization is an illustration of a computational approach to 3D dispersion engineering which is applicable to many other problems in optics, based on a novel semidefinite-program formulation for nonconvex eigenvalue optimization combined with other techniques such as a simple approach to impose symmetry constraints. We also demonstrate a technique for \emph{robust} topology optimization, in which some uncertainty is included in each voxel and we optimize the worst-case gap, and we show that the resulting band gaps have increased robustness to systematic fabrication errors. △ Less

Submitted 19 May, 2014; v1 submitted 16 May, 2014; originally announced May 2014.

Comments: 17 pages, 9 figures, submitted to Optics Express

Journal ref: Optics Express, Vol. 22, Issue 19, pp. 22632-22648 (2014)

One-dimensional Array Grammars and P Systems with Array Insertion and Deletion Rules

Authors: Rudolf Freund, Sergiu Ivanov, Marion Oswald, K. G. Subramanian

Abstract: We consider the (one-dimensional) array counterpart of contextual as well as insertion and deletion string grammars and consider the operations of array insertion and deletion in array grammars. First we show that the emptiness problem for P systems with (one-dimensional) insertion rules is undecidable. Then we show computational completeness of P systems using (one-dimensional) array insertion an… ▽ More We consider the (one-dimensional) array counterpart of contextual as well as insertion and deletion string grammars and consider the operations of array insertion and deletion in array grammars. First we show that the emptiness problem for P systems with (one-dimensional) insertion rules is undecidable. Then we show computational completeness of P systems using (one-dimensional) array insertion and deletion rules even of norm one only. The main result of the paper exhibits computational completeness of one-dimensional array grammars using array insertion and deletion rules of norm at most two. △ Less

Submitted 5 September, 2013; originally announced September 2013.

Comments: In Proceedings MCU 2013, arXiv:1309.1043

Journal ref: EPTCS 128, 2013, pp. 62-75

How to Obtain Computational Completeness in P Systems with One Catalyst

Authors: Rudolf Freund, Gheorghe Păun

Abstract: Whether P systems with only one catalyst can already be computationally complete, is still an open problem. Here we establish computational completeness by using specific variants of additional control mechanisms. At each step using only multiset rewriting rules from one set of a finite number of sets of multiset rewriting rules allows for obtaining computational completeness with one catalyst and… ▽ More Whether P systems with only one catalyst can already be computationally complete, is still an open problem. Here we establish computational completeness by using specific variants of additional control mechanisms. At each step using only multiset rewriting rules from one set of a finite number of sets of multiset rewriting rules allows for obtaining computational completeness with one catalyst and only one membrane. If the targets are used for choosing the multiset of rules to be applied, for getting computational completeness with only one catalyst more than one membrane is needed. If the available sets of rules change periodically with time, computational completeness can be obtained with one catalyst in one membrane. Moreover, we also improve existing computational completeness results for P systems with mobile catalysts and for P systems with membrane creation. △ Less

Submitted 5 September, 2013; originally announced September 2013.

Comments: In Proceedings MCU 2013, arXiv:1309.1043

Journal ref: EPTCS 128, 2013, pp. 47-61

Fabrication-Adaptive Optimization, with an Application to Photonic Crystal Design

Authors: Han Men, Robert M. Freund, Ngoc C. Nguyen, Joel Saa-Seoane, Jaime Peraire

Abstract: It is often the case that the computed optimal solution of an optimization problem cannot be implemented directly, irrespective of data accuracy, due to either (i) technological limitations (such as physical tolerances of machines or processes), (ii) the deliberate simplification of a model to keep it tractable (by ignoring certain types of constraints that pose computational difficulties), and/or… ▽ More It is often the case that the computed optimal solution of an optimization problem cannot be implemented directly, irrespective of data accuracy, due to either (i) technological limitations (such as physical tolerances of machines or processes), (ii) the deliberate simplification of a model to keep it tractable (by ignoring certain types of constraints that pose computational difficulties), and/or (iii) human factors (getting people to "do" the optimal solution). Motivated by this observation, we present a modeling paradigm called "fabrication-adaptive optimization" for treating issues of implementation/fabrication. We develop computationally-focused theory and algorithms, and we present computational results for incorporating considerations of implementation/fabrication into constrained optimization problems that arise in photonic crystal design. The fabrication-adaptive optimization framework stems from the robust regularization of a function. When the feasible region is not a normed space (as typically encountered in application settings), the fabrication-adaptive optimization framework typically yields a non-convex optimization problem. (In the special case where the feasible region is a finite-dimensional normed space, we show that fabrication-adaptive optimization can be re-cast as an instance of modern robust optimization.) We study a variety of problems with special structures on functions, feasible regions, and norms, for which computation is tractable, and develop an algorithmic scheme for solving these problems in spite of the challenges of non-convexity. We apply our methodology to compute fabrication-adaptive designs of two-dimensional photonic crystals with a variety of prescribed features. △ Less

Submitted 19 May, 2014; v1 submitted 21 July, 2013; originally announced July 2013.

Journal ref: Operations research 62, 418-434 (2014)

AdaBoost and Forward Stagewise Regression are First-Order Convex Optimization Methods

Authors: Robert M. Freund, Paul Grigas, Rahul Mazumder

Abstract: Boosting methods are highly popular and effective supervised learning methods which combine weak learners into a single accurate model with good statistical performance. In this paper, we analyze two well-known boosting methods, AdaBoost and Incremental Forward Stagewise Regression (FS$_\varepsilon$), by establishing their precise connections to the Mirror Descent algorithm, which is a first-order… ▽ More Boosting methods are highly popular and effective supervised learning methods which combine weak learners into a single accurate model with good statistical performance. In this paper, we analyze two well-known boosting methods, AdaBoost and Incremental Forward Stagewise Regression (FS$_\varepsilon$), by establishing their precise connections to the Mirror Descent algorithm, which is a first-order method in convex optimization. As a consequence of these connections we obtain novel computational guarantees for these boosting methods. In particular, we characterize convergence bounds of AdaBoost, related to both the margin and log-exponential loss function, for any step-size sequence. Furthermore, this paper presents, for the first time, precise computational complexity results for FS$_\varepsilon$. △ Less

Submitted 3 July, 2013; originally announced July 2013.

MSC Class: 68Q32; 68T05; 62J05; 90C25 ACM Class: I.2.6; I.5.1; G.3; G.1.6

New Analysis and Results for the Frank-Wolfe Method

Authors: Robert M. Freund, Paul Grigas

Abstract: We present new results for the Frank-Wolfe method (also known as the conditional gradient method). We derive computational guarantees for arbitrary step-size sequences, which are then applied to various step-size rules, including simple averaging and constant step-sizes. We also develop step-size rules and computational guarantees that depend naturally on the warm-start quality of the initial (and… ▽ More We present new results for the Frank-Wolfe method (also known as the conditional gradient method). We derive computational guarantees for arbitrary step-size sequences, which are then applied to various step-size rules, including simple averaging and constant step-sizes. We also develop step-size rules and computational guarantees that depend naturally on the warm-start quality of the initial (and subsequent) iterates. Our results include computational guarantees for both duality/bound gaps and the so-called FW gaps. Lastly, we present complexity bounds in the presence of approximate computation of gradients and/or linear optimization subproblem solutions. △ Less

Submitted 2 June, 2014; v1 submitted 2 July, 2013; originally announced July 2013.

Comments: Changed the name of the method from "conditional gradient" to "Frank-Wolfe"

Report number: MIT Operations Research Center Working Paper OR395-13 MSC Class: 90C25 ACM Class: G.1.6

Fine-scale structure of the quasar 3C 279 Measured with 1.3 mm very long baseline interferometry

Authors: Ru-Sen Lu, Vincent L. Fish, Kazunori Akiyama, Sheperd S. Doeleman, Juan C. Algaba, Geoffrey C. Bower, Christiaan Brinkerink, Richard Chamberlin, Geoffrey Crew, Roger J. Cappallo, Matt Dexter, Robert Freund, Per Friberg, Mark A. Gurwell, Paul T. P. Ho, Mareki Honma, Makoto Inoue, Svetlana G. Jorstad, Thomas P. Krichbaum, Laurent Loinard, David MacMahon, Daniel P. Marrone, Alan P. Marscher, James M. Moran, Richard Plambeck , et al. (8 additional authors not shown)

Abstract: We report results from 5-day VLBI observations of the well-known quasar 3C 279 at 1.3 mm (230 GHz) in 2011. The measured nonzero closure phases on triangles including stations in Arizona, California and Hawaii indicate that the source structure is spatially resolved. We find an unusual inner jet direction at scales of $\sim$1 parsec extending along the northwest-southeast direction (PA =… ▽ More We report results from 5-day VLBI observations of the well-known quasar 3C 279 at 1.3 mm (230 GHz) in 2011. The measured nonzero closure phases on triangles including stations in Arizona, California and Hawaii indicate that the source structure is spatially resolved. We find an unusual inner jet direction at scales of $\sim$1 parsec extending along the northwest-southeast direction (PA = $127^{\circ}\pm3^{\circ}$), as opposed to other (previously) reported measurements on scales of a few parsecs showing inner jet direction extending to the southwest. The 1.3 mm structure corresponds closely with that observed in the central region of quasi-simultaneous super-resolution VLBA images at 7 mm. The closure phase changed significantly on the last day when compared with the rest of observations, indicating that the inner jet structure may be variable on daily timescales. The observed new direction of the inner jet shows inconsistency with the prediction of a class of jet precession models. Our observations indicate a brightness temperature of $\sim 8\times10^{10}$ K in the 1.3 mm core, much lower than that at centimeter wavelengths. Observations with better uv coverage and sensitivity in the coming years will allow the discrimination between different structure models and will provide direct images of the inner regions of the jet with 20--30 $μ$as (5--7 light months) resolution. △ Less

Submitted 15 May, 2013; originally announced May 2013.

Comments: Accepted to ApJ

Zooming towards the Event Horizon - mm-VLBI today and tomorrow

Authors: T. P. Krichbaum, A. Roy, J. Wagner, H. Rottmann, J. A. Hodgson, A. Bertarini, W. Alef, J. A. Zensus, A. P. Marscher, S. G. Jorstad, R. Freund, D. Marrone, P. Strittmatter, L. Ziurys, R. Blundell, J. Weintroub, K. Young, V. Fish, S. Doeleman, M. Bremer, S. Sanchez, L. Fuhrmann, E. Angelakis, V. Karamanavis

Abstract: Global VLBI imaging at millimeter and sub-millimeter wavelength overcomes the opacity barrier of synchrotron self-absorption in AGN and opens the direct view into sub-pc scale regions not accessible before. Since AGN variability is more pronounced at short millimeter wavelength, mm-VLBI can reveal structural changes in very early stages after outbursts. When combined with observations at longer wa… ▽ More Global VLBI imaging at millimeter and sub-millimeter wavelength overcomes the opacity barrier of synchrotron self-absorption in AGN and opens the direct view into sub-pc scale regions not accessible before. Since AGN variability is more pronounced at short millimeter wavelength, mm-VLBI can reveal structural changes in very early stages after outbursts. When combined with observations at longer wavelength, global 3mm and 1mm VLBI adds very detailed information. This helps to determine fundamental physical properties at the jet base, and in the vicinity of super-massive black holes at the center of AGN. Here we present new results from multi-frequency mm-VLBI imaging of OJ287 during a major outburst. We also report on a successful 1.3mm VLBI experiment with the APEX telescope in Chile. This observation sets a new record in angular resolution. It also opens the path towards future mm-VLBI with ALMA, which aims at the map** of the black hole event horizon in nearby galaxies, and the study of the roots of jets in AGN. △ Less

Submitted 13 May, 2013; originally announced May 2013.

Comments: 6 pages, to appear in 11th European VLBI Network Symposium, ed. P. Charlot et al., Bordeaux (France), October 9-12, 2012

Jet Launching Structure Resolved Near the Supermassive Black Hole in M87

Authors: Sheperd S. Doeleman, Vincent L. Fish, David E. Schenck, Christopher Beaudoin, Ray Blundell, Geoffrey C. Bower, Avery E. Broderick, Richard Chamberlin, Robert Freund, Per Friberg, Mark A. Gurwell, Paul T. P. Ho, Mareki Honma, Makoto Inoue, Thomas P. Krichbaum, James Lamb, Abraham Loeb, Colin Lonsdale, Daniel P. Marrone, James M. Moran, Tomoaki Oyama, Richard Plambeck, Rurik A. Primiani, Alan E. E. Rogers, Daniel L. Smythe , et al. (8 additional authors not shown)

Abstract: Approximately 10% of active galactic nuclei exhibit relativistic jets, which are powered by accretion of matter onto super massive black holes. While the measured width profiles of such jets on large scales agree with theories of magnetic collimation, predicted structure on accretion disk scales at the jet launch point has not been detected. We report radio interferometry observations at 1.3mm wav… ▽ More Approximately 10% of active galactic nuclei exhibit relativistic jets, which are powered by accretion of matter onto super massive black holes. While the measured width profiles of such jets on large scales agree with theories of magnetic collimation, predicted structure on accretion disk scales at the jet launch point has not been detected. We report radio interferometry observations at 1.3mm wavelength of the elliptical galaxy M87 that spatially resolve the base of the jet in this source. The derived size of 5.5 +/- 0.4 Schwarzschild radii is significantly smaller than the innermost edge of a retrograde accretion disk, suggesting that the M87 jet is powered by an accretion disk in a prograde orbit around a spinning black hole. △ Less

Submitted 23 October, 2012; originally announced October 2012.

Comments: 12 pages, 3 figures, accepted version

Journal ref: Science 338, 355 (2012)

Resolving the inner jet structure of 1924-292 with the EVENT HORIZON TELESCOPE

Authors: Ru-Sen Lu, Vincent L. Fish, Jonathan Weintroub, Sheperd S. Doeleman, Geoffrey C. Bower, Robert Freund, Per Friberg, Paul T. P. Ho, Mareki Honma, Makoto Inoue, Thomas P. Krichbaum, Daniel P. Marrone, James M. Moran, Tomoaki Oyama, Richard Plambeck, Rurik Primiani, Zhi-Qiang Shen, Remo P. J. Tilanus, Melvyn Wright, Ken H. Young, Lucy M. Ziurys, J. Anton Zensus

Abstract: We present the first 1.3 mm (230 GHz) very long baseline interferometry model image of an AGN jet using closure phase techniques with a four-element array. The model image of the quasar 1924-292 was obtained with four telescopes at three observatories: the James Clerk Maxwell Telescope (JCMT) on Mauna Kea in Hawaii, the Arizona Radio Observatory's Submillimeter Telescope (SMT) in Arizona, and two… ▽ More We present the first 1.3 mm (230 GHz) very long baseline interferometry model image of an AGN jet using closure phase techniques with a four-element array. The model image of the quasar 1924-292 was obtained with four telescopes at three observatories: the James Clerk Maxwell Telescope (JCMT) on Mauna Kea in Hawaii, the Arizona Radio Observatory's Submillimeter Telescope (SMT) in Arizona, and two telescopes of the Combined Array for Research in Millimeterwave Astronomy (CARMA) in California in April 2009. With the greatly improved resolution compared with previous observations and robust closure phase measurement, the inner jet structure of 1924-292 was spatially resolved. The inner jet extends to the northwest along a position angle of $-53^\circ$ at a distance of 0.38\,mas from the tentatively identified core, in agreement with the inner jet structure inferred from lower frequencies, and making a position angle difference of $\sim 80^{\circ}$ with respect to the cm-jet. The size of the compact core is 0.15\,pc with a brightness temperature of $1.2\times10^{11}$\,K. Compared with those measured at lower frequencies, the low brightness temperature may argue in favor of the decelerating jet model or particle-cascade models. The successful measurement of closure phase paves the way for imaging and time resolving Sgr A* and nearby AGN with the Event Horizon Telescope. △ Less

Submitted 21 August, 2012; originally announced August 2012.

Comments: 6 pages, 4 figures, accepted for publication in ApJL

1.3 mm Wavelength VLBI of Sagittarius A*: Detection of Time-Variable Emission on Event Horizon Scales

Authors: Vincent L. Fish, Sheperd S. Doeleman, Christopher Beaudoin, Ray Blundell, David E. Bolin, Geoffrey C. Bower, Richard Chamberlin, Robert Freund, Per Friberg, Mark A. Gurwell, Mareki Honma, Makoto Inoue, Thomas P. Krichbaum, James Lamb, Daniel P. Marrone, James M. Moran, Tomoaki Oyama, Richard Plambeck, Rurik Primiani, Alan E. E. Rogers, Daniel L. Smythe, Jason SooHoo, Peter Strittmatter, Remo P. J. Tilanus, Michael Titus , et al. (5 additional authors not shown)

Abstract: Sagittarius A*, the ~4 x 10^6 solar mass black hole candidate at the Galactic Center, can be studied on Schwarzschild radius scales with (sub)millimeter wavelength Very Long Baseline Interferometry (VLBI). We report on 1.3 mm wavelength observations of Sgr A* using a VLBI array consisting of the JCMT on Mauna Kea, the ARO/SMT on Mt. Graham in Arizona, and two telescopes of the CARMA array at Cedar… ▽ More Sagittarius A*, the ~4 x 10^6 solar mass black hole candidate at the Galactic Center, can be studied on Schwarzschild radius scales with (sub)millimeter wavelength Very Long Baseline Interferometry (VLBI). We report on 1.3 mm wavelength observations of Sgr A* using a VLBI array consisting of the JCMT on Mauna Kea, the ARO/SMT on Mt. Graham in Arizona, and two telescopes of the CARMA array at Cedar Flat in California. Both Sgr A* and the quasar calibrator 1924-292 were observed over three consecutive nights, and both sources were clearly detected on all baselines. For the first time, we are able to extract 1.3 mm VLBI interferometer phase information on Sgr A* through measurement of closure phase on the triangle of baselines. On the third night of observing, the correlated flux density of Sgr A* on all VLBI baselines increased relative to the first two nights, providing strong evidence for time-variable change on scales of a few Schwarzschild radii. These results suggest that future VLBI observations with greater sensitivity and additional baselines will play a valuable role in determining the structure of emission near the event horizon of Sgr A*. △ Less

Submitted 10 November, 2010; originally announced November 2010.

Comments: 8 pages, submitted to ApJL

Journal ref: Astrophys.J.727:L36,2011

Graph-Controlled Insertion-Deletion Systems

Authors: Rudolf Freund, Marian Kogler, Yurii Rogozhin, Sergey Verlan

Abstract: In this article, we consider the operations of insertion and deletion working in a graph-controlled manner. We show that like in the case of context-free productions, the computational power is strictly increased when using a control graph: computational completeness can be obtained by systems with insertion or deletion rules involving at most two symbols in a contextual or in a context-free manne… ▽ More In this article, we consider the operations of insertion and deletion working in a graph-controlled manner. We show that like in the case of context-free productions, the computational power is strictly increased when using a control graph: computational completeness can be obtained by systems with insertion or deletion rules involving at most two symbols in a contextual or in a context-free manner and with the control graph having only four nodes. △ Less

Submitted 10 August, 2010; originally announced August 2010.

Comments: In Proceedings DCFS 2010, arXiv:1008.1270

Journal ref: EPTCS 31, 2010, pp. 88-98

Drip and Mate Operations Acting in Test Tube Systems and Tissue-like P systems

Authors: Rudolf Freund, Marian Kogler

Abstract: The operations drip and mate considered in (mem)brane computing resemble the operations cut and recombination well known from DNA computing. We here consider sets of vesicles with multisets of objects on their outside membrane interacting by drip and mate in two different setups: in test tube systems, the vesicles may pass from one tube to another one provided they fulfill specific constraints;… ▽ More The operations drip and mate considered in (mem)brane computing resemble the operations cut and recombination well known from DNA computing. We here consider sets of vesicles with multisets of objects on their outside membrane interacting by drip and mate in two different setups: in test tube systems, the vesicles may pass from one tube to another one provided they fulfill specific constraints; in tissue-like P systems, the vesicles are immediately passed to specified cells after having undergone a drip or mate operation. In both variants, computational completeness can be obtained, yet with different constraints for the drip and mate operations. △ Less

Submitted 25 November, 2009; originally announced November 2009.

Journal ref: EPTCS 11, 2009, pp. 123-135

On the Number of Membranes in Unary P Systems

Authors: Rudolf Freund, Andreas Klein, Martin Kutrib

Abstract: We consider P systems with a linear membrane structure working on objects over a unary alphabet using sets of rules resembling homomorphisms. Such a restricted variant of P systems allows for a unique minimal representation of the generated unary language and in that way for an effective solution of the equivalence problem. Moreover, we examine the descriptional complexity of unary P systems wit… ▽ More We consider P systems with a linear membrane structure working on objects over a unary alphabet using sets of rules resembling homomorphisms. Such a restricted variant of P systems allows for a unique minimal representation of the generated unary language and in that way for an effective solution of the equivalence problem. Moreover, we examine the descriptional complexity of unary P systems with respect to the number of membranes. △ Less

Submitted 29 July, 2009; originally announced July 2009.

Journal ref: EPTCS 3, 2009, pp. 101-109

Band Gap Optimization of Two-Dimensional Photonic Crystals Using Semidefinite Programming and Subspace Methods

Authors: Han Men, Ngoc-Cuong Nguyen, Robert M. Freund, Pablo A. Parrilo, Jaume Peraire

Abstract: In this paper, we consider the optimal design of photonic crystal band structures for two-dimensional square lattices. The mathematical formulation of the band gap optimization problem leads to an infinite-dimensional Hermitian eigenvalue optimization problem parametrized by the dielectric material and the wave vector. To make the problem tractable, the original eigenvalue problem is discretized… ▽ More In this paper, we consider the optimal design of photonic crystal band structures for two-dimensional square lattices. The mathematical formulation of the band gap optimization problem leads to an infinite-dimensional Hermitian eigenvalue optimization problem parametrized by the dielectric material and the wave vector. To make the problem tractable, the original eigenvalue problem is discretized using the finite element method into a series of finite-dimensional eigenvalue problems for multiple values of the wave vector parameter. The resulting optimization problem is large-scale and non-convex, with low regularity and non-differentiable objective. By restricting to appropriate eigenspaces, we reduce the large-scale non-convex optimization problem via reparametrization to a sequence of small-scale convex semidefinite programs (SDPs) for which modern SDP solvers can be efficiently applied. Numerical results are presented for both transverse magnetic (TM) and transverse electric (TE) polarizations at several frequency bands. The optimized structures exhibit patterns which go far beyond typical physical intuition on periodic media design. △ Less

Submitted 13 July, 2009; originally announced July 2009.

Comments: 23 pages, submitted

Journal ref: Journal of Computational Physics 229 (2010) pp. 3706-3725

Event-horizon-scale structure in the supermassive black hole candidate at the Galactic Centre

Authors: Sheperd Doeleman, Jonathan Weintroub, Alan E. E. Rogers, Richard Plambeck, Robert Freund, Remo P. J. Tilanus, Per Friberg, Lucy M. Ziurys, James M. Moran, Brian Corey, Ken H. Young, Daniel L. Smythe, Michael Titus, Daniel P. Marrone, Roger J. Cappallo, Douglas C. J. Bock, Geoffrey C. Bower, Richard Chamberlin, Gary R. Davis, Thomas P. Krichbaum, James Lamb, Holly Maness, Arthur E. Niell, Alan Roy, Peter Strittmatter , et al. (3 additional authors not shown)

Abstract: The cores of most galaxies are thought to harbour supermassive black holes, which power galactic nuclei by converting the gravitational energy of accreting matter into radiation (ref 1). Sagittarius A*, the compact source of radio, infrared and X-ray emission at the centre of the Milky Way, is the closest example of this phenomenon, with an estimated black hole mass that is 4 million times that… ▽ More The cores of most galaxies are thought to harbour supermassive black holes, which power galactic nuclei by converting the gravitational energy of accreting matter into radiation (ref 1). Sagittarius A*, the compact source of radio, infrared and X-ray emission at the centre of the Milky Way, is the closest example of this phenomenon, with an estimated black hole mass that is 4 million times that of the Sun (refs. 2,3). A long-standing astronomical goal is to resolve structures in the innermost accretion flow surrounding Sgr A* where strong gravitational fields will distort the appearance of radiation emitted near the black hole. Radio observations at wavelengths of 3.5 mm and 7 mm have detected intrinsic structure in Sgr A*, but the spatial resolution of observations at these wavelengths is limited by interstellar scattering (refs. 4-7). Here we report observations at a wavelength of 1.3 mm that set a size of 37 (+16, -10; 3-sigma) microarcseconds on the intrinsic diameter of Sgr A*. This is less than the expected apparent size of the event horizon of the presumed black hole, suggesting that the bulk of SgrA* emission may not be not centred on the black hole, but arises in the surrounding accretion flow. △ Less

Submitted 15 September, 2008; originally announced September 2008.

Comments: 12 pages including 2 figures

Journal ref: Nature, vol 455, p 78, 2008