-
Degree of the subspace variety
Authors:
Paul Breiding,
Pierpaola Santarsiero
Abstract:
Subspace varieties are algebraic varieties whose elements are tensors with bounded multilinear rank. In this paper, we compute their degrees by computing their volumes.
Subspace varieties are algebraic varieties whose elements are tensors with bounded multilinear rank. In this paper, we compute their degrees by computing their volumes.
△ Less
Submitted 19 February, 2024;
originally announced February 2024.
-
Reach of Segre-Veronese Manifolds
Authors:
Paul Breiding,
Sarah Eggleston
Abstract:
We compute the reach, extremal curvature and volume of a tubular neighborhood for the Segre-Veronese variety intersected with the unit sphere.
We compute the reach, extremal curvature and volume of a tubular neighborhood for the Segre-Veronese variety intersected with the unit sphere.
△ Less
Submitted 23 April, 2024; v1 submitted 9 July, 2023;
originally announced July 2023.
-
Khovanskii bases for semimixed systems of polynomial equations -- a case of approximating stationary nonlinear Newtonian dynamics
Authors:
Viktoriia Borovik,
Paul Breiding,
Javier del Pino,
Mateusz Michałek,
Oded Zilberberg
Abstract:
We provide an approach to counting roots of polynomial systems, where each polynomial is a general linear combination of prescribed, fixed polynomials. Our tools rely on the theory of Khovanskii bases, combined with toric geometry, the Bernstein-Khovanskii-Kushnirenko (BKK) Theorem, and fiber products.
As a direct application of this theory, we solve the problem of counting the number of approxi…
▽ More
We provide an approach to counting roots of polynomial systems, where each polynomial is a general linear combination of prescribed, fixed polynomials. Our tools rely on the theory of Khovanskii bases, combined with toric geometry, the Bernstein-Khovanskii-Kushnirenko (BKK) Theorem, and fiber products.
As a direct application of this theory, we solve the problem of counting the number of approximate stationary states for coupled driven nonlinear resonators. We set up a system of polynomial equations that depends on three numbers $N, n$ and $M$ and whose solutions model the stationary states. The parameter $N$ is the number of coupled resonators, $2n - 1$ is the degree of nonlinearity of the underlying differential equation, and $M$ is the number of frequencies used in the approximation. We use our main theorems, that is, the generalized BKK Theorem and the Decoupling Theorem, to count the number of (complex) solutions of the polynomial system for an arbitrary degree of nonlinearity $2n - 1 \geq 3$, any number of resonators $N \geq 1$, and $M = 1$ harmonic. We also solve the case $N = 1, n = 2$ and $M = 2$ and give a computational way to check the number of solutions for $N = 1, n = 2$ and $M \geq 2$. This extends the results of arXiv:2208.08179.
△ Less
Submitted 13 June, 2023;
originally announced June 2023.
-
Line Multiview Ideals
Authors:
Paul Breiding,
Timothy Duff,
Lukas Gustafsson,
Felix Rydell,
Elima Shehu
Abstract:
We study the following problem in computer vision from the perspective of algebraic geometry: Using $m$ pinhole cameras we take $m$ pictures of a line in $\mathbb P^3$. This produces $m$ lines in $\mathbb P^2$ and the question is which $m$-tuples of lines can arise that way. We are interested in polynomial equations and therefore study the complex Zariski closure of all such tuples of lines. The r…
▽ More
We study the following problem in computer vision from the perspective of algebraic geometry: Using $m$ pinhole cameras we take $m$ pictures of a line in $\mathbb P^3$. This produces $m$ lines in $\mathbb P^2$ and the question is which $m$-tuples of lines can arise that way. We are interested in polynomial equations and therefore study the complex Zariski closure of all such tuples of lines. The resulting algebraic variety is a subvariety of $(\mathbb P^2)^m$ and is called line multiview variety. In this article, we study its ideal. We show that for generic cameras the ideal is generated by $3\times 3$-minors of a specific matrix. We also compute Gröbner bases and discuss to what extent our results carry over to the non-generic case.
△ Less
Submitted 23 April, 2024; v1 submitted 3 March, 2023;
originally announced March 2023.
-
A short proof for the parameter continuation theorem
Authors:
Viktoriia Borovik,
Paul Breiding
Abstract:
The Parameter Continuation Theorem is the theoretical foundation for polynomial homotopy continuation, which is one of the main tools in computational algebraic geometry. In this note, we give a short proof using Gröbner bases. Our approach gives a method for computing discriminants.
The Parameter Continuation Theorem is the theoretical foundation for polynomial homotopy continuation, which is one of the main tools in computational algebraic geometry. In this note, we give a short proof using Gröbner bases. Our approach gives a method for computing discriminants.
△ Less
Submitted 30 October, 2023; v1 submitted 28 February, 2023;
originally announced February 2023.
-
Numerical Nonlinear Algebra
Authors:
Daniel J. Bates,
Paul Breiding,
Tianran Chen,
Jonathan D. Hauenstein,
Anton Leykin,
Frank Sottile
Abstract:
Numerical nonlinear algebra is a computational paradigm that uses numerical analysis to study polynomial equations. Its origins were methods to solve systems of polynomial equations based on the classical theorem of Bézout. This was decisively linked to modern developments in algebraic geometry by the polyhedral homotopy algorithm of Huber and Sturmfels, which exploits the combinatorial structure…
▽ More
Numerical nonlinear algebra is a computational paradigm that uses numerical analysis to study polynomial equations. Its origins were methods to solve systems of polynomial equations based on the classical theorem of Bézout. This was decisively linked to modern developments in algebraic geometry by the polyhedral homotopy algorithm of Huber and Sturmfels, which exploits the combinatorial structure of the equations and led to efficient software for solving polynomial equations.
Subsequent growth of numerical nonlinear algebra continues to be informed by algebraic geometry and its applications. These include new approaches to solving, algorithms for studying positive-dimensional varieties, certification, and a range of applications both within mathematics and from other disciplines. With new implementations, numerical nonlinear algebra is now a fundamental computational tool for algebraic geometry and its applications. We survey some of these innovations and some recent applications.
△ Less
Submitted 6 March, 2024; v1 submitted 16 February, 2023;
originally announced February 2023.
-
Average degree of the essential variety
Authors:
Paul Breiding,
Samantha Fairchild,
Pierpaola Santarsiero,
Elima Shehu
Abstract:
The essential variety is an algebraic subvariety of dimension $5$ in real projective space $\mathbb R\mathrm P^{8}$ which encodes the relative pose of two calibrated pinhole cameras. The $5$-point algorithm in computer vision computes the real points in the intersection of the essential variety with a linear space of codimension $5$. The degree of the essential variety is $10$, so this intersectio…
▽ More
The essential variety is an algebraic subvariety of dimension $5$ in real projective space $\mathbb R\mathrm P^{8}$ which encodes the relative pose of two calibrated pinhole cameras. The $5$-point algorithm in computer vision computes the real points in the intersection of the essential variety with a linear space of codimension $5$. The degree of the essential variety is $10$, so this intersection consists of 10 complex points in general.
We compute the expected number of real intersection points when the linear space is random. We focus on two probability distributions for linear spaces. The first distribution is invariant under the action of the orthogonal group $\mathrm{O}(9)$ acting on linear spaces in $\mathbb R\mathrm P^{8}$. In this case, the expected number of real intersection points is equal to $4$. The second distribution is motivated from computer vision and is defined by choosing 5 point correspondences in the image planes $\mathbb R\mathrm P^2\times \mathbb R\mathrm P^2$ uniformly at random. A Monte Carlo computation suggests that with high probability the expected value lies in the interval $(3.95 - 0.05,\ 3.95 + 0.05)$.
△ Less
Submitted 10 November, 2023; v1 submitted 3 December, 2022;
originally announced December 2022.
-
Real circles tangent to 3 conics
Authors:
Paul Breiding,
Julia Lindberg,
Wern Juin Gabriel Ong,
Linus Sommer
Abstract:
In this paper we study circles tangent to conics. We show there are generically $184$ complex circles tangent to three conics in the plane and we characterize the real discriminant of the corresponding polynomial system. We give an explicit example of $3$ conics with $136$ real circles tangent to them. We conjecture that 136 is the maximal number of real circles. Furthermore, we implement a hill-c…
▽ More
In this paper we study circles tangent to conics. We show there are generically $184$ complex circles tangent to three conics in the plane and we characterize the real discriminant of the corresponding polynomial system. We give an explicit example of $3$ conics with $136$ real circles tangent to them. We conjecture that 136 is the maximal number of real circles. Furthermore, we implement a hill-climbing algorithm to find instances of conics with many real circles, and we introduce a machine learning model that, given three real conics, predicts the number of circles tangent to these three conics.
△ Less
Submitted 13 November, 2022;
originally announced November 2022.
-
The Algebraic Degree of Coupled Oscillators
Authors:
Paul Breiding,
Mateusz Michałek,
Leonid Monin,
Simon Telen
Abstract:
Approximating periodic solutions to the coupled Duffing equations amounts to solving a system of polynomial equations. The number of complex solutions measures the algebraic complexity of this approximation problem. Using the theory of Khovanskii bases, we show that this number is given by the volume of a certain polytope. We also show how to compute all solutions using numerical nonlinear algebra…
▽ More
Approximating periodic solutions to the coupled Duffing equations amounts to solving a system of polynomial equations. The number of complex solutions measures the algebraic complexity of this approximation problem. Using the theory of Khovanskii bases, we show that this number is given by the volume of a certain polytope. We also show how to compute all solutions using numerical nonlinear algebra.
△ Less
Submitted 17 August, 2022;
originally announced August 2022.
-
Critical Curvature of Algebraic Surfaces in Three-Space
Authors:
Paul Breiding,
Kristian Ranestad,
Madeleine Weinstein
Abstract:
We study the curvature of a smooth algebraic surface $X\subset \mathbb R^3$ of degree $d$ from the point of view of algebraic geometry. More precisely, we consider umbilical points and points of critical curvature. We prove that the number of complex critical curvature points is of order $d^3$. For general quadrics, we fully characterize the number of real and complex umbilics and critical curvatu…
▽ More
We study the curvature of a smooth algebraic surface $X\subset \mathbb R^3$ of degree $d$ from the point of view of algebraic geometry. More precisely, we consider umbilical points and points of critical curvature. We prove that the number of complex critical curvature points is of order $d^3$. For general quadrics, we fully characterize the number of real and complex umbilics and critical curvature points.
△ Less
Submitted 30 October, 2023; v1 submitted 18 June, 2022;
originally announced June 2022.
-
Line Multiview Varieties
Authors:
Paul Breiding,
Felix Rydell,
Elima Shehu,
Angélica Torres
Abstract:
We present an algebraic study of line correspondences for pinhole cameras, in contrast to the thoroughly studied point correspondences. We define the line multiview variety as the Zariski closure of the image of the map projecting lines in 3-space to tuples of image lines in 2-space. We prove that in the case of generic camera matrices the line multiview variety is a determinantal variety and we p…
▽ More
We present an algebraic study of line correspondences for pinhole cameras, in contrast to the thoroughly studied point correspondences. We define the line multiview variety as the Zariski closure of the image of the map projecting lines in 3-space to tuples of image lines in 2-space. We prove that in the case of generic camera matrices the line multiview variety is a determinantal variety and we provide a complete set-theoretic description for any camera arrangement. We investigate basic properties of this variety such as dimension, smoothness, and multidegree. Finally, we give experimental results for the Euclidean distance degree and robustness under noise for the triangulation of lines.
△ Less
Submitted 18 November, 2022; v1 submitted 3 March, 2022;
originally announced March 2022.
-
Facet volumes of polytopes
Authors:
Pavle V. M. Blagojević,
Paul Breiding,
Alexander Heaton
Abstract:
In this paper, motivated by the work of Edelman and Strang, we show that for fixed integers $d\geq 2$ and $n\geq d+1$ the configuration space of all facet volume vectors of all $d$-polytopes in $\mathbb R^{d}$ with $n$ facets is a full dimensional cone in $\mathbb R^{n}$. In particular, for tetrahedra ($d=3$ and $n=4$) this is a cone over a regular octahedron. Our proof is based on a novel configu…
▽ More
In this paper, motivated by the work of Edelman and Strang, we show that for fixed integers $d\geq 2$ and $n\geq d+1$ the configuration space of all facet volume vectors of all $d$-polytopes in $\mathbb R^{d}$ with $n$ facets is a full dimensional cone in $\mathbb R^{n}$. In particular, for tetrahedra ($d=3$ and $n=4$) this is a cone over a regular octahedron. Our proof is based on a novel configuration space / test map scheme which uses topological methods for finding solutions of a problem, and tools of differential geometry to identify solutions with the desired properties. Furthermore, our results open a possibility for the study of realization spaces of all $d$-polytopes in $\mathbb R^{d}$ with $n$ facets by the methods of algebraic topology.
△ Less
Submitted 15 December, 2021;
originally announced December 2021.
-
Equations for GL invariant families of polynomials
Authors:
Paul Breiding,
Christian Ikenmeyer,
Mateusz Michałek,
Reuven Hodges
Abstract:
We provide an algorithm that takes as an input a given parametric family of homogeneous polynomials, which is invariant under the action of the general linear group, and an integer $d$. It outputs the ideal of that family intersected with the space of homogeneous polynomials of degree $d$. Our motivation comes from open problems, which ask to find equations for varieties of cubic and quartic symme…
▽ More
We provide an algorithm that takes as an input a given parametric family of homogeneous polynomials, which is invariant under the action of the general linear group, and an integer $d$. It outputs the ideal of that family intersected with the space of homogeneous polynomials of degree $d$. Our motivation comes from open problems, which ask to find equations for varieties of cubic and quartic symmetroids. The algorithm relies on a database of specific Young tableaux and highest weight polynomials. We provide the database and the implementation of the database construction algorithm. Moreover, we provide a julia implementation to run the algorithm using the database, so that more varieties of homogeneous polynomials can easily be treated in the future.
△ Less
Submitted 13 October, 2021;
originally announced October 2021.
-
Three decompositions of symmetric tensors have similar condition numbers
Authors:
Nick Dewaele,
Paul Breiding,
Nick Vannieuwenhoven
Abstract:
We relate the condition numbers of computing three decompositions of symmetric tensors: the canonical polyadic decomposition, the Waring decomposition, and a Tucker-compressed Waring decomposition. Based on this relation we can speed up the computation of these condition numbers by orders of magnitude
We relate the condition numbers of computing three decompositions of symmetric tensors: the canonical polyadic decomposition, the Waring decomposition, and a Tucker-compressed Waring decomposition. Based on this relation we can speed up the computation of these condition numbers by orders of magnitude
△ Less
Submitted 8 October, 2021;
originally announced October 2021.
-
The zonoid algebra, generalized mixed volumes, and random determinants
Authors:
Paul Breiding,
Peter Bürgisser,
Antonio Lerario,
Léo Mathis
Abstract:
We show that every multilinear map between Euclidean spaces induces a unique, continuous, Minkowski multilinear map of the corresponding real cones of zonoids. Applied to the wedge product of the exterior algebra of a Euclidean space, this yields a multiplication of zonoids, defining the structure of a commutative, associative, and partially ordered ring, which we call the zonoid algebra. This fra…
▽ More
We show that every multilinear map between Euclidean spaces induces a unique, continuous, Minkowski multilinear map of the corresponding real cones of zonoids. Applied to the wedge product of the exterior algebra of a Euclidean space, this yields a multiplication of zonoids, defining the structure of a commutative, associative, and partially ordered ring, which we call the zonoid algebra. This framework gives a new perspective on classical objects in convex geometry, and it allows to introduce new functionals on zonoids, in particular generalizing the notion of mixed volume. We also analyze a similar construction based on the complex wedge product, which leads to the new notion of mixed $J$-volume. These ideas connect to the theory of random determinants.
△ Less
Submitted 18 March, 2022; v1 submitted 30 September, 2021;
originally announced September 2021.
-
Algebraic compressed sensing
Authors:
Paul Breiding,
Fulvio Gesmundo,
Mateusz Michałek,
Nick Vannieuwenhoven
Abstract:
We introduce the broad subclass of algebraic compressed sensing problems, where structured signals are modeled either explicitly or implicitly via polynomials. This includes, for instance, low-rank matrix and tensor recovery. We employ powerful techniques from algebraic geometry to study well-posedness of sufficiently general compressed sensing problems, including existence, local recoverability,…
▽ More
We introduce the broad subclass of algebraic compressed sensing problems, where structured signals are modeled either explicitly or implicitly via polynomials. This includes, for instance, low-rank matrix and tensor recovery. We employ powerful techniques from algebraic geometry to study well-posedness of sufficiently general compressed sensing problems, including existence, local recoverability, global uniqueness, and local smoothness. Our main results are summarized in thirteen questions and answers in algebraic compressed sensing. Most of our answers concerning the minimum number of required measurements for existence, recoverability, and uniqueness of algebraic compressed sensing problems are optimal and depend only on the dimension of the model.
△ Less
Submitted 24 June, 2024; v1 submitted 30 August, 2021;
originally announced August 2021.
-
The condition number of many tensor decompositions is invariant under Tucker compression
Authors:
Nick Dewaele,
Paul Breiding,
Nick Vannieuwenhoven
Abstract:
We characterise the sensitivity of several additive tensor decompositions with respect to perturbations of the original tensor. These decompositions include canonical polyadic decompositions, block term decompositions, and sums of tree tensor networks. Our main result shows that the condition number of all these decompositions is invariant under Tucker compression. This result can dramatically spe…
▽ More
We characterise the sensitivity of several additive tensor decompositions with respect to perturbations of the original tensor. These decompositions include canonical polyadic decompositions, block term decompositions, and sums of tree tensor networks. Our main result shows that the condition number of all these decompositions is invariant under Tucker compression. This result can dramatically speed up the computation of the condition number in practical applications. We give the example of an $265\times 371\times 7$ tensor of rank $3$ from a food science application whose condition number was computed in $6.9$ milliseconds by exploiting our new theorem, representing a speedup of four orders of magnitude over the previous state of the art.
△ Less
Submitted 24 June, 2021;
originally announced June 2021.
-
Nonlinear Algebra and Applications
Authors:
Paul Breiding,
Türkü Özlüm Çelik,
Timothy Duff,
Alexander Heaton,
Aida Maraj,
Anna-Laura Sattelberger,
Lorenzo Venturello,
Oğuzhan Yürük
Abstract:
We showcase applications of nonlinear algebra in the sciences and engineering. Our review is organized into eight themes: polynomial optimization, partial differential equations, algebraic statistics, integrable systems, configuration spaces of frameworks, biochemical reaction networks, algebraic vision, and tensor decompositions. Conversely, developments on these topics inspire new questions and…
▽ More
We showcase applications of nonlinear algebra in the sciences and engineering. Our review is organized into eight themes: polynomial optimization, partial differential equations, algebraic statistics, integrable systems, configuration spaces of frameworks, biochemical reaction networks, algebraic vision, and tensor decompositions. Conversely, developments on these topics inspire new questions and algorithms for algebraic geometry.
△ Less
Submitted 6 October, 2021; v1 submitted 30 March, 2021;
originally announced March 2021.
-
Sensitivity of low-rank matrix recovery
Authors:
Paul Breiding,
Nick Vannieuwenhoven
Abstract:
We characterize the first-order sensitivity of approximately recovering a low-rank matrix from linear measurements, a standard problem in compressed sensing. A special case covered by our analysis is approximating an incomplete matrix by a low-rank matrix. We give an algorithm for computing the associated condition number and demonstrate experimentally how the number of linear measurements affects…
▽ More
We characterize the first-order sensitivity of approximately recovering a low-rank matrix from linear measurements, a standard problem in compressed sensing. A special case covered by our analysis is approximating an incomplete matrix by a low-rank matrix. We give an algorithm for computing the associated condition number and demonstrate experimentally how the number of linear measurements affects it.
In addition, we study the condition number of the rank-r matrix approximation problem. It measures in the Frobenius norm by how much an infinitesimal perturbation to an arbitrary input matrix is amplified in the movement of its best rank-r approximation. We give an explicit formula for the condition number, which shows that it does depend on the relative singular value gap between the rth and (r+1)th singular values of the input matrix.
△ Less
Submitted 5 October, 2021; v1 submitted 28 February, 2021;
originally announced March 2021.
-
Euclidean distance degree and mixed volume
Authors:
Paul Breiding,
Frank Sottile,
James Woodcock
Abstract:
We initiate a study of the Euclidean Distance Degree in the context of sparse polynomials. Specifically, we consider a hypersurface f=0 defined by a polynomial f that is general given its support, such that the support contains the origin. We show that the Euclidean Distance Degree of f=0 equals the mixed volume of the Newton polytopes of the associated Lagrange multiplier equations. We discuss th…
▽ More
We initiate a study of the Euclidean Distance Degree in the context of sparse polynomials. Specifically, we consider a hypersurface f=0 defined by a polynomial f that is general given its support, such that the support contains the origin. We show that the Euclidean Distance Degree of f=0 equals the mixed volume of the Newton polytopes of the associated Lagrange multiplier equations. We discuss the implication of our result for computational complexity and give a formula for the Euclidean distance degree when the Newton polytope is a rectangular parallelepiped.
△ Less
Submitted 30 May, 2021; v1 submitted 11 December, 2020;
originally announced December 2020.
-
Certifying zeros of polynomial systems using interval arithmetic
Authors:
Paul Breiding,
Kemal Rose,
Sascha Timme
Abstract:
We establish interval arithmetic as a practical tool for certification in numerical algebraic geometry. Our software HomotopyContinuation.jl now has a built-in function certify, which proves the correctness of an isolated nonsingular solution to a square system of polynomial equations. The implementation rests on Krawczyk's method. We demonstrate that it dramatically outperforms earlier approaches…
▽ More
We establish interval arithmetic as a practical tool for certification in numerical algebraic geometry. Our software HomotopyContinuation.jl now has a built-in function certify, which proves the correctness of an isolated nonsingular solution to a square system of polynomial equations. The implementation rests on Krawczyk's method. We demonstrate that it dramatically outperforms earlier approaches to certification. We see this contribution as powerful new tool in numerical algebraic geometry, that can make certification the default and not just an option.
△ Less
Submitted 22 May, 2024; v1 submitted 10 November, 2020;
originally announced November 2020.
-
An algebraic geometry perspective on topological data analysis
Authors:
Paul Breiding
Abstract:
A short survey on applications of algebraic geometry in topological data analysis.
A short survey on applications of algebraic geometry in topological data analysis.
△ Less
Submitted 6 January, 2020;
originally announced January 2020.
-
The condition number of Riemannian approximation problems
Authors:
Paul Breiding,
Nick Vannieuwenhoven
Abstract:
We consider the local sensitivity of least-squares formulations of inverse problems. The sets of inputs and outputs of these problems are assumed to have the structures of Riemannian manifolds. The problems we consider include the approximation problem of finding the nearest point on a Riemannian embedded submanifold from a given point in the ambient space. We characterize the first-order sensitiv…
▽ More
We consider the local sensitivity of least-squares formulations of inverse problems. The sets of inputs and outputs of these problems are assumed to have the structures of Riemannian manifolds. The problems we consider include the approximation problem of finding the nearest point on a Riemannian embedded submanifold from a given point in the ambient space. We characterize the first-order sensitivity, i.e., condition number, of local minimizers and critical points to arbitrary perturbations of the input of the least-squares problem. This condition number involves the Weingarten map of the input manifold, which measures the amount by which the input manifold curves in its ambient space. We validate our main results through experiments with the $n$-camera triangulation problem in computer vision.
△ Less
Submitted 7 December, 2020; v1 submitted 26 September, 2019;
originally announced September 2019.
-
Quantitative singularity theory for random polynomials
Authors:
Paul Breiding,
Hanieh Keneshlou,
Antonio Lerario
Abstract:
Motivated by Hilbert's 16th problem we discuss the probabilities of topological features of a system of random homogeneous polynomials. The distribution for the polynomials is the Kostlan distribution. The topological features we consider are type-$W$ singular loci. This is a term that we introduce and that is defined by a list of equalities and inequalities on the derivatives of the polynomials.…
▽ More
Motivated by Hilbert's 16th problem we discuss the probabilities of topological features of a system of random homogeneous polynomials. The distribution for the polynomials is the Kostlan distribution. The topological features we consider are type-$W$ singular loci. This is a term that we introduce and that is defined by a list of equalities and inequalities on the derivatives of the polynomials. In technical terms a type-$W$ singular locus is the set of points where the jet of the Kostlan polynomials belongs to a semialgebraic subset $W$ of the jet space, which we require to be invariant under orthogonal change of variables. For instance, the zero set of polynomial functions or the set of critical points fall under this definition.
We will show that, with overwhelming probability, the type-$W$ singular locus of a Kostlan polynomial is ambient isotopic to that of a polynomial of lower degree. As a crucial result, this implies that complicated topological configurations are rare. Our results extend earlier results from Diatta and Lerario who considered the special case of the zero set of a single polynomial. Furthermore, for a given polynomial function $p$ we provide a deterministic bound for the radius of the ball in the space of differentiable functions with center $p$, in which the $W$-singularity structure is constant.
△ Less
Submitted 20 August, 2020; v1 submitted 24 September, 2019;
originally announced September 2019.
-
The average condition number of most tensor rank decomposition problems is infinite
Authors:
Carlos Beltrán,
Paul Breiding,
Nick Vannieuwenhoven
Abstract:
The tensor rank decomposition, or canonical polyadic decomposition, is the decomposition of a tensor into a sum of rank-1 tensors. The condition number of the tensor rank decomposition measures the sensitivity of the rank-1 summands with respect to structured perturbations. Those are perturbations preserving the rank of the tensor that is decomposed. On the other hand, the angular condition number…
▽ More
The tensor rank decomposition, or canonical polyadic decomposition, is the decomposition of a tensor into a sum of rank-1 tensors. The condition number of the tensor rank decomposition measures the sensitivity of the rank-1 summands with respect to structured perturbations. Those are perturbations preserving the rank of the tensor that is decomposed. On the other hand, the angular condition number measures the perturbations of the rank-1 summands up to scaling.
We show for random rank-2 tensors that the expected value of the condition number is infinite for a wide range of choices of the density. Under a mild additional assumption, we show that the same is true for most higher ranks $r\geq 3$ as well. In fact, as the dimensions of the tensor tend to infinity, asymptotically all ranks are covered by our analysis. On the contrary, we show that rank-2 tensors have finite expected angular condition number. Based on numerical experiments, we conjecture that this could also be true for higher ranks.
Our results underline the high computational complexity of computing tensor rank decompositions. We discuss consequences of our results for algorithm design and for testing algorithms computing tensor rank decompositions.
△ Less
Submitted 20 September, 2022; v1 submitted 13 March, 2019;
originally announced March 2019.
-
3264 Conics in a Second
Authors:
Paul Breiding,
Bernd Sturmfels,
Sascha Timme
Abstract:
Enumerative algebraic geometry counts the solutions to certain geometric constraints. Numerical algebraic geometry determines these solutions for any given instance. This article illustrates how these two fields complement each other. Our focus lies on the 3264 conics that are tangent to five given conics in the plane. We present a web interface for computing them. It uses the software HomotopyCon…
▽ More
Enumerative algebraic geometry counts the solutions to certain geometric constraints. Numerical algebraic geometry determines these solutions for any given instance. This article illustrates how these two fields complement each other. Our focus lies on the 3264 conics that are tangent to five given conics in the plane. We present a web interface for computing them. It uses the software HomotopyContinuation.jl, which makes this process fast and reliable. We discuss an instance where all 3264 solutions are real.
△ Less
Submitted 5 September, 2019; v1 submitted 14 February, 2019;
originally announced February 2019.
-
Random points on an algebraic manifold
Authors:
Paul Breiding,
Orlando Marigliano
Abstract:
Consider the set of solutions to a system of polynomial equations in many variables. An algebraic manifold is an open submanifold of such a set. We introduce a new method for computing integrals and sampling from distributions on algebraic manifolds. This method is based on intersecting with random linear spaces. It produces i.i.d. samples, works in the presence of multiple connected components, a…
▽ More
Consider the set of solutions to a system of polynomial equations in many variables. An algebraic manifold is an open submanifold of such a set. We introduce a new method for computing integrals and sampling from distributions on algebraic manifolds. This method is based on intersecting with random linear spaces. It produces i.i.d. samples, works in the presence of multiple connected components, and is simple to implement. We present applications to computational statistical physics and topological data analysis.
△ Less
Submitted 9 March, 2020; v1 submitted 15 October, 2018;
originally announced October 2018.
-
On the geometry of the set of symmetric matrices with repeated eigenvalues
Authors:
Paul Breiding,
Khazhgali Kozhasov,
Antonio Lerario
Abstract:
We investigate some geometric properties of the real algebraic variety $Δ$ of symmetric matrices with repeated eigenvalues. We explicitly compute the volume of its intersection with the sphere and prove a Eckart-Young-Mirsky-type theorem for the distance function from a generic matrix to points in $Δ$. We exhibit connections of our study to Real Algebraic Geometry (computing the Euclidean Distance…
▽ More
We investigate some geometric properties of the real algebraic variety $Δ$ of symmetric matrices with repeated eigenvalues. We explicitly compute the volume of its intersection with the sphere and prove a Eckart-Young-Mirsky-type theorem for the distance function from a generic matrix to points in $Δ$. We exhibit connections of our study to Real Algebraic Geometry (computing the Euclidean Distance Degree of $Δ$) and Random Matrix Theory.
△ Less
Submitted 17 July, 2018; v1 submitted 12 July, 2018;
originally announced July 2018.
-
Pencil-based algorithms for tensor rank decomposition are not stable
Authors:
Carlos Beltrán,
Paul Breiding,
Nick Vannieuwenhoven
Abstract:
We prove the existence of an open set of $n_1\times n_2 \times n_3$ tensors of rank $r$ on which a popular and efficient class of algorithms for computing tensor rank decompositions based on a reduction to a linear matrix pencil, typically followed by a generalized eigendecomposition, is arbitrarily numerically forward unstable. Our analysis shows that this problem is caused by the fact that the c…
▽ More
We prove the existence of an open set of $n_1\times n_2 \times n_3$ tensors of rank $r$ on which a popular and efficient class of algorithms for computing tensor rank decompositions based on a reduction to a linear matrix pencil, typically followed by a generalized eigendecomposition, is arbitrarily numerically forward unstable. Our analysis shows that this problem is caused by the fact that the condition number of the tensor rank decomposition can be much larger for $n_1 \times n_2 \times 2$ tensors than for the $n_1\times n_2 \times n_3$ input tensor. Moreover, we present a lower bound for the limiting distribution of the condition number of random tensor rank decompositions of third-order tensors. The numerical experiments illustrate that for random tensor rank decompositions one should anticipate a loss of precision of a few digits.
△ Less
Submitted 11 July, 2018;
originally announced July 2018.
-
Learning Algebraic Varieties from Samples
Authors:
Paul Breiding,
Sara Kalisnik Verovsek,
Bernd Sturmfels,
Madeleine Weinstein
Abstract:
We seek to determine a real algebraic variety from a fixed finite subset of points. Existing methods are studied and new methods are developed. Our focus lies on aspects of topology and algebraic geometry, such as dimension and defining polynomials. All algorithms are tested on a range of datasets and made available in a Julia package.
We seek to determine a real algebraic variety from a fixed finite subset of points. Existing methods are studied and new methods are developed. Our focus lies on aspects of topology and algebraic geometry, such as dimension and defining polynomials. All algorithms are tested on a range of datasets and made available in a Julia package.
△ Less
Submitted 16 August, 2018; v1 submitted 26 February, 2018;
originally announced February 2018.
-
On the average condition number of tensor rank decompositions
Authors:
Paul Breiding,
Nick Vannieuwenhoven
Abstract:
We compute the expected value of powers of the geometric condition number of random tensor rank decompositions. It is shown in particular that the expected value of the condition number of $n_1\times n_2 \times 2$ tensors with a random rank-$r$ decomposition, given by factor matrices with independent and identically distributed standard normal entries, is infinite. This entails that it is expected…
▽ More
We compute the expected value of powers of the geometric condition number of random tensor rank decompositions. It is shown in particular that the expected value of the condition number of $n_1\times n_2 \times 2$ tensors with a random rank-$r$ decomposition, given by factor matrices with independent and identically distributed standard normal entries, is infinite. This entails that it is expected and probable that such a rank-$r$ decomposition is sensitive to perturbations of the tensor. Moreover, it provides concrete further evidence that tensor decomposition can be a challenging problem, also from the numerical point of view. On the other hand, we provide strong theoretical and empirical evidence that tensors of size $n_1~\times~n_2~\times~n_3$ with all $n_1,n_2,n_3 \ge 3$ have a finite average condition number. This suggests there exists a gap in the expected sensitivity of tensors between those of format $n_1\times n_2 \times 2$ and other order-3 tensors. For establishing these results, we show that a natural weighted distance from a tensor rank decomposition to the locus of ill-posed decompositions with an infinite geometric condition number is bounded from below by the inverse of this condition number. That is, we prove one inequality towards a so-called condition number theorem for the tensor rank decomposition.
△ Less
Submitted 2 January, 2019; v1 submitted 5 January, 2018;
originally announced January 2018.
-
HomotopyContinuation.jl: A package for homotopy continuation in Julia
Authors:
Paul Breiding,
Sascha Timme
Abstract:
We present the Julia package HomotopyContinuation.jl, which provides an algorithmic framework for solving polynomial systems by numerical homotopy continuation. We introduce the basic capabilities of the package and demonstrate the software on an illustrative example. We motivate our choice of Julia and how its features allow us to improve upon existing software packages with respect to usability,…
▽ More
We present the Julia package HomotopyContinuation.jl, which provides an algorithmic framework for solving polynomial systems by numerical homotopy continuation. We introduce the basic capabilities of the package and demonstrate the software on an illustrative example. We motivate our choice of Julia and how its features allow us to improve upon existing software packages with respect to usability, modularity and performance. Furthermore, we compare the performance of HomotopyContinuation.jl to the existing packages Bertini and PHCpack.
△ Less
Submitted 30 May, 2018; v1 submitted 28 November, 2017;
originally announced November 2017.
-
Random spectrahedra
Authors:
Paul Breiding,
Khazhgali Kozhasov,
Antonio Lerario
Abstract:
Spectrahedra are affine-linear sections of the cone $\mathcal{P}_n$ of positive semidefinite symmetric $n\times n$-matrices. We consider random spectrahedra that are obtained by intersecting~$\mathcal{P}_n$ with the affine-linear space $\mathbf{1} + V$, where $\mathbf{1}$ is the identity matrix and $V$ is an $\ell$-dimensional linear space that is chosen from the unique orthogonally invariant prob…
▽ More
Spectrahedra are affine-linear sections of the cone $\mathcal{P}_n$ of positive semidefinite symmetric $n\times n$-matrices. We consider random spectrahedra that are obtained by intersecting~$\mathcal{P}_n$ with the affine-linear space $\mathbf{1} + V$, where $\mathbf{1}$ is the identity matrix and $V$ is an $\ell$-dimensional linear space that is chosen from the unique orthogonally invariant probability measure on the Grassmanian of $\ell$-planes in the space of $n\times n$ real symmetric matrices (endowed with the Frobenius inner product). Motivated by applications, for $\ell=3$ we relate the average number $\mathbb{E} σ_n$ of singular points on the boundary of a three-dimensional spectrahedron to the volume of the set of symmetric matrices whose two smallest eigenvalues coincide. In the case of quartic spectrahedra ($n=4$) we show that $\mathbb{E} σ_4 = 6-\frac{4}{\sqrt{3}}$. Moreover, we prove that the average number $\mathbb{E} ρ_n$ of singular points on the real variety of singular matrices in $\mathbf{1} + V$ is $n(n-1)$. This quantity is related to the volume of the variety of real symmetric matrices with repeated eigenvalues. Furthermore, we compute the asymptotics of the volume and the volume of the boundary of a random spectrahedron.
△ Less
Submitted 17 September, 2019; v1 submitted 22 November, 2017;
originally announced November 2017.
-
A Riemannian Trust Region Method for the Canonical Tensor Rank Approximation Problem
Authors:
Paul Breiding,
Nick Vannieuwenhoven
Abstract:
The canonical tensor rank approximation problem (TAP) consists of approximating a real-valued tensor by one of low canonical rank, which is a challenging non-linear, non-convex, constrained optimization problem, where the constraint set forms a non-smooth semi-algebraic set. We introduce a Riemannian Gauss-Newton method with trust region for solving small-scale, dense TAPs. The novelty of our appr…
▽ More
The canonical tensor rank approximation problem (TAP) consists of approximating a real-valued tensor by one of low canonical rank, which is a challenging non-linear, non-convex, constrained optimization problem, where the constraint set forms a non-smooth semi-algebraic set. We introduce a Riemannian Gauss-Newton method with trust region for solving small-scale, dense TAPs. The novelty of our approach is threefold. First, we parametrize the constraint set as the Cartesian product of Segre manifolds, hereby formulating the TAP as a Riemannian optimization problem, and we argue why this parametrization is among the theoretically best possible. Second, an original ST-HOSVD-based retraction operator is proposed. Third, we introduce a hot restart mechanism that efficiently detects when the optimization process is tending to an ill-conditioned tensor rank decomposition and which often yields a quick escape path from such spurious decompositions. Numerical experiments show improvements of up to three orders of magnitude in terms of the expected time to compute a successful solution over existing state-of-the-art methods.
△ Less
Submitted 11 July, 2018; v1 submitted 31 August, 2017;
originally announced September 2017.
-
Convergence analysis of Riemannian Gauss-Newton methods and its connection with the geometric condition number
Authors:
Paul Breiding,
Nick Vannieuwenhoven
Abstract:
We obtain estimates of the multiplicative constants appearing in local convergence results of the Riemannian Gauss-Newton method for least squares problems on manifolds and relate them to the geometric condition number of [P. Bürgisser and F. Cucker, Condition: The Geometry of Numerical Algorithms, 2013].
We obtain estimates of the multiplicative constants appearing in local convergence results of the Riemannian Gauss-Newton method for least squares problems on manifolds and relate them to the geometric condition number of [P. Bürgisser and F. Cucker, Condition: The Geometry of Numerical Algorithms, 2013].
△ Less
Submitted 16 October, 2017; v1 submitted 8 August, 2017;
originally announced August 2017.
-
How Many Eigenvalues of a Random Symmetric Tensor are Real?
Authors:
Paul Breiding
Abstract:
This article answers a question posed by Draisma and Horobet, who asked for a closed formula for the expected number of real eigenvalues of a random real symmetric tensor drawn from the Gaussian distribution relative to the Bombieri norm. This expected value is equal to the expected number of real critical points on the unit sphere of a Kostlan polynomial. We also derive an exact formula for the e…
▽ More
This article answers a question posed by Draisma and Horobet, who asked for a closed formula for the expected number of real eigenvalues of a random real symmetric tensor drawn from the Gaussian distribution relative to the Bombieri norm. This expected value is equal to the expected number of real critical points on the unit sphere of a Kostlan polynomial. We also derive an exact formula for the expected absolute value of the determinant of a matrix from the Gaussian Orthogonal Ensemble.
△ Less
Submitted 13 February, 2019; v1 submitted 25 January, 2017;
originally announced January 2017.
-
The condition number of join decompositions
Authors:
Paul Breiding,
Nick Vannieuwenhoven
Abstract:
The join set of a finite collection of smooth embedded submanifolds of a mutual vector space is defined as their Minkowski sum. Join decompositions generalize some ubiquitous decompositions in multilinear algebra, namely tensor rank, Waring, partially symmetric rank and block term decompositions. This paper examines the numerical sensitivity of join decompositions to perturbations; specifically, w…
▽ More
The join set of a finite collection of smooth embedded submanifolds of a mutual vector space is defined as their Minkowski sum. Join decompositions generalize some ubiquitous decompositions in multilinear algebra, namely tensor rank, Waring, partially symmetric rank and block term decompositions. This paper examines the numerical sensitivity of join decompositions to perturbations; specifically, we consider the condition number for general join decompositions. It is characterized as a distance to a set of ill-posed points in a supplementary product of Grassmannians. We prove that this condition number can be computed efficiently as the smallest singular value of an auxiliary matrix. For some special join sets, we characterized the behavior of sequences in the join set converging to the latter's boundary points. Finally, we specialize our discussion to the tensor rank and Waring decompositions and provide several numerical experiments confirming the key results.
△ Less
Submitted 14 May, 2018; v1 submitted 24 November, 2016;
originally announced November 2016.
-
The expected number of Z-eigenvalues of a real gaussian tensor
Authors:
Paul Breiding
Abstract:
A real number $λ$ is called a Z-eigenvalue of a tensor $A$, if $λ$ is an eigenvalue of $A$ and the corresponding eigenvector $v$ is real and satisfies $v^Tv=1$. In this paper we compute the expected number of Z-eigenvalues of a real gaussian tensor and its asymptotic behaviour. Here we call a tensor $A=(A_{i_0,\ldots,i_{d}}) \in\mathbb{R}^{n^{d+1}}$ gaussian, when the $A_{i_0,\ldots,i_{d}}$ are ce…
▽ More
A real number $λ$ is called a Z-eigenvalue of a tensor $A$, if $λ$ is an eigenvalue of $A$ and the corresponding eigenvector $v$ is real and satisfies $v^Tv=1$. In this paper we compute the expected number of Z-eigenvalues of a real gaussian tensor and its asymptotic behaviour. Here we call a tensor $A=(A_{i_0,\ldots,i_{d}}) \in\mathbb{R}^{n^{d+1}}$ gaussian, when the $A_{i_0,\ldots,i_{d}}$ are centered gaussian random variables with variance $σ^2= 1$.
△ Less
Submitted 23 January, 2017; v1 submitted 13 April, 2016;
originally announced April 2016.
-
An efficient randomized homotopy method to approximate eigenpairs of tensors
Authors:
Paul Breiding
Abstract:
Let $A \in (\mathbb{C}^{n})^{\otimes p}$ be a complex tensor of order $p$. The pair $(v,η)\in\mathbb{C}^n\times \mathbb{C}$ is called an h-eigenpair of $A$, if $v\neq0$ and it satisfies $Av^{p-1}=η^{p-2} v$, where $Av^{p-1}$ is the contraction of $A$ by $v$ in all but the first modes. We describe a randomized algorithm to compute approximations of h-eigenpairs of complex tensors. Assuming random i…
▽ More
Let $A \in (\mathbb{C}^{n})^{\otimes p}$ be a complex tensor of order $p$. The pair $(v,η)\in\mathbb{C}^n\times \mathbb{C}$ is called an h-eigenpair of $A$, if $v\neq0$ and it satisfies $Av^{p-1}=η^{p-2} v$, where $Av^{p-1}$ is the contraction of $A$ by $v$ in all but the first modes. We describe a randomized algorithm to compute approximations of h-eigenpairs of complex tensors. Assuming random input, the average number of arithmetic operations it performs is polynomially bounded in the input size.
△ Less
Submitted 11 January, 2018; v1 submitted 10 December, 2015;
originally announced December 2015.
-
Distribution of the eigenvalues of a random system of homogeneous polynomials
Authors:
Paul Breiding,
Peter Bürgisser
Abstract:
Let $f=(f_1,\ldots,f_n)$ be a system of $n$ complex homogeneous polynomials in $n$ variables of degree $d$. We call $λ\in\mathbb{C}$ an eigenvalue of $f$ if there exists $v\in\mathbb{C}^n\backslash\{0\}$ with $f(v)=λv$, generalizing the case of eigenvalues of matrices ($d=1$). We derive the distribution of $λ$ when the $f_i$ are independently chosen at random according to the unitary invariant Wey…
▽ More
Let $f=(f_1,\ldots,f_n)$ be a system of $n$ complex homogeneous polynomials in $n$ variables of degree $d$. We call $λ\in\mathbb{C}$ an eigenvalue of $f$ if there exists $v\in\mathbb{C}^n\backslash\{0\}$ with $f(v)=λv$, generalizing the case of eigenvalues of matrices ($d=1$). We derive the distribution of $λ$ when the $f_i$ are independently chosen at random according to the unitary invariant Weyl distribution and determine the limit distribution for $n\to\infty$.
△ Less
Submitted 3 February, 2016; v1 submitted 9 July, 2015;
originally announced July 2015.
