-
Quantum Lazy Training
Authors:
Erfan Abedi,
Salman Beigi,
Leila Taghavi
Abstract:
In the training of over-parameterized model functions via gradient descent, sometimes the parameters do not change significantly and remain close to their initial values. This phenomenon is called lazy training, and motivates consideration of the linear approximation of the model function around the initial parameters. In the lazy regime, this linear approximation imitates the behavior of the para…
▽ More
In the training of over-parameterized model functions via gradient descent, sometimes the parameters do not change significantly and remain close to their initial values. This phenomenon is called lazy training, and motivates consideration of the linear approximation of the model function around the initial parameters. In the lazy regime, this linear approximation imitates the behavior of the parameterized function whose associated kernel, called the tangent kernel, specifies the training performance of the model. Lazy training is known to occur in the case of (classical) neural networks with large widths. In this paper, we show that the training of geometrically local parameterized quantum circuits enters the lazy regime for large numbers of qubits. More precisely, we prove bounds on the rate of changes of the parameters of such a geometrically local parameterized quantum circuit in the training process, and on the precision of the linear approximation of the associated quantum model function; both of these bounds tend to zero as the number of qubits grows. We support our analytic results with numerical simulations.
△ Less
Submitted 20 April, 2023; v1 submitted 16 February, 2022;
originally announced February 2022.
-
Simplified Quantum Algorithm for the Oracle Identification Problem
Authors:
Leila Taghavi
Abstract:
In the oracle identification problem we have oracle access to bits of an unknown string $x$ of length $n$, with the promise that it belongs to a known set $C\subseteq\{0,1\}^n$. The goal is to identify $x$ using as few queries to the oracle as possible. We develop a quantum query algorithm for this problem with query complexity $O\left(\sqrt{\frac{n\log M }{\log(n/\log M)+1}}\right)$, where $M$ is…
▽ More
In the oracle identification problem we have oracle access to bits of an unknown string $x$ of length $n$, with the promise that it belongs to a known set $C\subseteq\{0,1\}^n$. The goal is to identify $x$ using as few queries to the oracle as possible. We develop a quantum query algorithm for this problem with query complexity $O\left(\sqrt{\frac{n\log M }{\log(n/\log M)+1}}\right)$, where $M$ is the size of $C$. This bound is already derived by Kothari in 2014, for which we provide a more elegant simpler proof.
△ Less
Submitted 8 September, 2021;
originally announced September 2021.
-
Time and Query Optimal Quantum Algorithms Based on Decision Trees
Authors:
Salman Beigi,
Leila Taghavi,
Artin Tajdini
Abstract:
It has recently been shown that starting with a classical query algorithm (decision tree) and a guessing algorithm that tries to predict the query answers, we can design a quantum algorithm with query complexity $O(\sqrt{GT})$ where $T$ is the query complexity of the classical algorithm (depth of the decision tree) and $G$ is the maximum number of wrong answers by the guessing algorithm [arXiv:141…
▽ More
It has recently been shown that starting with a classical query algorithm (decision tree) and a guessing algorithm that tries to predict the query answers, we can design a quantum algorithm with query complexity $O(\sqrt{GT})$ where $T$ is the query complexity of the classical algorithm (depth of the decision tree) and $G$ is the maximum number of wrong answers by the guessing algorithm [arXiv:1410.0932, arXiv:1905.13095]. In this paper we show that, given some constraints on the classical algorithms, this quantum algorithm can be implemented in time $\tilde O(\sqrt{GT})$. Our algorithm is based on non-binary span programs and their efficient implementation. We conclude that various graph theoretic problems including bipartiteness, cycle detection and topological sort can be solved in time $O(n^{3/2}\log n)$ and with $O(n^{3/2})$ quantum queries. Moreover, finding a maximal matching can be solved with $O(n^{3/2})$ quantum queries in time $O(n^{3/2}\log n)$, and maximum bipartite matching can be solved in time $O(n^2\log n)$.
△ Less
Submitted 16 October, 2022; v1 submitted 18 May, 2021;
originally announced May 2021.
-
Quantum Speedup Based on Classical Decision Trees
Authors:
Salman Beigi,
Leila Taghavi
Abstract:
Lin and Lin have recently shown how starting with a classical query algorithm (decision tree) for a function, we may find upper bounds on its quantum query complexity. More precisely, they have shown that given a decision tree for a function $f:\{0,1\}^n\to[m]$ whose input can be accessed via queries to its bits, and a guessing algorithm that predicts answers to the queries, there is a quantum que…
▽ More
Lin and Lin have recently shown how starting with a classical query algorithm (decision tree) for a function, we may find upper bounds on its quantum query complexity. More precisely, they have shown that given a decision tree for a function $f:\{0,1\}^n\to[m]$ whose input can be accessed via queries to its bits, and a guessing algorithm that predicts answers to the queries, there is a quantum query algorithm for $f$ which makes at most $O(\sqrt{GT})$ quantum queries where $T$ is the depth of the decision tree and $G$ is the maximum number of mistakes of the guessing algorithm. In this paper we give a simple proof of and generalize this result for functions $f:[\ell]^n \to [m]$ with non-binary input as well as output alphabets. Our main tool for this generalization is non-binary span program which has recently been developed for non-binary functions, and the dual adversary bound. As applications of our main result we present several quantum query upper bounds, some of which are new. In particular, we show that topological sorting of vertices of a directed graph $\mathcal{G}$ can be done with $O(n^{3/2})$ quantum queries in the adjacency matrix model. Also, we show that the quantum query complexity of the maximum bipartite matching is upper bounded by $O(n^{3/4}\sqrt m + n)$ in the adjacency list model.
△ Less
Submitted 28 February, 2020; v1 submitted 30 May, 2019;
originally announced May 2019.
-
Span Program for Non-binary Functions
Authors:
Salman Beigi,
Leila Taghavi
Abstract:
Span programs characterize the quantum query complexity of binary functions $f:\{0,\ldots,\ell\}^n \to \{0,1\}$ up to a constant factor. In this paper we generalize the notion of span programs for functions with non-binary input/output alphabets $f: [\ell]^n \to [m]$. We show that non-binary span program characterizes the quantum query complexity of any such function up to a constant factor. We ar…
▽ More
Span programs characterize the quantum query complexity of binary functions $f:\{0,\ldots,\ell\}^n \to \{0,1\}$ up to a constant factor. In this paper we generalize the notion of span programs for functions with non-binary input/output alphabets $f: [\ell]^n \to [m]$. We show that non-binary span program characterizes the quantum query complexity of any such function up to a constant factor. We argue that this non-binary span program is indeed the generalization of its binary counterpart.
We also generalize the notion of span programs for a special class of relations.
Learning graphs provide another tool for designing quantum query algorithms for binary functions. In this paper, we also generalize this tool for non-binary functions, and as an application of our non-binary span program show that any non-binary learning graph gives an upper bound on the quantum query complexity.
△ Less
Submitted 30 May, 2019; v1 submitted 7 May, 2018;
originally announced May 2018.
