-
Push-Pull Based Distributed Primal-Dual Algorithm for Coupled Constrained Convex Optimization in Multi-Agent Networks
Authors:
Kai Gong,
Liwei Zhang
Abstract:
This paper focuses on a distributed coupled constrained convex optimization problem over directed unbalanced and time-varying multi-agent networks, where the global objective function is the sum of all agents' private local objective functions, and decisions of all agents are subject to coupled equality and inequality constraints and a compact convex subset. In the multi-agent networks, each agent…
▽ More
This paper focuses on a distributed coupled constrained convex optimization problem over directed unbalanced and time-varying multi-agent networks, where the global objective function is the sum of all agents' private local objective functions, and decisions of all agents are subject to coupled equality and inequality constraints and a compact convex subset. In the multi-agent networks, each agent exchanges information with other neighboring agents. Finally, all agents reach a consensus on decisions, meanwhile achieving the goal of minimizing the global objective function under the given constraint conditions. For the purpose of protecting the information privacy of each agent, we first establish the saddle point problem of the constrained convex optimization problem considered in this article, then based on the push-pull method, develop a distributed primal-dual algorithm to solve the dual problem. Under Slater's condition, we will show that the sequence of points generated by the proposed algorithm converges to a saddle point of the Lagrange function. Moreover, we analyze the iteration complexity of the algorithm.
△ Less
Submitted 24 October, 2023;
originally announced October 2023.
-
Distributed Proximal-Correction Algorithm for the Sum of Maximal Monotone Operators in Multi-Agent Network
Authors:
Kai Gong,
Liwei Zhang
Abstract:
This paper focuses on a class of inclusion problems of maximal monotone operators in a multi-agent network, where each agent is characterized by an operator that is not available to any other agents, but the agents can cooperate by exchanging information with their neighbors according to a given communication topology. All agents aim at finding a common decision vector that is the solution to the…
▽ More
This paper focuses on a class of inclusion problems of maximal monotone operators in a multi-agent network, where each agent is characterized by an operator that is not available to any other agents, but the agents can cooperate by exchanging information with their neighbors according to a given communication topology. All agents aim at finding a common decision vector that is the solution to the sum of agents' operators. This class of problems is motivated by distributed convex optimization with coupled constraints. In this paper, we propose a distributed proximal point method with a cumulative correction term (named Proximal-Correction Algorithm) for this class of inclusion problems of operators. It's proved that the Proximal-Correction Algorithm converges for any value of a constant penalty parameter. In order to make the Proximal-Correction ALgorithm computationally implementable for a wide variety of distributed optimization problems, we adopt two inexact criteria for calculating the proximal steps of the algorithm. Under each of these two criteria, the convergence of Proximal-Correction Algorithm can be guaranteed, and the linear convergence rate is established when the stronger one is satisfied. In numerical simulations, both exact and inexact versions of Proximal-Correction Algorithm are executed for a distributed convex optimization problem with coupled constraints. Compared with several alternative algorithms in the literature, the exact and inexact versions of Proximal-Correction both exhibit good numerical performance.
△ Less
Submitted 24 October, 2023;
originally announced October 2023.
-
Decentralized Proximal Method of Multipliers for Convex Optimization with Coupled Constraints
Authors:
Kai Gong,
Liwei Zhang
Abstract:
In this paper, a decentralized proximal method of multipliers (DPMM) is proposed to solve constrained convex optimization problems over multi-agent networks, where the local objective of each agent is a general closed convex function, and the constraints are coupled equalities and inequalities. This algorithm strategically integrates the dual decomposition method and the proximal point algorithm.…
▽ More
In this paper, a decentralized proximal method of multipliers (DPMM) is proposed to solve constrained convex optimization problems over multi-agent networks, where the local objective of each agent is a general closed convex function, and the constraints are coupled equalities and inequalities. This algorithm strategically integrates the dual decomposition method and the proximal point algorithm. One advantage of DPMM is that subproblems can be solved inexactly and in parallel by agents at each iteration, which relaxes the restriction of requiring exact solutions to subproblems in many distributed constrained optimization algorithms. We show that the first-order optimality residual of the proposed algorithm decays to $0$ at a rate of $o(1/k)$ under general convexity. Furthermore, if a structural assumption for the considered optimization problem is satisfied, the sequence generated by DPMM converges linearly to an optimal solution. In numerical simulations, we compare DPMM with several existing algorithms using two examples to demonstrate its effectiveness.
△ Less
Submitted 24 October, 2023;
originally announced October 2023.
-
Large-System Insensitivity of Zero-Waiting Load Balancing Algorithms
Authors:
Xin Liu,
Kang Gong,
Lei Ying
Abstract:
This paper studies the sensitivity (or insensitivity) of a class of load balancing algorithms that achieve asymptotic zero-waiting in the sub-Halfin-Whitt regime, named LB-zero. Most existing results on zero-waiting load balancing algorithms assume the service time distribution is exponential. This paper establishes the {\em large-system insensitivity} of LB-zero for jobs whose service time follow…
▽ More
This paper studies the sensitivity (or insensitivity) of a class of load balancing algorithms that achieve asymptotic zero-waiting in the sub-Halfin-Whitt regime, named LB-zero. Most existing results on zero-waiting load balancing algorithms assume the service time distribution is exponential. This paper establishes the {\em large-system insensitivity} of LB-zero for jobs whose service time follows a Coxian distribution with a finite number of phases. This result suggests that LB-zero achieves asymptotic zero-waiting for a large class of service time distributions, which is confirmed in our simulations. To prove this result, this paper develops a new technique, called "Iterative State-Space Peeling" (or ISSP for short). ISSP first identifies an iterative relation between the upper and lower bounds on the queue states and then proves that the system lives near the fixed point of the iterative bounds with a high probability. Based on ISSP, the steady-state distribution of the system is further analyzed by applying Stein's method in the neighborhood of the fixed point. ISSP, like state-space collapse in heavy-traffic analysis, is a general approach that may be used to study other complex stochastic systems.
△ Less
Submitted 16 February, 2022;
originally announced February 2022.
-
Steady-State Analysis of Load Balancing with Coxian-$2$ Distributed Service Times
Authors:
Xin Liu,
Kang Gong,
Lei Ying
Abstract:
This paper studies load balancing for many-server ($N$ servers) systems. Each server has a buffer of size $b-1,$ and can have at most one job in service and $b-1$ jobs in the buffer. The service time of a job follows the Coxian-2 distribution. We focus on steady-state performance of load balancing policies in the heavy traffic regime such that the normalized load of system is $λ= 1 - N^{-α}$ for…
▽ More
This paper studies load balancing for many-server ($N$ servers) systems. Each server has a buffer of size $b-1,$ and can have at most one job in service and $b-1$ jobs in the buffer. The service time of a job follows the Coxian-2 distribution. We focus on steady-state performance of load balancing policies in the heavy traffic regime such that the normalized load of system is $λ= 1 - N^{-α}$ for $0<α<0.5.$ We identify a set of policies that achieve asymptotic zero waiting. The set of policies include several classical policies such as join-the-shortest-queue (JSQ), join-the-idle-queue (JIQ), idle-one-first (I1F) and power-of-$d$-choices (Po$d$) with $d=O(N^α\log N)$. The proof of the main result is based on Stein's method and state space collapse. A key technical contribution of this paper is the iterative state space collapse approach that leads to a simple generator approximation when applying Stein's method.
△ Less
Submitted 17 February, 2021; v1 submitted 19 May, 2020;
originally announced May 2020.
-
On power residues modulo a prime
Authors:
Ke Gong,
Chaohua Jia
Abstract:
Let $p$ be a sufficiently large prime number, $n$ be a positive odd integer with $n|\,p-1$ and $n>p^\varepsilon $, where $\varepsilon$ is a sufficiently small constant. Let $k(p,\,n)$ denote the least positive integer $k$ such that for $x=-k,\,\dots,\,-1,\,1,\,2,\,\dots,\,k$, the numbers $x^n\pmod p$ yield all the non-zero $n$-th power residues modulo $p$. In this paper, we shall prove…
▽ More
Let $p$ be a sufficiently large prime number, $n$ be a positive odd integer with $n|\,p-1$ and $n>p^\varepsilon $, where $\varepsilon$ is a sufficiently small constant. Let $k(p,\,n)$ denote the least positive integer $k$ such that for $x=-k,\,\dots,\,-1,\,1,\,2,\,\dots,\,k$, the numbers $x^n\pmod p$ yield all the non-zero $n$-th power residues modulo $p$. In this paper, we shall prove $$ k(p,\,n)=O(p^{1-δ}), $$ which improves a result of S. Chowla and H. London in the case of large $n$.
△ Less
Submitted 1 September, 2019; v1 submitted 27 August, 2019;
originally announced August 2019.
-
Shifted Character Sums with Multiplicative Coefficients, II
Authors:
K. Gong,
C. Jia,
M. A. Korolev
Abstract:
Let $f(n)$ be a multiplicative function with $|f(n)|\leq 1, q$ be a prime number and $a$ be an integer with $(a, q)=1, χ$ be a non-principal Dirichlet character modulo $q$. Let $\varepsilon$ be a sufficiently small positive constant, $A$ be a large constant, $q^{\frac12+\varepsilon}\ll N\ll q^A$. In this paper, we shall prove that $$ \sum_{n\leq N}f(n)χ(n+a)\ll N\frac{\log\log q}{\log q} $$ and th…
▽ More
Let $f(n)$ be a multiplicative function with $|f(n)|\leq 1, q$ be a prime number and $a$ be an integer with $(a, q)=1, χ$ be a non-principal Dirichlet character modulo $q$. Let $\varepsilon$ be a sufficiently small positive constant, $A$ be a large constant, $q^{\frac12+\varepsilon}\ll N\ll q^A$. In this paper, we shall prove that $$ \sum_{n\leq N}f(n)χ(n+a)\ll N\frac{\log\log q}{\log q} $$ and that $$ \sum_{n\leq N}f(n)χ(n+a_1)\cdotsχ(n+a_t)\ll N\frac{\log\log q}{\log q}, $$ where $t\geq 2, a_1, \ldots, a_t$ are distinct integers modulo $q$.
△ Less
Submitted 20 November, 2016;
originally announced November 2016.
-
Shifted Character Sums with Multiplicative Coefficients
Authors:
Ke Gong,
Chaohua Jia
Abstract:
Let $f(n)$ be a multiplicative function satisfying $|f(n)|\leq 1$, $q$ $(\leq N^2)$ be a prime number and $a$ be an integer with $(a,\,q)=1$, $χ$ be a non-principal Dirichlet character modulo $q$. In this paper, we shall prove that $$ \sum_{n\leq N}f(n)χ(n+a)\ll {N\over q^{1\over 4}}\log\log(6N)+q^{1\over 4}N^{1\over 2}\log(6N)+{N\over \sqrt{\log\log(6N)}}. $$
We shall also prove that \begin{ali…
▽ More
Let $f(n)$ be a multiplicative function satisfying $|f(n)|\leq 1$, $q$ $(\leq N^2)$ be a prime number and $a$ be an integer with $(a,\,q)=1$, $χ$ be a non-principal Dirichlet character modulo $q$. In this paper, we shall prove that $$ \sum_{n\leq N}f(n)χ(n+a)\ll {N\over q^{1\over 4}}\log\log(6N)+q^{1\over 4}N^{1\over 2}\log(6N)+{N\over \sqrt{\log\log(6N)}}. $$
We shall also prove that \begin{align*} &\sum_{n\leq N}f(n)χ(n+a_1)\cdotsχ(n+a_t)\ll {N\over q^{1\over 4}}\log\log(6N)\\ &\quad+q^{1\over 4}N^{1\over 2}\log(6N)+{N\over \sqrt{\log\log(6N)}}, \end{align*} where $t\geq 2$, $a_1,\,\cdots,\,a_t$ are pairwise distinct integers modulo $q$.
△ Less
Submitted 2 July, 2014; v1 submitted 8 April, 2014;
originally announced April 2014.
-
An elementary approach to character sums over multiplicative subgroups
Authors:
Ke Gong
Abstract:
Let $p$ be an odd prime. Using I. M. Vinogradov's bilinear estimate, we present an elementary approach to estimate nontrivially the character sum $$ \sum_{x\in H}χ(x+a),\qquad a\in\Bbb F_p^*, $$ where $H<\Bbb F_p^*$ is a multiplicative subgroup in finite prime field $\Bbb F_p$. Some interesting mean-value estimates are also provided.
Let $p$ be an odd prime. Using I. M. Vinogradov's bilinear estimate, we present an elementary approach to estimate nontrivially the character sum $$ \sum_{x\in H}χ(x+a),\qquad a\in\Bbb F_p^*, $$ where $H<\Bbb F_p^*$ is a multiplicative subgroup in finite prime field $\Bbb F_p$. Some interesting mean-value estimates are also provided.
△ Less
Submitted 18 January, 2014;
originally announced January 2014.
-
Kloosterman Sums with Multiplicative Coefficients
Authors:
Ke Gong,
Chaohua Jia
Abstract:
Let $f(n)$ be a multiplicative function satisfying $|f(n)|\leq 1$, $q$ $(\leq N^2)$ be a positive integer and $a$ be an integer with $(a,\,q)=1$. In this paper, we shall prove that $$\sum_{\substack{n\leq N\\ (n,\,q)=1}}f(n)e({a\bar{n}\over q})\ll\sqrt{τ(q)\over q}N\log\log(6N)+q^{{1\over 4}+{ε\over 2}}N^{1\over 2}(\log(6N))^{1\over 2}+{N\over \sqrt{\log\log(6N)}},$$ where $\bar{n}$ is the multipl…
▽ More
Let $f(n)$ be a multiplicative function satisfying $|f(n)|\leq 1$, $q$ $(\leq N^2)$ be a positive integer and $a$ be an integer with $(a,\,q)=1$. In this paper, we shall prove that $$\sum_{\substack{n\leq N\\ (n,\,q)=1}}f(n)e({a\bar{n}\over q})\ll\sqrt{τ(q)\over q}N\log\log(6N)+q^{{1\over 4}+{ε\over 2}}N^{1\over 2}(\log(6N))^{1\over 2}+{N\over \sqrt{\log\log(6N)}},$$ where $\bar{n}$ is the multiplicative inverse of $n$ such that $\bar{n}n\equiv 1\,({\rm mod}\,q),\,e(x)=\exp(2πix),\,τ(q)$ is the divisor function.
△ Less
Submitted 13 March, 2014; v1 submitted 18 January, 2014;
originally announced January 2014.
-
Power moments of Kloosterman sums
Authors:
Ke Gong,
Willem Veys,
Daqing Wan
Abstract:
In this paper we give an essential treatment for estimating arbitrary integral power moments of Kloosterman sums over the residue class ring. For prime moduli we derive explicit estimates, and for prime-power moduli we prove concrete formulas using computations with Igusa zeta functions.
In this paper we give an essential treatment for estimating arbitrary integral power moments of Kloosterman sums over the residue class ring. For prime moduli we derive explicit estimates, and for prime-power moduli we prove concrete formulas using computations with Igusa zeta functions.
△ Less
Submitted 19 February, 2016; v1 submitted 18 June, 2013;
originally announced June 2013.
-
Partial Gaussian sums in finite fields
Authors:
Ke Gong
Abstract:
We generalize Burgess' results on partial Gaussian sums to arbitrary finite fields. The main ingredients are the classical method of amplification, two deep results on multiplicative energy for subsets in finite fields which are obtained respectively by the tools from additive combinatorics and geometry of numbers, and a technique of Chamizo for treating the difficulty caused by additive charact…
▽ More
We generalize Burgess' results on partial Gaussian sums to arbitrary finite fields. The main ingredients are the classical method of amplification, two deep results on multiplicative energy for subsets in finite fields which are obtained respectively by the tools from additive combinatorics and geometry of numbers, and a technique of Chamizo for treating the difficulty caused by additive character. Our results include the recent works on character sums in finite fields by M.-C. Chang and S. V. Konyagin.
△ Less
Submitted 3 February, 2010;
originally announced February 2010.
