-
Doubly relaxed forward-Douglas--Rachford splitting for the sum of two nonconvex and a DC function
Authors:
Minh N. Dao,
Tan Nhat Pham,
Phan Thanh Tung
Abstract:
In this paper, we consider a class of structured nonconvex nonsmooth optimization problems whose objective function is the sum of three nonconvex functions, one of which is expressed in a difference-of-convex (DC) form. This problem class covers several important structures in the literature including the sum of three functions and the general DC program. We propose a splitting algorithm and prove…
▽ More
In this paper, we consider a class of structured nonconvex nonsmooth optimization problems whose objective function is the sum of three nonconvex functions, one of which is expressed in a difference-of-convex (DC) form. This problem class covers several important structures in the literature including the sum of three functions and the general DC program. We propose a splitting algorithm and prove the subsequential convergence to a stationary point of the problem. The full sequential convergence, along with convergence rates for both the iterates and objective function values, is then established without requiring differentiability of the concave part. Our analysis not only extends but also unifies and improves recent convergence analyses in nonconvex settings. We benchmark our proposed algorithm with notable algorithms in the literature to show its competitiveness on both synthetic data and real power system load data.
△ Less
Submitted 14 May, 2024;
originally announced May 2024.
-
Joint User Association and Power Control for Cell-Free Massive MIMO
Authors:
Chongzheng Hao,
Tung Thanh Vu,
Hien Quoc Ngo,
Minh N. Dao,
Xiaoyu Dang,
Chenghua Wang,
Michail Matthaiou
Abstract:
This work proposes novel approaches that jointly design user equipment (UE) association and power control (PC) in a downlink user-centric cell-free massive multiple-input multiple-output (CFmMIMO) network, where each UE is only served by a set of access points (APs) for reducing the fronthaul signalling and computational complexity. In order to maximize the sum spectral efficiency (SE) of the UEs,…
▽ More
This work proposes novel approaches that jointly design user equipment (UE) association and power control (PC) in a downlink user-centric cell-free massive multiple-input multiple-output (CFmMIMO) network, where each UE is only served by a set of access points (APs) for reducing the fronthaul signalling and computational complexity. In order to maximize the sum spectral efficiency (SE) of the UEs, we formulate a mixed-integer nonconvex optimization problem under constraints on the per-AP transmit power, quality-of-service rate requirements, maximum fronthaul signalling load, and maximum number of UEs served by each AP. In order to solve the formulated problem efficiently, we propose two different schemes according to the different sizes of the CFmMIMO systems. For small-scale CFmMIMO systems, we present a successive convex approximation (SCA) method to obtain a stationary solution and also develop a learning-based method (JointCFNet) to reduce the computational complexity. For large-scale CFmMIMO systems, we propose a low-complexity suboptimal algorithm using accelerated projected gradient (APG) techniques. Numerical results show that our JointCFNet can yield similar performance and significantly decrease the run time compared with the SCA algorithm in small-scale systems. The presented APG approach is confirmed to run much faster than the SCA algorithm in the large-scale system while obtaining an SE performance close to that of the SCA approach. Moreover, the median sum SE of the APG method is up to about 2.8 fold higher than that of the heuristic baseline scheme.
△ Less
Submitted 20 May, 2024; v1 submitted 5 January, 2024;
originally announced January 2024.
-
Bregman Proximal Linearized ADMM for Minimizing Separable Sums Coupled by a Difference of Functions
Authors:
Tan Nhat Pham,
Minh N. Dao,
Andrew Eberhard,
Nargiz Sultanova
Abstract:
In this paper, we develop a splitting algorithm incorporating Bregman distances to solve a broad class of linearly constrained composite optimization problems, whose objective function is the separable sum of possibly nonconvex nonsmooth functions and a smooth function, coupled by a difference of functions. This structure encapsulates numerous significant nonconvex and nonsmooth optimization probl…
▽ More
In this paper, we develop a splitting algorithm incorporating Bregman distances to solve a broad class of linearly constrained composite optimization problems, whose objective function is the separable sum of possibly nonconvex nonsmooth functions and a smooth function, coupled by a difference of functions. This structure encapsulates numerous significant nonconvex and nonsmooth optimization problems in the current literature including the linearly constrained difference-of-convex problems. Relying on the successive linearization and alternating direction method of multipliers (ADMM), the proposed algorithm exhibits the global subsequential convergence to a stationary point of the underlying problem. We also establish the convergence of the full sequence generated by our algorithm under the Kurdyka-Lojasiewicz property and some mild assumptions. The efficiency of the proposed algorithm is tested on a robust principal component analysis problem and a nonconvex optimal power flow problem.
△ Less
Submitted 4 January, 2024;
originally announced January 2024.
-
Optimizing carbon dioxide trap** for geological storage
Authors:
Jaione Tirapu Azpiroz,
Ronaldo Giro,
Rodrigo Neumann Barros Ferreira,
Marcio Nogueira Pereira da Silva,
Manuela Fernandes Blanco Rodriguez,
Adolfo E. Correa Lopez,
David A. Lazo Vasquez,
Matheus Esteves Ferreira,
Mariana Del Grande,
Ademir Ferreira Da Silva,
Mathias B. Steiner
Abstract:
Carbon dioxide (CO2) trap** in capillary networks of reservoir rocks is a pathway to long-term geological storage. At pore scale, the CO2 trap** potential depends on injection pressure, temperature, and the rock's interaction with the surrounding fluids. Modeling this interaction requires adequate representations of both capillary volume and surface. For the lack of scalable representations, h…
▽ More
Carbon dioxide (CO2) trap** in capillary networks of reservoir rocks is a pathway to long-term geological storage. At pore scale, the CO2 trap** potential depends on injection pressure, temperature, and the rock's interaction with the surrounding fluids. Modeling this interaction requires adequate representations of both capillary volume and surface. For the lack of scalable representations, however, the prediction of a rock's CO2 storage potential has been challenging. Here, we report how to represent a rock's pore space by statistically sampled capillary networks (ssCN) that preserve morphological rock characteristics. We have used the ssCN method to simulate CO2 drainage within a representative sandstone sample at reservoir pressures and temperatures, exploring intermediate- and CO2-wet conditions. This wetting regime is often neglected, despite evidence of plausibility. By raising pressure and temperature we observe increasing CO2 penetration within the capillary network. For contact angles approaching 90 degrees, the CO2 saturation exhibits a pronounced maximum reaching 80 percent of the accessible pore volume. This is about twice as high as the saturation values reported previously. For enabling validation of our results and a broader application of our methodology, we have made available the rock tomography data, the digital rock computational workflows, and the ssCN models used in this study.
△ Less
Submitted 20 December, 2023;
originally announced December 2023.
-
Douglas--Rachford is the best projection method
Authors:
Minh N. Dao,
Mareike Dressler,
Hongzhi Liao,
Vera Roshchina
Abstract:
We prove that the Douglas--Rachford method applied to two closed convex cones in the Euclidean plane converges in finitely many steps if and only if the set of fixed points of the Douglas--Rachford operator is nontrivial. We analyze this special case using circle dynamics.
We also construct explicit examples for a broad family of projection methods for which the set of fixed points of the releva…
▽ More
We prove that the Douglas--Rachford method applied to two closed convex cones in the Euclidean plane converges in finitely many steps if and only if the set of fixed points of the Douglas--Rachford operator is nontrivial. We analyze this special case using circle dynamics.
We also construct explicit examples for a broad family of projection methods for which the set of fixed points of the relevant projection method operator is nontrivial, but the convergence is not finite. This three-parametric family is well known in the projection method literature and includes both the Douglas--Rachford method and the classic method of alternating projections.
Even though our setting is fairly elementary, this work contributes in a new way to the body of theoretical research justifying the superior performance of the Douglas--Rachford method compared to other techniques. Moreover, our result leads to a neat sufficient condition for finite convergence of the Douglas--Rachford method in the locally polyhedral case on the plane, unifying and expanding several special cases available in the literature.
△ Less
Submitted 25 October, 2023;
originally announced October 2023.
-
Full scale, microscopically resolved tomographies of sandstone and carbonate rocks augmented by experimental porosity and permeability values
Authors:
Matheus Esteves Ferreira,
Mariana Del Grande,
Rodrigo Neumann Barros Ferreira,
Ademir Ferreira da Silva,
Márcio Nogueira Pereira da Silva,
Jaione Tirapu-Azpiroz,
Everton Lucas-Oliveira,
Arthur Gustavo de Araújo Ferreira,
Renato Soares,
Christian B. Eckardt,
Tito J Bonagamba,
Mathias Steiner
Abstract:
We report a dataset containing full-scale, 3D images of rock plugs augmented by petrophysical lab characterization data for application in digital rock and capillary network analysis. Specifically, we have acquired microscopically resolved tomography datasets of 18 cylindrical sandstone and carbonate rock samples having lengths of 25.4 mm and diameters of 9.5 mm, respectively. Based on the micro-t…
▽ More
We report a dataset containing full-scale, 3D images of rock plugs augmented by petrophysical lab characterization data for application in digital rock and capillary network analysis. Specifically, we have acquired microscopically resolved tomography datasets of 18 cylindrical sandstone and carbonate rock samples having lengths of 25.4 mm and diameters of 9.5 mm, respectively. Based on the micro-tomography data, we have computed porosity-values for each imaged rock sample. For validating the computed porosity values with a complementary lab method, we have measured porosity for each rock sample by using standard petrophysical characterization techniques. Overall, the tomography-based porosity values agree with the measurement results obtained from the lab, with values ranging from 8% to 30%. In addition, we provide for each rock sample the experimental permeabilities, with values ranging from 0.4 mD to above 5D. This dataset will be essential for establishing, benchmarking, and referencing the relation between porosity and permeability of reservoir rock at pore scale.
△ Less
Submitted 21 December, 2022; v1 submitted 19 December, 2022;
originally announced December 2022.
-
Locating Theorems of Differential Inclusions Governed by Maximally Monotone Operators
Authors:
Minh N. Dao,
Hassan Saoud,
Michel Théra
Abstract:
In this paper, we are interested in studying the asymptotic behavior of the solutions of differential inclusions governed by maximally monotone operators. In the case where the LaSalle's invariance principle is inconclusive, we provide a refined version of the invariance principle theorem. This result derives from the problem of locating the $ω$-limit set of a bounded solution of the dynamic. In a…
▽ More
In this paper, we are interested in studying the asymptotic behavior of the solutions of differential inclusions governed by maximally monotone operators. In the case where the LaSalle's invariance principle is inconclusive, we provide a refined version of the invariance principle theorem. This result derives from the problem of locating the $ω$-limit set of a bounded solution of the dynamic. In addition, we propose an extension of LaSalle's invariance principle, which allows us to give a sharper location of the $ω$-limit set. The provided results are given in terms of nonsmooth Lyapunov pair-type functions.
△ Less
Submitted 25 August, 2023; v1 submitted 17 October, 2022;
originally announced October 2022.
-
A proximal subgradient algorithm with extrapolation for structured nonconvex nonsmooth problems
Authors:
Tan Nhat Pham,
Minh N. Dao,
Rakibuzzaman Shah,
Nargiz Sultanova,
Guoyin Li,
Syed Islam
Abstract:
In this paper, we consider a class of structured nonconvex nonsmooth optimization problems, in which the objective function is formed by the sum of a possibly nonsmooth nonconvex function and a differentiable function whose gradient is Lipschitz continuous, subtracted by a weakly convex function. This type of structured problems has many practical applications in machine learning and statistics su…
▽ More
In this paper, we consider a class of structured nonconvex nonsmooth optimization problems, in which the objective function is formed by the sum of a possibly nonsmooth nonconvex function and a differentiable function whose gradient is Lipschitz continuous, subtracted by a weakly convex function. This type of structured problems has many practical applications in machine learning and statistics such as compressed sensing, signal recovery, sparse dictionary learning, clustering, matrix factorization, and others. We develop a flexible extrapolated proximal subgradient algorithm for solving these problems with guaranteed subsequential convergence to a stationary point. The global convergence of the whole sequence generated by our algorithm is also established under the Kurdyka-Lojasiewicz property. To illustrate the promising numerical performance of the proposed algorithm, we conduct numerical experiments on two important nonconvex models. This includes a least squares problem with a nonconvex regularization and an optimal power flow problem with distributed energy resources.
△ Less
Submitted 18 March, 2023; v1 submitted 26 August, 2022;
originally announced August 2022.
-
Higher Multi-Courant Algebroids
Authors:
P. Antunes,
J. M. Nunes da Costa
Abstract:
The binary bracket of a Courant algebroid structure on $(E,\langle \cdot,\cdot \rangle)$ can be extended to a $n$-ary bracket on $Γ(E)$, yielding a multi-Courant algebroid. These $n$-ary brackets form a Poisson algebra and were defined, in an algebraic setting, by Keller and Waldmann. We construct a higher geometric version of Keller-Waldmann Poisson algebra and define higher multi-Courant algebro…
▽ More
The binary bracket of a Courant algebroid structure on $(E,\langle \cdot,\cdot \rangle)$ can be extended to a $n$-ary bracket on $Γ(E)$, yielding a multi-Courant algebroid. These $n$-ary brackets form a Poisson algebra and were defined, in an algebraic setting, by Keller and Waldmann. We construct a higher geometric version of Keller-Waldmann Poisson algebra and define higher multi-Courant algebroids. As Courant algebroid structures can be seen as degree $3$ functions on a graded symplectic manifold of degree $2$, higher multi-Courant structures can be seen as functions of degree $n\geq 3$ on that graded symplectic manifold.
△ Less
Submitted 21 June, 2022;
originally announced June 2022.
-
Data Size-Aware Downlink Massive MIMO: A Session-Based Approach
Authors:
Tung T. Vu,
Hien Quoc Ngo,
Minh N. Dao,
Michail Matthaiou,
Erik G. Larsson
Abstract:
This letter considers the development of transmission strategies for the downlink of massive multiple-input multiple-output networks, with the objective of minimizing the completion time of the transmission. Specifically, we introduce a session-based scheme that splits time into sessions and allocates different rates in different sessions for the different users. In each session, one user is selec…
▽ More
This letter considers the development of transmission strategies for the downlink of massive multiple-input multiple-output networks, with the objective of minimizing the completion time of the transmission. Specifically, we introduce a session-based scheme that splits time into sessions and allocates different rates in different sessions for the different users. In each session, one user is selected to complete its transmission and will not join subsequent sessions, which results in successively lower levels of interference when moving from one session to the next. An algorithm is developed to assign users and allocate transmit power that minimizes the completion time. Numerical results show that our proposed session-based scheme significantly outperforms conventional non-session-based schemes.
△ Less
Submitted 10 May, 2022; v1 submitted 9 May, 2022;
originally announced May 2022.
-
Graph Augmentation Learning
Authors:
Shuo Yu,
Huafei Huang,
Minh N. Dao,
Feng Xia
Abstract:
Graph Augmentation Learning (GAL) provides outstanding solutions for graph learning in handling incomplete data, noise data, etc. Numerous GAL methods have been proposed for graph-based applications such as social network analysis and traffic flow forecasting. However, the underlying reasons for the effectiveness of these GAL methods are still unclear. As a consequence, how to choose optimal graph…
▽ More
Graph Augmentation Learning (GAL) provides outstanding solutions for graph learning in handling incomplete data, noise data, etc. Numerous GAL methods have been proposed for graph-based applications such as social network analysis and traffic flow forecasting. However, the underlying reasons for the effectiveness of these GAL methods are still unclear. As a consequence, how to choose optimal graph augmentation strategy for a certain application scenario is still in black box. There is a lack of systematic, comprehensive, and experimentally validated guideline of GAL for scholars. Therefore, in this survey, we in-depth review GAL techniques from macro (graph), meso (subgraph), and micro (node/edge) levels. We further detailedly illustrate how GAL enhance the data quality and the model performance. The aggregation mechanism of augmentation strategies and graph learning models are also discussed by different application scenarios, i.e., data-specific, model-specific, and hybrid scenarios. To better show the outperformance of GAL, we experimentally validate the effectiveness and adaptability of different GAL strategies in different downstream tasks. Finally, we share our insights on several open issues of GAL, including heterogeneity, spatio-temporal dynamics, scalability, and generalization.
△ Less
Submitted 16 March, 2022;
originally announced March 2022.
-
Energy-Efficient Massive MIMO for Federated Learning: Transmission Designs and Resource Allocations
Authors:
Tung T. Vu,
Hien Q. Ngo,
Minh N. Dao,
Duy T. Ngo,
Erik G. Larsson,
Tho Le-Ngoc
Abstract:
This work proposes novel synchronous, asynchronous, and session-based designs for energy-efficient massive multiple-input multiple-output networks to support federated learning (FL). The synchronous design relies on strict synchronization among users when executing each FL communication round, while the asynchronous design allows more flexibility for users to save energy by using lower computing f…
▽ More
This work proposes novel synchronous, asynchronous, and session-based designs for energy-efficient massive multiple-input multiple-output networks to support federated learning (FL). The synchronous design relies on strict synchronization among users when executing each FL communication round, while the asynchronous design allows more flexibility for users to save energy by using lower computing frequencies. The session-based design splits the downlink and uplink phases in each FL communication round into separate sessions. In this design, we assign users such that one of the participating users in each session finishes its transmission and does not join the next session. As such, more power and degrees of freedom will be allocated to unfinished users, leading to higher rates, lower transmission times, and hence, a higher energy efficiency. In all three designs, we use zero-forcing processing for both uplink and downlink, and develop algorithms that optimize user assignment, time allocation, power, and computing frequencies to minimize the energy consumption at the base station and users, while guaranteeing a predefined maximum execution time of one FL communication round.
△ Less
Submitted 15 November, 2022; v1 submitted 22 December, 2021;
originally announced December 2021.
-
Energy-Efficient Massive MIMO for Serving Multiple Federated Learning Groups
Authors:
Tung T. Vu,
Hien Quoc Ngo,
Duy T. Ngo,
Minh N Dao,
Erik G. Larsson
Abstract:
With its privacy preservation and communication efficiency, federated learning (FL) has emerged as a learning framework that suits beyond 5G and towards 6G systems. This work looks into a future scenario in which there are multiple groups with different learning purposes and participating in different FL processes. We give energy-efficient solutions to demonstrate that this scenario can be realist…
▽ More
With its privacy preservation and communication efficiency, federated learning (FL) has emerged as a learning framework that suits beyond 5G and towards 6G systems. This work looks into a future scenario in which there are multiple groups with different learning purposes and participating in different FL processes. We give energy-efficient solutions to demonstrate that this scenario can be realistic. First, to ensure a stable operation of multiple FL processes over wireless channels, we propose to use a massive multiple-input multiple-output network to support the local and global FL training updates, and let the iterations of these FL processes be executed within the same large-scale coherence time. Then, we develop asynchronous and synchronous transmission protocols where these iterations are asynchronously and synchronously executed, respectively, using the downlink unicasting and conventional uplink transmission schemes. Zero-forcing processing is utilized for both uplink and downlink transmissions. Finally, we propose an algorithm that optimally allocates power and computation resources to save energy at both base station and user sides, while guaranteeing a given maximum execution time threshold of each FL iteration. Compared to the baseline schemes, the proposed algorithm significantly reduces the energy consumption, especially when the number of base station antennas is large.
△ Less
Submitted 17 October, 2021; v1 submitted 30 August, 2021;
originally announced August 2021.
-
An adaptive splitting algorithm for the sum of three operators
Authors:
Minh N. Dao,
Hung M. Phan
Abstract:
Splitting algorithms for finding a zero of sum of operators often involve multiple steps which are referred to as forward or backward steps. Forward steps are the explicit use of the operators and backward steps involve the operators implicitly via their resolvents. In this paper, we study an adaptive splitting algorithm for finding a zero of the sum of three operators. We assume that two of the o…
▽ More
Splitting algorithms for finding a zero of sum of operators often involve multiple steps which are referred to as forward or backward steps. Forward steps are the explicit use of the operators and backward steps involve the operators implicitly via their resolvents. In this paper, we study an adaptive splitting algorithm for finding a zero of the sum of three operators. We assume that two of the operators are generalized monotone and their resolvents are computable, while the other operator is cocoercive but its resolvent is missing or costly to compute. Our splitting algorithm adapts new parameters to the generalized monotonicity of the operators and, at the same time, combines appropriate forward and backward steps to guarantee convergence to a solution of the problem.
△ Less
Submitted 12 April, 2021;
originally announced April 2021.
-
Generalized Bregman envelopes and proximity operators
Authors:
Regina S. Burachik,
Minh N. Dao,
Scott B. Lindstrom
Abstract:
Every maximally monotone operator can be associated with a family of convex functions, called the Fitzpatrick family or family of representative functions. Surprisingly, in 2017, Burachik and Martínez-Legaz showed that the well-known Bregman distance is a particular case of a general family of distances, each one induced by a specific maximally monotone operator and a specific choice of one of its…
▽ More
Every maximally monotone operator can be associated with a family of convex functions, called the Fitzpatrick family or family of representative functions. Surprisingly, in 2017, Burachik and Martínez-Legaz showed that the well-known Bregman distance is a particular case of a general family of distances, each one induced by a specific maximally monotone operator and a specific choice of one of its representative functions. For the family of generalized Bregman distances, sufficient conditions for convexity, coercivity, and supercoercivity have recently been furnished. Motivated by these advances, we introduce in the present paper the generalized left and right envelopes and proximity operators, and we provide asymptotic results for parameters. Certain results extend readily from the more specific Bregman context, while others only extend for certain generalized cases. To illustrate, we construct examples from the Bregman generalizing case, together with the natural "extreme" cases that highlight the importance of which generalized Bregman distance is chosen.
△ Less
Submitted 30 June, 2021; v1 submitted 21 February, 2021;
originally announced February 2021.
-
A New Look and Convergence Rate of Federated Multi-Task Learning with Laplacian Regularization
Authors:
Canh T. Dinh,
Tung T. Vu,
Nguyen H. Tran,
Minh N. Dao,
Hongyu Zhang
Abstract:
Non-Independent and Identically Distributed (non- IID) data distribution among clients is considered as the key factor that degrades the performance of federated learning (FL). Several approaches to handle non-IID data such as personalized FL and federated multi-task learning (FMTL) are of great interest to research communities. In this work, first, we formulate the FMTL problem using Laplacian re…
▽ More
Non-Independent and Identically Distributed (non- IID) data distribution among clients is considered as the key factor that degrades the performance of federated learning (FL). Several approaches to handle non-IID data such as personalized FL and federated multi-task learning (FMTL) are of great interest to research communities. In this work, first, we formulate the FMTL problem using Laplacian regularization to explicitly leverage the relationships among the models of clients for multi-task learning. Then, we introduce a new view of the FMTL problem, which in the first time shows that the formulated FMTL problem can be used for conventional FL and personalized FL. We also propose two algorithms FedU and dFedU to solve the formulated FMTL problem in communication-centralized and decentralized schemes, respectively. Theoretically, we prove that the convergence rates of both algorithms achieve linear speedup for strongly convex and sublinear speedup of order 1/2 for nonconvex objectives. Experimentally, we show that our algorithms outperform the algorithm FedAvg, FedProx, SCAFFOLD, and AFL in FL settings, MOCHA in FMTL settings, as well as pFedMe and Per-FedAvg in personalized FL settings.
△ Less
Submitted 11 October, 2022; v1 submitted 14 February, 2021;
originally announced February 2021.
-
Tensor-Train Networks for Learning Predictive Modeling of Multidimensional Data
Authors:
M. Nazareth da Costa,
R. Attux,
A. Cichocki,
J. M. T. Romano
Abstract:
In this work, we firstly apply the Train-Tensor (TT) networks to construct a compact representation of the classical Multilayer Perceptron, representing a reduction of up to 95% of the coefficients. A comparative analysis between tensor model and standard multilayer neural networks is also carried out in the context of prediction of the Mackey-Glass noisy chaotic time series and NASDAQ index. We s…
▽ More
In this work, we firstly apply the Train-Tensor (TT) networks to construct a compact representation of the classical Multilayer Perceptron, representing a reduction of up to 95% of the coefficients. A comparative analysis between tensor model and standard multilayer neural networks is also carried out in the context of prediction of the Mackey-Glass noisy chaotic time series and NASDAQ index. We show that the weights of a multidimensional regression model can be learned by means of TT network and the optimization of TT weights is a more robust to the impact of coefficient initialization and hyper-parameter setting. Furthermore, an efficient algorithm based on alternating least squares has been proposed for approximating the weights in TT-format with a reduction of computational calculus, providing a much faster convergence than the well-known adaptive learning-method algorithms, widely applied for optimizing neural networks.
△ Less
Submitted 30 March, 2021; v1 submitted 22 January, 2021;
originally announced January 2021.
-
Inertial Proximal Block Coordinate Method for a Class of Nonsmooth Sum-of-Ratios Optimization Problems
Authors:
Radu Ioan Boţ,
Minh N. Dao,
Guoyin Li
Abstract:
In this paper, we consider a class of nonsmooth sum-of-ratios fractional optimization problems with block structure. This model class is ubiquitous and encompasses several important nonsmooth optimization problems in the literature. We first propose an inertial proximal block coordinate method for solving this class of problems by exploiting the underlying structure. The global convergence of our…
▽ More
In this paper, we consider a class of nonsmooth sum-of-ratios fractional optimization problems with block structure. This model class is ubiquitous and encompasses several important nonsmooth optimization problems in the literature. We first propose an inertial proximal block coordinate method for solving this class of problems by exploiting the underlying structure. The global convergence of our method is guaranteed under the Kurdyka--Lojasiewicz (KL) property and some mild assumptions. We then identify the explicit exponents of the KL property for three important structured fractional optimization problems. In particular, for the sparse generalized eigenvalue problem with either cardinality regularization or sparsity constraint, we show that the KL exponents are 1/2, and so, the proposed method exhibits linear convergence rate. Finally, we illustrate our theoretical results with both analytic and simulated numerical examples.
△ Less
Submitted 18 May, 2023; v1 submitted 19 November, 2020;
originally announced November 2020.
-
Joint Resource Allocation to Minimize Execution Time of Federated Learning in Cell-Free Massive MIMO
Authors:
Tung T. Vu,
Duy T. Ngo,
Hien Quoc Ngo,
Minh N. Dao,
Nguyen H. Tran,
Richard H. Middleton
Abstract:
Due to its communication efficiency and privacy-preserving capability, federated learning (FL) has emerged as a promising framework for machine learning in 5G-and-beyond wireless networks. Of great interest is the design and optimization of new wireless network structures that support the stable and fast operation of FL. Cell-free massive multiple-input multiple-output (CFmMIMO) turns out to be a…
▽ More
Due to its communication efficiency and privacy-preserving capability, federated learning (FL) has emerged as a promising framework for machine learning in 5G-and-beyond wireless networks. Of great interest is the design and optimization of new wireless network structures that support the stable and fast operation of FL. Cell-free massive multiple-input multiple-output (CFmMIMO) turns out to be a suitable candidate, which allows each communication round in the iterative FL process to be stably executed within a large-scale coherence time. Aiming to reduce the total execution time of the FL process in CFmMIMO, this paper proposes choosing only a subset of available users to participate in FL. An optimal selection of users with favorable link conditions would minimize the execution time of each communication round, while limiting the total number of communication rounds required. Toward this end, we formulate a joint optimization problem of user selection, transmit power, and processing frequency, subject to a predefined minimum number of participating users to guarantee the quality of learning. We then develop a new algorithm that is proven to converge to the neighbourhood of the stationary points of the formulated problem. Numerical results confirm that our proposed approach significantly reduces the FL total execution time over baseline schemes. The time reduction is more pronounced when the density of access point deployments is moderately low.
△ Less
Submitted 10 June, 2022; v1 submitted 4 September, 2020;
originally announced September 2020.
-
Extrapolated Proximal Subgradient Algorithms for Nonconvex and Nonsmooth Fractional Programs
Authors:
Radu Ioan Boţ,
Minh N. Dao,
Guoyin Li
Abstract:
In this paper, we consider a broad class of nonsmooth and nonconvex fractional programs, where the numerator can be written as the sum of a continuously differentiable convex function whose gradient is Lipschitz continuous and a proper lower semicontinuous (possibly nonconvex) function, and the denominator is weakly convex over the constraint set. This model problem includes the composite optimiza…
▽ More
In this paper, we consider a broad class of nonsmooth and nonconvex fractional programs, where the numerator can be written as the sum of a continuously differentiable convex function whose gradient is Lipschitz continuous and a proper lower semicontinuous (possibly nonconvex) function, and the denominator is weakly convex over the constraint set. This model problem includes the composite optimization problems studied extensively lately, and encompasses many important modern fractional optimization problems arising from diverse areas such as the recently proposed scale invariant sparse signal reconstruction problem in signal processing. We propose a proximal subgradient algorithm with extrapolations for solving this optimization model and show that the iterated sequence generated by the algorithm is bounded and any of its limit points is a stationary point of the model problem. The choice of our extrapolation parameter is flexible and includes the popular extrapolation parameter adopted in the restarted Fast Iterative Shrinking-Threshold Algorithm (FISTA). By providing a unified analysis framework of descent methods, we establish the convergence of the full sequence under the assumption that a suitable merit function satisfies the Kurdyka--Łojasiewicz (KL) property. In particular, our algorithm exhibits linear convergence for the scale invariant sparse signal reconstruction problem and the Rayleigh quotient problem over spherical constraint. In the case where the denominator is the maximum of finitely many continuously differentiable weakly convex functions, we also propose an enhanced extrapolated proximal subgradient algorithm with guaranteed convergence to a stronger notion of stationary points of the model problem. Finally, we illustrate the proposed methods by both analytical and simulated numerical examples.
△ Less
Submitted 16 October, 2020; v1 submitted 9 March, 2020;
originally announced March 2020.
-
Split Courant algebroids as $L_{\infty}$-structures
Authors:
Paulo Antunes,
Joana M. Nunes da Costa
Abstract:
We show that split Courant algebroids, i.e., those defined on a Whitney sum $A \oplus A^*$, are in a one-to-one correspondence with multiplicative curved $L_\infty$-algebras. This one-to-one correspondence extends to Nijenhuis morphisms and behaves well under the operation of twisting by a bivector.
We show that split Courant algebroids, i.e., those defined on a Whitney sum $A \oplus A^*$, are in a one-to-one correspondence with multiplicative curved $L_\infty$-algebras. This one-to-one correspondence extends to Nijenhuis morphisms and behaves well under the operation of twisting by a bivector.
△ Less
Submitted 26 June, 2020; v1 submitted 20 December, 2019;
originally announced December 2019.
-
Conical averagedness and convergence analysis of fixed point algorithms
Authors:
Sedi Bartz,
Minh N. Dao,
Hung M. Phan
Abstract:
We study a conical extension of averaged nonexpansive operators and the role it plays in convergence analysis of fixed point algorithms. Various properties of conically averaged operators are systematically investigated, in particular, the stability under relaxations, convex combinations and compositions. We derive conical averagedness properties of resolvents of generalized monotone operators. Th…
▽ More
We study a conical extension of averaged nonexpansive operators and the role it plays in convergence analysis of fixed point algorithms. Various properties of conically averaged operators are systematically investigated, in particular, the stability under relaxations, convex combinations and compositions. We derive conical averagedness properties of resolvents of generalized monotone operators. These properties are then utilized in order to analyze the convergence of the proximal point algorithm, the forward-backward algorithm, and the adaptive Douglas-Rachford algorithm. Our study unifies, improves and casts new light on recent studies of these topics.
△ Less
Submitted 30 November, 2020; v1 submitted 30 October, 2019;
originally announced October 2019.
-
Cell-Free Massive MIMO for Wireless Federated Learning
Authors:
Tung T. Vu,
Duy T. Ngo,
Nguyen H. Tran,
Hien Quoc Ngo,
Minh N. Dao,
Richard H. Middleton
Abstract:
This paper proposes a novel scheme for cell-free massive multiple-input multiple-output (CFmMIMO) networks to support any federated learning (FL) framework. This scheme allows each instead of all the iterations of the FL framework to happen in a large-scale coherence time to guarantee a stable operation of an FL process. To show how to optimize the FL performance using this proposed scheme, we con…
▽ More
This paper proposes a novel scheme for cell-free massive multiple-input multiple-output (CFmMIMO) networks to support any federated learning (FL) framework. This scheme allows each instead of all the iterations of the FL framework to happen in a large-scale coherence time to guarantee a stable operation of an FL process. To show how to optimize the FL performance using this proposed scheme, we consider an existing FL framework as an example and target FL training time minimization for this framework. An optimization problem is then formulated to jointly optimize the local accuracy, transmit power, data rate, and users' processing frequency. This mixed-timescale stochastic nonconvex problem captures the complex interactions among the training time, and transmission and computation of training updates of one FL process. By employing the online successive convex approximation approach, we develop a new algorithm to solve the formulated problem with proven convergence to the neighbourhood of its stationary points. Our numerical results confirm that the presented joint design reduces the training time by up to $55\%$ over baseline approaches. They also show that CFmMIMO here requires the lowest training time for FL processes compared with cell-free time-division multiple access massive MIMO and collocated massive MIMO.
△ Less
Submitted 14 June, 2020; v1 submitted 27 September, 2019;
originally announced September 2019.
-
The Generalized Bregman Distance
Authors:
Regina S. Burachik,
Minh N. Dao,
Scott B. Lindstrom
Abstract:
Recently, a new distance has been introduced for the graphs of two point-to-set operators, one of which is maximally monotone. When both operators are the subdifferential of a proper lower semicontinuous convex function, this distance specializes under modest assumptions to the classical Bregman distance. We name this new distance the generalized Bregman distance, and we shed light on it with exam…
▽ More
Recently, a new distance has been introduced for the graphs of two point-to-set operators, one of which is maximally monotone. When both operators are the subdifferential of a proper lower semicontinuous convex function, this distance specializes under modest assumptions to the classical Bregman distance. We name this new distance the generalized Bregman distance, and we shed light on it with examples that utilize the other two most natural representative functions: the Fitzpatrick function and its conjugate. We provide sufficient conditions for convexity, coercivity, and supercoercivity: properties that are essential for implementation in proximal point type algorithms. We establish these results for both the left and right variants of this new distance. We construct examples closely related to the Kullback--Leibler divergence, which was previously considered in the context of Bregman distances, and whose importance in information theory is well known. In so doing, we demonstrate how to compute a difficult Fitzpatrick conjugate function, and we discover natural occurrences of the Lambert $\W$ function, whose importance in optimization is of growing interest.
△ Less
Submitted 26 September, 2020; v1 submitted 18 September, 2019;
originally announced September 2019.
-
Computing the resolvent of the sum of operators with application to best approximation problems
Authors:
Minh N. Dao,
Hung M. Phan
Abstract:
We propose a flexible approach for computing the resolvent of the sum of weakly monotone operators in real Hilbert spaces. This relies on splitting methods where strong convergence is guaranteed. We also prove linear convergence under Lipschitz continuity assumption. The approach is then applied to computing the proximity operator of the sum of weakly convex functions, and particularly to finding…
▽ More
We propose a flexible approach for computing the resolvent of the sum of weakly monotone operators in real Hilbert spaces. This relies on splitting methods where strong convergence is guaranteed. We also prove linear convergence under Lipschitz continuity assumption. The approach is then applied to computing the proximity operator of the sum of weakly convex functions, and particularly to finding the best approximation to the intersection of convex sets.
△ Less
Submitted 11 September, 2018;
originally announced September 2018.
-
Adaptive Douglas-Rachford splitting algorithm for the sum of two operators
Authors:
Minh N. Dao,
Hung M. Phan
Abstract:
The Douglas-Rachford algorithm is a classical and powerful splitting method for minimizing the sum of two convex functions and, more generally, finding a zero of the sum of two maximally monotone operators. Although this algorithm is well understood when the involved operators are monotone or strongly monotone, the convergence theory for weakly monotone settings is far from being complete. In this…
▽ More
The Douglas-Rachford algorithm is a classical and powerful splitting method for minimizing the sum of two convex functions and, more generally, finding a zero of the sum of two maximally monotone operators. Although this algorithm is well understood when the involved operators are monotone or strongly monotone, the convergence theory for weakly monotone settings is far from being complete. In this paper, we propose an adaptive Douglas-Rachford splitting algorithm for the sum of two operators, one of which is strongly monotone while the other one is weakly monotone. With appropriately chosen parameters, the algorithm converges globally to a fixed point from which we derive a solution of the problem. When one operator is Lipschitz continuous, we prove global linear convergence, which sharpens recent known results.
△ Less
Submitted 9 October, 2019; v1 submitted 3 September, 2018;
originally announced September 2018.
-
Union Averaged Operators with Applications to Proximal Algorithms for Min-Convex Functions
Authors:
Minh N. Dao,
Matthew K. Tam
Abstract:
In this paper we introduce and study a class of structured set-valued operators which we call union averaged nonexpansive. At each point in their domain, the value of such an operator can be expressed as a finite union of single-valued averaged nonexpansive operators. We investigate various structural properties of the class and show, in particular, that is closed under taking unions, convex combi…
▽ More
In this paper we introduce and study a class of structured set-valued operators which we call union averaged nonexpansive. At each point in their domain, the value of such an operator can be expressed as a finite union of single-valued averaged nonexpansive operators. We investigate various structural properties of the class and show, in particular, that is closed under taking unions, convex combinations, and compositions, and that their fixed point iterations are locally convergent around strong fixed points. We then systematically apply our results to analyze proximal algorithms in situations where union averaged nonexpansive operators naturally arise. In particular, we consider the problem of minimizing the sum two functions where the first is convex and the second can be expressed as the minimum of finitely many convex functions.
△ Less
Submitted 17 October, 2018; v1 submitted 16 July, 2018;
originally announced July 2018.
-
The Douglas--Rachford algorithm for a hyperplane and a doubleton
Authors:
Heinz H. Bauschke,
Minh N. Dao,
Scott B. Lindstrom
Abstract:
The Douglas--Rachford algorithm is a popular algorithm for solving both convex and nonconvex feasibility problems. While its behaviour is settled in the convex inconsistent case, the general nonconvex inconsistent case is far from being fully understood. In this paper, we focus on the most simple nonconvex inconsistent case: when one set is a hyperplane and the other a doubleton (i.e., a two-point…
▽ More
The Douglas--Rachford algorithm is a popular algorithm for solving both convex and nonconvex feasibility problems. While its behaviour is settled in the convex inconsistent case, the general nonconvex inconsistent case is far from being fully understood. In this paper, we focus on the most simple nonconvex inconsistent case: when one set is a hyperplane and the other a doubleton (i.e., a two-point set). We present a characterization of cycling in this case which --- somewhat surprisingly --- depends on whether the ratio of the distance of the points to the hyperplane is rational or not. Furthermore, we provide closed-form expressions as well as several concrete examples which illustrate the dynamical richness of this algorithm.
△ Less
Submitted 24 April, 2018;
originally announced April 2018.
-
Linear convergence of the generalized Douglas-Rachford algorithm for feasibility problems
Authors:
Minh N. Dao,
Hung M. Phan
Abstract:
In this paper, we study the generalized Douglas-Rachford algorithm and its cyclic variants which include many projection-type methods such as the classical Douglas-Rachford algorithm and the alternating projection algorithm. Specifically, we establish several local linear convergence results for the algorithm in solving feasibility problems with finitely many closed possibly nonconvex sets under d…
▽ More
In this paper, we study the generalized Douglas-Rachford algorithm and its cyclic variants which include many projection-type methods such as the classical Douglas-Rachford algorithm and the alternating projection algorithm. Specifically, we establish several local linear convergence results for the algorithm in solving feasibility problems with finitely many closed possibly nonconvex sets under different assumptions. Our findings not only relax some regularity conditions but also improve linear convergence rates in the literature. In the presence of convexity, the linear convergence is global.
△ Less
Submitted 16 April, 2018; v1 submitted 26 October, 2017;
originally announced October 2017.
-
A Lyapunov-type approach to convergence of the Douglas-Rachford algorithm
Authors:
Minh N. Dao,
Matthew K. Tam
Abstract:
The Douglas-Rachford projection algorithm is an iterative method used to find a point in the intersection of closed constraint sets. The algorithm has been experimentally observed to solve various nonconvex feasibility problems which current theory cannot sufficiently explain. In this paper, we prove convergence of the Douglas-Rachford algorithm in a potentially nonconvex setting. Our analysis rel…
▽ More
The Douglas-Rachford projection algorithm is an iterative method used to find a point in the intersection of closed constraint sets. The algorithm has been experimentally observed to solve various nonconvex feasibility problems which current theory cannot sufficiently explain. In this paper, we prove convergence of the Douglas-Rachford algorithm in a potentially nonconvex setting. Our analysis relies on the existence of a Lyapunov-type functional whose convexity properties are not tantamount to convexity of the original constraint sets. Moreover, we provide various nonconvex examples in which our framework proves global convergence of the algorithm.
△ Less
Submitted 15 June, 2017;
originally announced June 2017.
-
Regularizing with Bregman-Moreau envelopes
Authors:
Heinz H. Bauschke,
Minh N. Dao,
Scott B. Lindstrom
Abstract:
Moreau's seminal paper, introducing what is now called the Moreau envelope and the proximity operator (also known as the proximal map**), appeared in 1965. The Moreau envelope of a given convex function provides a regularized version which has additional desirable properties such as differentiability and full domain. Fifty years ago, Attouch proposed using the Moreau envelope for regularization.…
▽ More
Moreau's seminal paper, introducing what is now called the Moreau envelope and the proximity operator (also known as the proximal map**), appeared in 1965. The Moreau envelope of a given convex function provides a regularized version which has additional desirable properties such as differentiability and full domain. Fifty years ago, Attouch proposed using the Moreau envelope for regularization. Since then, this branch of convex analysis has developed in many fruitful directions. In 1967, Bregman introduced what is nowadays known as the Bregman distance as a measure of discrepancy between two points generalizing the square of the Euclidean distance. Proximity operators based on the Bregman distance have become a topic of significant research as they are useful in the algorithmic solution of optimization problems. More recently, in 2012, Kan and Song studied regularization aspects of the left Bregman-Moreau envelope even for nonconvex functions. In this paper, we complement previous works by analyzing the left and right Bregman-Moreau envelopes and by providing additional asymptotic results. Several examples are provided.
△ Less
Submitted 16 November, 2018; v1 submitted 17 May, 2017;
originally announced May 2017.
-
Linear Convergence of Projection Algorithms
Authors:
Minh N. Dao,
Hung M. Phan
Abstract:
Projection algorithms are well known for their simplicity and flexibility in solving feasibility problems. They are particularly important in practice due to minimal requirements for software implementation and maintenance. In this work, we study linear convergence of several projection algorithms for systems of finitely many closed sets. The results complement contemporary research on the same to…
▽ More
Projection algorithms are well known for their simplicity and flexibility in solving feasibility problems. They are particularly important in practice due to minimal requirements for software implementation and maintenance. In this work, we study linear convergence of several projection algorithms for systems of finitely many closed sets. The results complement contemporary research on the same topic.
△ Less
Submitted 25 October, 2017; v1 submitted 1 September, 2016;
originally announced September 2016.
-
Nijenhuis forms on Lie-infinity algebras associated to Lie algebroids
Authors:
M. Jawad Azimi,
C. Laurent-Gengoux,
J. M. Nunes da Costa
Abstract:
Introducing Nijenhuis forms on Lie-infinity algebras gives a general frame to understand deformations of the latter. We give here a Nijenhuis interpretation of a deformation of an arbitrary Lie algebroid into a Lie-infinity algebra. Then we show that Nijenhuis forms on Lie-infinity algebras also give a short and efficient manner to understand Poisson-Nijenhuis structures and, more generally, the s…
▽ More
Introducing Nijenhuis forms on Lie-infinity algebras gives a general frame to understand deformations of the latter. We give here a Nijenhuis interpretation of a deformation of an arbitrary Lie algebroid into a Lie-infinity algebra. Then we show that Nijenhuis forms on Lie-infinity algebras also give a short and efficient manner to understand Poisson-Nijenhuis structures and, more generally, the so-called exact Poisson quasi-Nijenhuis structures with background.
△ Less
Submitted 27 April, 2016;
originally announced April 2016.
-
On the finite convergence of the Douglas-Rachford algorithm for solving (not necessarily convex) feasibility problems in Euclidean spaces
Authors:
Heinz H. Bauschke,
Minh N. Dao
Abstract:
Solving feasibility problems is a central task in mathematics and the applied sciences. One particularly successful method is the Douglas-Rachford algorithm. In this paper, we provide many new conditions sufficient for finite convergence. Numerous examples illustrate our results.
Solving feasibility problems is a central task in mathematics and the applied sciences. One particularly successful method is the Douglas-Rachford algorithm. In this paper, we provide many new conditions sufficient for finite convergence. Numerous examples illustrate our results.
△ Less
Submitted 15 April, 2016;
originally announced April 2016.
-
On Fejér monotone sequences and nonexpansive map**s
Authors:
H. H. Bauschke,
M. N. Dao,
W. M. Moursi
Abstract:
The notion of Fejér monotonicity has proven to be a fruitful concept in fixed point theory and optimization. In this paper, we present new conditions sufficient for convergence of Fejér monotone sequences and we also provide applications to the study of nonexpansive map**s. Various examples illustrate our results.
The notion of Fejér monotonicity has proven to be a fruitful concept in fixed point theory and optimization. In this paper, we present new conditions sufficient for convergence of Fejér monotone sequences and we also provide applications to the study of nonexpansive map**s. Various examples illustrate our results.
△ Less
Submitted 20 July, 2015;
originally announced July 2015.
-
The Douglas-Rachford algorithm in the affine-convex case
Authors:
Heinz H. Bauschke,
Minh N. Dao,
Walaa M. Moursi
Abstract:
The Douglas-Rachford algorithm is a simple yet effective method for solving convex feasibility problems. However, if the underlying constraints are inconsistent, then the convergence theory is incomplete. We provide convergence results when one constraint is an affine subspace. As a consequence, we extend a result by S**arn from halfspaces to general closed convex sets admitting least-squares so…
▽ More
The Douglas-Rachford algorithm is a simple yet effective method for solving convex feasibility problems. However, if the underlying constraints are inconsistent, then the convergence theory is incomplete. We provide convergence results when one constraint is an affine subspace. As a consequence, we extend a result by S**arn from halfspaces to general closed convex sets admitting least-squares solutions.
△ Less
Submitted 24 May, 2015;
originally announced May 2015.
-
On Slater's condition and finite convergence of the Douglas-Rachford algorithm
Authors:
Heinz H. Bauschke,
Minh N. Dao,
Dominikus Noll,
Hung M. Phan
Abstract:
The Douglas-Rachford algorithm is a classical and very successful method for solving optimization and feasibility problems. In this paper, we provide novel conditions sufficient for finite convergence in the context of convex feasibility problems. Our analysis builds upon, and considerably extends, pioneering work by S**arn. Specifically, we obtain finite convergence in the presence of Slater's…
▽ More
The Douglas-Rachford algorithm is a classical and very successful method for solving optimization and feasibility problems. In this paper, we provide novel conditions sufficient for finite convergence in the context of convex feasibility problems. Our analysis builds upon, and considerably extends, pioneering work by S**arn. Specifically, we obtain finite convergence in the presence of Slater's condition in the affine-polyhedral and in a hyperplanar-epigraphical case. Various examples illustrate our results. Numerical experiments demonstrate the competitiveness of the Douglas-Rachford algorithm for solving linear equations with a positivity constraint when compared to the method of alternating projections and the method of reflection-projection.
△ Less
Submitted 27 April, 2015;
originally announced April 2015.
-
Proximal point algorithm, Douglas-Rachford algorithm and alternating projections: a case study
Authors:
Heinz H. Bauschke,
Minh N. Dao,
Dominikus Noll,
Hung M. Phan
Abstract:
Many iterative methods for solving optimization or feasibility problems have been invented, and often convergence of the iterates to some solution is proven. Under favourable conditions, one might have additional bounds on the distance of the iterate to the solution leading thus to worst case estimates, i.e., how fast the algorithm must converge.
Exact convergence estimates are typically hard to…
▽ More
Many iterative methods for solving optimization or feasibility problems have been invented, and often convergence of the iterates to some solution is proven. Under favourable conditions, one might have additional bounds on the distance of the iterate to the solution leading thus to worst case estimates, i.e., how fast the algorithm must converge.
Exact convergence estimates are typically hard to come by. In this paper, we consider the complementary problem of finding best case estimates, i.e., how slow the algorithm has to converge, and we also study exact asymptotic rates of convergence. Our investigation focuses on convex feasibility in the Euclidean plane, where one set is the real axis while the other is the epigraph of a convex function. This case study allows us to obtain various convergence rate results. We focus on the popular method of alternating projections and the Douglas-Rachford algorithm. These methods are connected to the proximal point algorithm which is also discussed. Our findings suggest that the Douglas-Rachford algorithm outperforms the method of alternating projections in the absence of constraint qualifications. Various examples illustrate the theory.
△ Less
Submitted 26 January, 2015;
originally announced January 2015.
-
Hypersymplectic structures with torsion on Lie algebroids
Authors:
P. Antunes,
J. M. Nunes da Costa
Abstract:
Hypersymplectic structures with torsion on Lie algebroids are investigated. We show that each hypersymplectic structure with torsion on a Lie algebroid determines three Nijenhuis morphisms. From a contravariant point of view, these structures are twisted Poisson structures. We prove the existence of a one-to-one correspondence between hypersymplectic structures with torsion and hyperkähler structu…
▽ More
Hypersymplectic structures with torsion on Lie algebroids are investigated. We show that each hypersymplectic structure with torsion on a Lie algebroid determines three Nijenhuis morphisms. From a contravariant point of view, these structures are twisted Poisson structures. We prove the existence of a one-to-one correspondence between hypersymplectic structures with torsion and hyperkähler structures with torsion. We show that given a Lie algebroid with a hypersymplectic structure with torsion, the deformation of the Lie algebroid structure by any of the transition morphisms does not affect the hypersymplectic structure with torsion. We also show that if a triplet of $2$-forms is a hypersymplectic structure with torsion on a Lie algebroid $A$, then the triplet of the inverse bivectors is a hypersymplectic structure with torsion for a certain Lie algebroid structure on the dual $A^*$, and conversely. Examples of hypersymplectic structures with torsion are included.
△ Less
Submitted 26 January, 2016; v1 submitted 5 January, 2015;
originally announced January 2015.
-
Hypersymplectic structures on Courant algebroids
Authors:
P. Antunes,
J. M. Nunes da Costa
Abstract:
We introduce the notion of hypersymplectic structure on a Courant algebroid and we prove the existence of a one-to-one correspondence between hypersymplectic and hyperkähler structures. This correspondence provides a simpler way to define a hyperkähler structure on a Courant algebroid. We show that hypersymplectic structures on Courant algebroids encompass hyperkähler and hyperkähler structures wi…
▽ More
We introduce the notion of hypersymplectic structure on a Courant algebroid and we prove the existence of a one-to-one correspondence between hypersymplectic and hyperkähler structures. This correspondence provides a simpler way to define a hyperkähler structure on a Courant algebroid. We show that hypersymplectic structures on Courant algebroids encompass hyperkähler and hyperkähler structures with torsion on Lie algebroids. In the latter, the torsion existing at the Lie algebroid level is incorporated in the Courant structure. Cases of hypersymplectic structures on Courant algebroids which are doubles of Lie, quasi-Lie and proto-Lie bialgebroids are investigated.
△ Less
Submitted 16 December, 2014;
originally announced December 2014.
-
Parametric robust structured control design
Authors:
P. Apkarian,
M. N. Dao,
D. Noll
Abstract:
We present a new approach to parametric robust controller design, where we compute controllers of arbitrary order and structure which minimize the worst-case $H_\infty$ norm over a pre-specified set of uncertain parameters. At the core of our method is a nonsmooth minimization method tailored to functions which are semi-infinite minima of smooth functions. A rich test bench and a more detailed exa…
▽ More
We present a new approach to parametric robust controller design, where we compute controllers of arbitrary order and structure which minimize the worst-case $H_\infty$ norm over a pre-specified set of uncertain parameters. At the core of our method is a nonsmooth minimization method tailored to functions which are semi-infinite minima of smooth functions. A rich test bench and a more detailed example illustrate the potential of the technique, which can deal with complex problems involving multiple possibly repeated uncertain parameters.
△ Less
Submitted 16 May, 2014;
originally announced May 2014.
-
Nonconvex bundle method with application to a delamination problem
Authors:
M. N. Dao,
J. Gwinner,
D. Noll,
N. Ovcharova
Abstract:
Delamination is a typical failure mode of composite materials caused by weak bonding. It arises when a crack initiates and propagates under a destructive loading. Given the physical law characterizing the properties of the interlayer adhesive between the bonded bodies, we consider the problem of computing the propagation of the crack front and the stress field along the contact boundary. This lead…
▽ More
Delamination is a typical failure mode of composite materials caused by weak bonding. It arises when a crack initiates and propagates under a destructive loading. Given the physical law characterizing the properties of the interlayer adhesive between the bonded bodies, we consider the problem of computing the propagation of the crack front and the stress field along the contact boundary. This leads to a hemivariational inequality, which after discretization by finite elements we solve by a nonconvex bundle method, where upper-$C^1$ criteria have to be minimized. As this is in contrast with other classes of mechanical problems with non-monotone friction laws and in other applied fields, where criteria are typically lower-$C^1$, we propose a bundle method suited for both types of nonsmoothness. We prove its global convergence in the sense of subsequences and test it on a typical delamination problem of material sciences.
△ Less
Submitted 27 January, 2014;
originally announced January 2014.
-
Nijenhuis forms on $L_\infty$-algebras and Poisson geometry
Authors:
M. J. Azimi,
C. Laurent-Gengoux,
J. M. Nunes da Costa
Abstract:
We investigate Nijenhuis deformations of $L_\infty$-algebras, a notion that unifies several Nijenhuis deformations, namely those of Lie algebras, Lie algebroids, Poisson structures and Courant structures. Additional examples, linked to Lie $n$-algebras and $n$-plectic manifolds, are included.
We investigate Nijenhuis deformations of $L_\infty$-algebras, a notion that unifies several Nijenhuis deformations, namely those of Lie algebras, Lie algebroids, Poisson structures and Courant structures. Additional examples, linked to Lie $n$-algebras and $n$-plectic manifolds, are included.
△ Less
Submitted 16 December, 2014; v1 submitted 28 August, 2013;
originally announced August 2013.
-
Hyperstructures on Lie algebroids
Authors:
P. Antunes,
J. M. Nunes da Costa
Abstract:
We define hypersymplectic structures on Lie algebroids recovering, as particular cases, all the classical results and examples of hypersymplectic structures on manifolds. We prove a 1-1 correspondence theorem between hypersymplectic structures and (pseudo-)hyperkähler structures. We show that the hypersymplectic framework is very rich in already known compatible pairs of tensors such as Poisson-Ni…
▽ More
We define hypersymplectic structures on Lie algebroids recovering, as particular cases, all the classical results and examples of hypersymplectic structures on manifolds. We prove a 1-1 correspondence theorem between hypersymplectic structures and (pseudo-)hyperkähler structures. We show that the hypersymplectic framework is very rich in already known compatible pairs of tensors such as Poisson-Nijenhuis, $ΩN$ and $P Ω$ structures.
△ Less
Submitted 15 April, 2013;
originally announced April 2013.
-
Nijenhuis and Compatible Tensors on Lie and Courant algebroids
Authors:
Paulo Antunes,
Joana M. Nunes da Costa
Abstract:
We show that well known structures on Lie algebroids can be viewed as Nijenhuis tensors or pairs of compatible tensors on Courant algebroids. We study compatibility and construct hierarchies of these structures.
We show that well known structures on Lie algebroids can be viewed as Nijenhuis tensors or pairs of compatible tensors on Courant algebroids. We study compatibility and construct hierarchies of these structures.
△ Less
Submitted 19 February, 2013; v1 submitted 9 July, 2012;
originally announced July 2012.
-
Hierarchies and compatibility on Courant algebroids
Authors:
Paulo Antunes,
Camille Laurent-Gengoux,
Joana M. Nunes da Costa
Abstract:
We extend to the context of Courant algebroids several hierarchies that can be constructed on Poisson-Nijenhuis manifolds. More precisely, we introduce several notions (Poisson-Nijenhuis, deformation-Nijenhuis and Nijenhuis pairs) that extend to Courant algebroids the notion of a Poisson-Nijenhuis manifold, by using the idea that both the Poisson and the Nijenhuis structures, although they seem to…
▽ More
We extend to the context of Courant algebroids several hierarchies that can be constructed on Poisson-Nijenhuis manifolds. More precisely, we introduce several notions (Poisson-Nijenhuis, deformation-Nijenhuis and Nijenhuis pairs) that extend to Courant algebroids the notion of a Poisson-Nijenhuis manifold, by using the idea that both the Poisson and the Nijenhuis structures, although they seem to be different in nature when considered on manifolds, are just $(1,1)$-tensors on the usual Courant algebroid $TM \oplus T^*M $ satisfying several constraints. For each of the generalizations mentioned, we show that there are natural hierarchies obtained by successive deformation by one of the $(1,1)$-tensor.
△ Less
Submitted 14 January, 2012; v1 submitted 3 November, 2011;
originally announced November 2011.
-
On Jacobi quasi-Nijenhuis algebroids and Courant-Jacobi algebroid morphisms
Authors:
Raquel Caseiro,
Antonio De Nicola,
Joana M. Nunes da Costa
Abstract:
We propose a definition of Jacobi quasi-Nijenhuis algebroid and show that any such Jacobi algebroid has an associated quasi-Jacobi bialgebroid. Therefore, also an associated Courant-Jacobi algebroid is obtained. We introduce the notions of quasi-Jacobi bialgebroid morphism and Courant-Jacobi algebroid morphism providing also some examples of Courant-Jacobi algebroid morphisms.
We propose a definition of Jacobi quasi-Nijenhuis algebroid and show that any such Jacobi algebroid has an associated quasi-Jacobi bialgebroid. Therefore, also an associated Courant-Jacobi algebroid is obtained. We introduce the notions of quasi-Jacobi bialgebroid morphism and Courant-Jacobi algebroid morphism providing also some examples of Courant-Jacobi algebroid morphisms.
△ Less
Submitted 1 March, 2010;
originally announced March 2010.
-
Reduction and construction of Poisson quasi-Nijenhuis manifolds with background
Authors:
Flavio Cordeiro,
Joana M. Nunes da Costa
Abstract:
We extend the Falceto-Zambon version of Marsden-Ratiu Poisson reduction to Poisson quasi-Nijenhuis structures with background on manifolds. We define gauge transformations of Poisson quasi-Nijenhuis structures with background, study some of their properties and show that they are compatible with reduction procedure. We use gauge transformations to construct Poisson quasi-Nijenhuis structures wit…
▽ More
We extend the Falceto-Zambon version of Marsden-Ratiu Poisson reduction to Poisson quasi-Nijenhuis structures with background on manifolds. We define gauge transformations of Poisson quasi-Nijenhuis structures with background, study some of their properties and show that they are compatible with reduction procedure. We use gauge transformations to construct Poisson quasi-Nijenhuis structures with background.
△ Less
Submitted 3 December, 2009;
originally announced December 2009.
-
On Poisson quasi-Nijenhuis Lie algebroids
Authors:
Raquel Caseiro,
Antonio De Nicola,
Joana M. Nunes da Costa
Abstract:
We propose a definition of Poisson quasi-Nijenhuis Lie algebroids as a natural generalization of Poisson quasi-Nijenhuis manifolds and show that any such Lie algebroid has an associated quasi-Lie bialgebroid. Therefore, also an associated Courant algebroid is obtained. We introduce the notion of a morphism of quasi-Lie bialgebroids and of the induced Courant algebroids morphism and provide some…
▽ More
We propose a definition of Poisson quasi-Nijenhuis Lie algebroids as a natural generalization of Poisson quasi-Nijenhuis manifolds and show that any such Lie algebroid has an associated quasi-Lie bialgebroid. Therefore, also an associated Courant algebroid is obtained. We introduce the notion of a morphism of quasi-Lie bialgebroids and of the induced Courant algebroids morphism and provide some examples of Courant algebroid morphisms. Finally, we use paired operators to deform doubles of Lie and quasi-Lie bialgebroids and find an application to generalized complex geometry.
△ Less
Submitted 15 June, 2008;
originally announced June 2008.
-
Jacobi-Nijenhuis algebroids and their modular classes
Authors:
Raquel Caseiro,
Joana M. Nunes da Costa
Abstract:
Jacobi-Nijenhuis algebroids are defined as a natural generalization of Poisson-Nijenhuis algebroids, in the case where there exists a Nijenhuis operator on a Jacobi algebroid which is compatible with it. We study modular classes of Jacobi and Jacobi-Nijenhuis algebroids.
Jacobi-Nijenhuis algebroids are defined as a natural generalization of Poisson-Nijenhuis algebroids, in the case where there exists a Nijenhuis operator on a Jacobi algebroid which is compatible with it. We study modular classes of Jacobi and Jacobi-Nijenhuis algebroids.
△ Less
Submitted 26 September, 2007; v1 submitted 11 June, 2007;
originally announced June 2007.
