-
Elastica Models for Color Image Regularization
Authors:
Hao Liu,
Xue-Cheng Tai,
Ron Kimmel,
Roland Glowinski
Abstract:
One classical approach to regularize color is to tream them as two dimensional surfaces embedded in a five dimensional spatial-chromatic space. In this case, a natural regularization term arises as the image surface area. Choosing the chromatic coordinates as dominating over the spatial ones, the image spatial coordinates could be thought of as a paramterization of the image surface manifold in a…
▽ More
One classical approach to regularize color is to tream them as two dimensional surfaces embedded in a five dimensional spatial-chromatic space. In this case, a natural regularization term arises as the image surface area. Choosing the chromatic coordinates as dominating over the spatial ones, the image spatial coordinates could be thought of as a paramterization of the image surface manifold in a three dimensional color space. Minimizing the area of the image manifold leads to the Beltrami flow or mean curvature flow of the image surface in the 3D color space, while minimizing the elastica of the image surface yields an additional interesting regularization. Recently, the authors proposed a color elastica model, which minimizes both the surface area and elastica of the image manifold. In this paper, we propose to modify the color elastica and introduce two new models for color image regularization. The revised measures are motivated by the relations between the color elastica model, Euler's elastica model and the total variation model for gray level images. Compared to our previous color elastica model, the new models are direct extensions of Euler's elastica model to color images. The proposed models are nonlinear and challenging to minimize. To overcome this difficulty, two operator-splitting methods are suggested. Specifically, nonlinearities are decoupled by introducing new vector- and matrix-valued variables. Then, the minimization problems are converted to solving initial value problems which are time-discretized by operator splitting. Each subproblem, after splitting either, has a closed-form solution or can be solved efficiently. The effectiveness and advantages of the proposed models are demonstrated by comprehensive experiments. The benefits of incorporating the elastica of the image surface as regularization terms compared to common alternatives are empirically validated.
△ Less
Submitted 24 November, 2022; v1 submitted 18 March, 2022;
originally announced March 2022.
-
Bilinear Optimal Control of an Advection-reaction-diffusion System
Authors:
Roland Glowinski,
Yongcun Song,
Xiaoming Yuan,
Hangrui Yue
Abstract:
We consider the bilinear optimal control of an advection-reaction-diffusion system, where the control arises as the velocity field in the advection term. Such a problem is generally challenging from both theoretical analysis and algorithmic design perspectives mainly because the state variable depends nonlinearly on the control variable and an additional divergence-free constraint on the control i…
▽ More
We consider the bilinear optimal control of an advection-reaction-diffusion system, where the control arises as the velocity field in the advection term. Such a problem is generally challenging from both theoretical analysis and algorithmic design perspectives mainly because the state variable depends nonlinearly on the control variable and an additional divergence-free constraint on the control is coupled together with the state equation.
Mathematically, the proof of the existence of optimal solutions is delicate, and up to now, only some results are known for a few special cases where additional restrictions are imposed on the space dimension and the regularity of the control. We prove the existence of optimal controls and derive the first-order optimality conditions in general settings without any extra assumption. Computationally, the well-known conjugate gradient (CG) method can be applied conceptually. However, due to the additional divergence-free constraint on the control variable and the nonlinear relation between the state and control variables, it is challenging to compute the gradient and the optimal stepsize at each CG iteration, and thus nontrivial to implement the CG method. To address these issues, we advocate a fast inner preconditioned CG method to ensure the divergence-free constraint and an efficient inexactness strategy to determine an appropriate stepsize. An easily implementable nested CG method is thus proposed for solving such a complicated problem. For the numerical discretization, we combine finite difference methods for the time discretization and finite element methods for the space discretization. Efficiency of the proposed nested CG method is promisingly validated by the results of some preliminary numerical experiments.
△ Less
Submitted 7 January, 2021;
originally announced January 2021.
-
Overlap** Domain Decomposition Methods for Ptychographic Imaging
Authors:
Huibin Chang,
Roland Glowinski,
Stefano Marchesini,
Xue-cheng Tai,
Yang Wang,
Tieyong Zeng
Abstract:
In ptychography experiments, redundant scanning is usually required to guarantee the stable recovery, such that a huge amount of frames are generated, and thus it poses a great demand of parallel computing in order to solve this large-scale inverse problem. In this paper, we propose the overlap** Domain Decomposition Methods(DDMs) to solve the nonconvex optimization problem in ptychographic imag…
▽ More
In ptychography experiments, redundant scanning is usually required to guarantee the stable recovery, such that a huge amount of frames are generated, and thus it poses a great demand of parallel computing in order to solve this large-scale inverse problem. In this paper, we propose the overlap** Domain Decomposition Methods(DDMs) to solve the nonconvex optimization problem in ptychographic imaging. They decouple the problem defined on the whole domain into subproblems only defined on the subdomains with synchronizing information in the overlap** regions of these subdomains,thus leading to highly parallel algorithms with good load balance. More specifically, for the nonblind recovery (with known probe in advance), by enforcing the continuity of the overlap** regions for the image (sample), the nonlinear optimization model is established based on a novel smooth-truncated amplitude-Gaussian metric (ST-AGM). Such metric allows for fast calculation of the proximal map** with closed form, and meanwhile provides the possibility for the convergence guarantee of the first-order nonconvex optimization algorithm due to its Lipschitz smoothness. Then the Alternating Direction Method of Multipliers (ADMM) is utilized to generate an efficient Overlap** Domain Decomposition based Ptychography algorithm(OD2P) for the two-subdomain domain decomposition (DD), where all subproblems can be computed with close-form solutions.Due to the Lipschitz continuity for the gradient of the objective function with ST-AGM, the convergence of the proposed OD2P is derived under mild conditions. Moreover, it is extended to more general case including multiple-subdomain DD and blind recovery. Numerical experiments are further conducted to show the performance of proposed algorithms, demonstrating good convergence speed and robustness to the noise.
△ Less
Submitted 4 February, 2021; v1 submitted 30 October, 2020;
originally announced November 2020.
-
On the Numerical Solution of Nonlinear Eigenvalue Problems for the Monge-Ampère Operator
Authors:
Roland Glowinski,
Shingyu Leung,
Hao Liu,
Jianliang Qian
Abstract:
In this article, we report the results we obtained when investigating the numerical solution of some nonlinear eigenvalue problems for the Monge-Ampère operator $v\rightarrow \det \mathbf{D}^2 v$. The methodology we employ relies on the following ingredients: (i) A divergence formulation of the eigenvalue problems under consideration. (ii) The time discretization by operator-splitting of an initia…
▽ More
In this article, we report the results we obtained when investigating the numerical solution of some nonlinear eigenvalue problems for the Monge-Ampère operator $v\rightarrow \det \mathbf{D}^2 v$. The methodology we employ relies on the following ingredients: (i) A divergence formulation of the eigenvalue problems under consideration. (ii) The time discretization by operator-splitting of an initial value problem (a kind of gradient flow) associated with each eigenvalue problem. (iii) A finite element approximation relying on spaces of continuous piecewise affine functions. To validate the above methodology, we applied it to the solution of problems with known exact solutions: The results we obtained suggest convergence to the exact solution when the space discretization step $h\rightarrow 0$. We considered also test problems with no known exact solutions.
△ Less
Submitted 9 September, 2020; v1 submitted 18 August, 2020;
originally announced August 2020.
-
Discrete Dynamical System Approaches for Boolean Polynomial Optimization
Authors:
Yi-Shuai Niu,
Roland Glowinski
Abstract:
In this article, we discuss the numerical solution of Boolean polynomial programs by algorithms borrowing from numerical methods for differential equations, namely the Houbolt scheme, the Lie scheme, and a Runge-Kutta scheme. We first introduce a quartic penalty functional (of Ginzburg-Landau type) to approximate the Boolean program by a continuous one and prove some convergence results as the pen…
▽ More
In this article, we discuss the numerical solution of Boolean polynomial programs by algorithms borrowing from numerical methods for differential equations, namely the Houbolt scheme, the Lie scheme, and a Runge-Kutta scheme. We first introduce a quartic penalty functional (of Ginzburg-Landau type) to approximate the Boolean program by a continuous one and prove some convergence results as the penalty parameter $\varepsilon$ converges to $0$. We prove also that, under reasonable assumptions, the distance between local minimizers of the penalized problem and the set $\{\pm1\}^n$ is of order $O(\sqrt{n}\varepsilon)$. Next, we introduce algorithms for the numerical solution of the penalized problem, these algorithms relying on the Houbolt, Lie and Runge-Kutta schemes, classical methods for the numerical solution of ordinary or partial differential equations. We performed numerical experiments to investigate the impact of various parameters on the convergence of the algorithms. We have tested our ODE approaches and compared with the classical nonlinear optimization solver IPOPT and a quadratic binary formulation approach (QB-G) as well as an exhaustive method using parallel computing techniques. The numerical results on various datasets (including small and large-scale randomly generated synthetic datasets of general Boolean polynomial optimization problems, and a large-scale heterogeneous MQLib benchmark dataset of Max-Cut and Quadratic Unconstrained Binary Optimization (QUBO) problems) show good performances for our ODE approaches. As a result, our ODE algorithms often converge faster than the other compared methods to better integer solutions of the Boolean program.
△ Less
Submitted 25 April, 2022; v1 submitted 21 December, 2019;
originally announced December 2019.
-
A New Operator Splitting Method for Euler's Elastica Model
Authors:
Liang-Jian Deng,
Roland Glowinski,
Xue-Cheng Tai
Abstract:
Euler's elastica model has a wide range of applications in Image Processing and Computer Vision. However, the non-convexity, the non-smoothness and the nonlinearity of the associated energy functional make its minimization a challenging task, further complicated by the presence of high order derivatives in the model. In this article we propose a new operator-splitting algorithm to minimize the Eul…
▽ More
Euler's elastica model has a wide range of applications in Image Processing and Computer Vision. However, the non-convexity, the non-smoothness and the nonlinearity of the associated energy functional make its minimization a challenging task, further complicated by the presence of high order derivatives in the model. In this article we propose a new operator-splitting algorithm to minimize the Euler elastica functional. This algorithm is obtained by applying an operator-splitting based time discretization scheme to an initial value problem (dynamical flow) associated with the optimality system (a system of multivalued equations). The sub-problems associated with the three fractional steps of the splitting scheme have either closed form solutions or can be handled by fast dedicated solvers. Compared with earlier approaches relying on ADMM (Alternating Direction Method of Multipliers), the new method has, essentially, only the time discretization step as free parameter to choose, resulting in a very robust and stable algorithm. The simplicity of the sub-problems and its modularity make this algorithm quite efficient. Applications to the numerical solution of smoothing test problems demonstrate the efficiency and robustness of the proposed methodology.
△ Less
Submitted 16 November, 2018;
originally announced November 2018.
-
A Modular, Operator Splitting Scheme for Fluid-Structure Interaction Problems with Thick Structures
Authors:
Martina Bukac,
Suncica Canic,
Roland Glowinski,
Boris Muha,
Annalisa Quaini
Abstract:
We present an operator-splitting scheme for fluid-structure interaction (FSI) problems in hemodynamics, where the thickness of the structural wall is comparable to the radius of the cylindrical fluid domain. The equations of linear elasticity are used to model the structure, while the Navier-Stokes equations for an incompressible viscous fluid are used to model the fluid. The operator splitting sc…
▽ More
We present an operator-splitting scheme for fluid-structure interaction (FSI) problems in hemodynamics, where the thickness of the structural wall is comparable to the radius of the cylindrical fluid domain. The equations of linear elasticity are used to model the structure, while the Navier-Stokes equations for an incompressible viscous fluid are used to model the fluid. The operator splitting scheme, based on Lie splitting, separates the elastodynamics structure problem, from a fluid problem in which structure inertia is included to achieve unconditional stability. We prove energy estimates associated with unconditional stability of this modular scheme for the full nonlinear FSI problem defined on a moving domain, without requiring any sub-iterations within time steps. Two numerical examples are presented, showing excellent agreement with the results of monolithic schemes. First-order convergence in time is shown numerically. Modularity, unconditional stability without temporal sub-iterations, and simple implementation are the features that make this operator-splitting scheme particularly appealing for multi-physics problems involving fluid-structure interaction.
△ Less
Submitted 13 November, 2013;
originally announced November 2013.
-
Fluid-structure interaction in blood flow capturing non-zero longitudinal structure displacement
Authors:
Martina Bukac,
Suncica Canic,
Roland Glowinski,
Josip Tambaca,
Annalisa Quaini
Abstract:
We present a new model and a novel loosely coupled partitioned numerical scheme modeling fluid-structure interaction (FSI) in blood flow allowing non-zero longitudinal displacement. Arterial walls are modeled by a {linearly viscoelastic, cylindrical Koiter shell model capturing both radial and longitudinal displacement}. Fluid flow is modeled by the Navier-Stokes equations for an incompressible, v…
▽ More
We present a new model and a novel loosely coupled partitioned numerical scheme modeling fluid-structure interaction (FSI) in blood flow allowing non-zero longitudinal displacement. Arterial walls are modeled by a {linearly viscoelastic, cylindrical Koiter shell model capturing both radial and longitudinal displacement}. Fluid flow is modeled by the Navier-Stokes equations for an incompressible, viscous fluid. The two are fully coupled via kinematic and dynamic coupling conditions. Our numerical scheme is based on a new modified Lie operator splitting that decouples the fluid and structure sub-problems in a way that leads to a loosely coupled scheme which is {unconditionally} stable. This was achieved by a clever use of the kinematic coupling condition at the fluid and structure sub-problems, leading to an implicit coupling between the fluid and structure velocities. The proposed scheme is a modification of the recently introduced "kinematically coupled scheme" for which the newly proposed modified Lie splitting significantly increases the accuracy. The performance and accuracy of the scheme were studied on a couple of instructive examples including a comparison with a monolithic scheme. It was shown that the accuracy of our scheme was comparable to that of the monolithic scheme, while our scheme retains all the main advantages of partitioned schemes, such as modularity, simple implementation, and low computational costs.
△ Less
Submitted 29 June, 2012;
originally announced July 2012.
-
Computational Techniques for Simulating Natural Convection in Three-Dimensional Enclosures with Tetrahedral Finite Elements
Authors:
Kehinde O. Ladipo,
Roland Glowinski,
Tsorng-Whay Pan
Abstract:
This article discusses computational techniques for simulating natural convection in three-dimensional domains using finite element methods with tetrahedral elements. These techniques form a new numerical procedure for this kind of problems. In this procedure, the treatment of advection by a wave equation approach is extended to three-dimensional unstructured meshes with tetrahedra.
Numerical…
▽ More
This article discusses computational techniques for simulating natural convection in three-dimensional domains using finite element methods with tetrahedral elements. These techniques form a new numerical procedure for this kind of problems. In this procedure, the treatment of advection by a wave equation approach is extended to three-dimensional unstructured meshes with tetrahedra.
Numerical results of natural convection of an incompressible Newtonian fluid in a cubical enclosure at Rayleigh numbers in the range $10^3$ to $10 ^6$ are obtained and they are in good agreement with those in literature obtained by other methods.
△ Less
Submitted 1 September, 2003;
originally announced September 2003.
