-
Tuning parameter selection for the adaptive nuclear norm regularized trace regression
Authors:
Pan Shang,
Lingchen Kong,
Yiting Ma
Abstract:
Regularized models have been applied in lots of areas, with high-dimensional data sets being popular. Because tuning parameter decides the theoretical performance and computational efficiency of the regularized models, tuning parameter selection is a basic and important issue. We consider the tuning parameter selection for adaptive nuclear norm regularized trace regression, which achieves by the B…
▽ More
Regularized models have been applied in lots of areas, with high-dimensional data sets being popular. Because tuning parameter decides the theoretical performance and computational efficiency of the regularized models, tuning parameter selection is a basic and important issue. We consider the tuning parameter selection for adaptive nuclear norm regularized trace regression, which achieves by the Bayesian information criterion (BIC). The proposed BIC is established with the help of an unbiased estimator of degrees of freedom. Under some regularized conditions, this BIC is proved to achieve the rank consistency of the tuning parameter selection. That is the model solution under selected tuning parameter converges to the true solution and has the same rank with that of the true solution in probability. Some numerical results are presented to evaluate the performance of the proposed BIC on tuning parameter selection.
△ Less
Submitted 10 May, 2024;
originally announced May 2024.
-
Solving the train-platforming problem via a two-level Lagrangian Relaxation approach
Authors:
Qin Zhang,
Richard Martin Lusby,
Pan Shang,
Chang Liu,
Wenqian Liu
Abstract:
High-speed railway stations are crucial junctions in high-speed railway networks. Compared to operations on the tracks between stations, trains have more routing possibilities within stations. As a result, track allocation at a station is relatively complicated. In this study, we aim to solve the train platforming problem for a busy high-speed railway station by considering comprehensive track res…
▽ More
High-speed railway stations are crucial junctions in high-speed railway networks. Compared to operations on the tracks between stations, trains have more routing possibilities within stations. As a result, track allocation at a station is relatively complicated. In this study, we aim to solve the train platforming problem for a busy high-speed railway station by considering comprehensive track resources and interlocking configurations. A two-level space-time network is constructed to capture infrastructure information at various levels of detail from both macroscopic and microscopic perspectives. Additionally, we propose a nonlinear programming model that minimizes a weighted sum of total travel time and total deviation time for trains at the station. We apply a Two-level Lagrangian Relaxation (2-L LR) to a linearized version of the model and demonstrate how this induces a decomposable train-specific path choice problem at the macroscopic level that is guided by Lagrange multipliers associated with microscopic resource capacity violation. As case studies, the proposed model and solution approach are applied to a small virtual railway station and a high-speed railway hub station located on the busiest high-speed railway line in China. Through a comparison of other approaches that include Logic-based Benders Decomposition (LBBD), we highlight the superiority of the proposed method; on realistic instances, the 2-L LR method finds solution that are, on average, approximately 2% from optimality. Finally, we test algorithm performance at the operational level and obtain near-optimal solutions, with optimality gaps of approximately 1%, in a very short time.
△ Less
Submitted 2 May, 2024;
originally announced May 2024.
-
Safe Feature Identification Rule for Fused Lasso by An Extra Dual Variable
Authors:
Pan Shang,
Huangyue Chen,
Lingchen Kong
Abstract:
Fused Lasso was proposed to characterize the sparsity of the coefficients and the sparsity of their successive differences for the linear regression. Due to its wide applications, there are many existing algorithms to solve fused Lasso. However, the computation of this model is time-consuming in high-dimensional data sets. To accelerate the calculation of fused Lasso in high-dimension data sets, w…
▽ More
Fused Lasso was proposed to characterize the sparsity of the coefficients and the sparsity of their successive differences for the linear regression. Due to its wide applications, there are many existing algorithms to solve fused Lasso. However, the computation of this model is time-consuming in high-dimensional data sets. To accelerate the calculation of fused Lasso in high-dimension data sets, we build up the safe feature identification rule by introducing an extra dual variable. With a low computational cost, this rule can eliminate inactive features with zero coefficients and identify adjacent features with same coefficients in the solution. To the best of our knowledge, existing screening rules can not be applied to speed up the computation of fused Lasso and our work is the first one to deal with this problem. To emphasize our rule is a unique result that is capable of identifying adjacent features with same coefficients, we name the result as the safe feature identification rule. Numerical experiments on simulation and real data illustrate the efficiency of the rule, which means this rule can reduce the computational time of fused Lasso. In addition, our rule can be embedded into any efficient algorithm and speed up the computational process of fused Lasso.
△ Less
Submitted 15 April, 2024;
originally announced April 2024.
-
Safe subspace screening for the adaptive nuclear norm regularized trace regression
Authors:
Pan Shang,
Lingchen Kong
Abstract:
Matrix form data sets arise in many areas, so there are lots of works about the matrix regression models. One special model of these models is the adaptive nuclear norm regularized trace regression, which has been proven have good statistical performances. In order to accelerate the computation of this model, we consider the technique called screening rule. According to matrix decomposition and op…
▽ More
Matrix form data sets arise in many areas, so there are lots of works about the matrix regression models. One special model of these models is the adaptive nuclear norm regularized trace regression, which has been proven have good statistical performances. In order to accelerate the computation of this model, we consider the technique called screening rule. According to matrix decomposition and optimal condition of the model, we develop a safe subspace screening rule that can be used to identify inactive subspace of the solution decomposition and reduce the dimension of the solution. To evaluate the efficiency of the safe subspace screening rule, we embed this result into the alternating direction method of multipliers algorithm under a sequence of the tuning parameters. Under this process, each solution under the tuning parameter provides a matrix decomposition space. Then, the safe subspace screening rule is applied to eliminate inactive subspace, reduce the solution dimension and accelerate the computation process. Some numerical experiments are implemented on simulation data sets and real data sets, which illustrate the efficiency of our screening rule.
△ Less
Submitted 15 April, 2024; v1 submitted 10 April, 2024;
originally announced April 2024.
-
l1-norm quantile regression screening rule via the dual circumscribed sphere
Authors:
Pan Shang,
Lingchen Kong
Abstract:
l1-norm quantile regression is a common choice if there exists outlier or heavy-tailed error in high-dimensional data sets. However, it is computationally expensive to solve this problem when the feature size of data is ultra high. As far as we know, existing screening rules can not speed up the computation of the l1-norm quantile regression, which dues to the non-differentiability of the quantile…
▽ More
l1-norm quantile regression is a common choice if there exists outlier or heavy-tailed error in high-dimensional data sets. However, it is computationally expensive to solve this problem when the feature size of data is ultra high. As far as we know, existing screening rules can not speed up the computation of the l1-norm quantile regression, which dues to the non-differentiability of the quantile function/pinball loss. In this paper, we introduce the dual circumscribed sphere technique and propose a novel l1-norm quantile regression screening rule. Our rule is expressed as the closed-form function of given data and eliminates inactive features with a low computational cost. Numerical experiments on some simulation and real data sets show that this screening rule can be used to eliminate almost all inactive features. Moreover, this rule can help to reduce up to 23 times of computational time, compared with the computation without our screening rule.
△ Less
Submitted 16 December, 2020;
originally announced December 2020.
-
Existence of a traveling wave solution in a free interface problem with fractional order kinetics
Authors:
Claude-Michel Brauner,
Robert Roussarie,
Peipei Shang,
Linwan Zhang
Abstract:
In this paper we consider a system of two reaction-diffusion equations that models diffusional-thermal combustion with stepwise ignition-temperature kinetics and fractional reaction order 0 < $α$ < 1. We turn the free interface problem into a scalar free boundary problem coupled with an integral equation. The main intermediary step is to reduce the scalar problem to the study of a non-C 1 vector f…
▽ More
In this paper we consider a system of two reaction-diffusion equations that models diffusional-thermal combustion with stepwise ignition-temperature kinetics and fractional reaction order 0 < $α$ < 1. We turn the free interface problem into a scalar free boundary problem coupled with an integral equation. The main intermediary step is to reduce the scalar problem to the study of a non-C 1 vector field in dimension 2. The latter is treated by qualitative topo-logical methods based on the Poincar{é}-Bendixson Theorem. The phase portrait is determined and the existence of a stable manifold at the origin is proved. A significant result is that the settling time to reach the origin is finite, meaning that the trailing interface is finite in contrast to the case $α$ = 1, but in accordance with $α$ = 0. Finally, the integro-differential system is solved via a fixed-point method.
△ Less
Submitted 29 October, 2020;
originally announced October 2020.
-
Boundary stabilization in finite time of one-dimensional linear hyperbolic balance laws with coefficients depending on time and space
Authors:
Jean-Michel Coron,
Long Hu,
Guillaume Olive,
Peipei Shang
Abstract:
In this article we are interested in the boundary stabilization in finite time of one-dimensional linear hyperbolic balance laws with coefficients depending on time and space. We extend the so called "backstep** method" by introducing appropriate time-dependent integral transformations in order to map our initial system to a new one which has desired stability properties. The kernels of the inte…
▽ More
In this article we are interested in the boundary stabilization in finite time of one-dimensional linear hyperbolic balance laws with coefficients depending on time and space. We extend the so called "backstep** method" by introducing appropriate time-dependent integral transformations in order to map our initial system to a new one which has desired stability properties. The kernels of the integral transformations involved are solutions to non standard multi-dimensional hyperbolic PDEs, where the time dependence introduces several new difficulties in the treatment of their well-posedness. This work generalizes previous results of the literature, where only time-independent systems were considered.
△ Less
Submitted 27 April, 2020;
originally announced April 2020.
-
Regularization parameter selection for low rank matrix recovery
Authors:
Pan Shang,
Lingchen Kong
Abstract:
Low rank matrix recovery is the focus of many applications, but it is a NP-hard problem. A popular way to deal with this problem is to solve its convex relaxation, the nuclear norm regularized minimization problem (NRM), which includes LASSO as a special case. There are some regularization parameter selection results for LASSO in vector case, such as screening rules, which improve the efficiency o…
▽ More
Low rank matrix recovery is the focus of many applications, but it is a NP-hard problem. A popular way to deal with this problem is to solve its convex relaxation, the nuclear norm regularized minimization problem (NRM), which includes LASSO as a special case. There are some regularization parameter selection results for LASSO in vector case, such as screening rules, which improve the efficiency of the algorithms. However, there are no corresponding parameter selection results for NRM in matrix case. In this paper, we build up a novel rule to choose the regularization parameter for NRM under the help of duality theory. This rule claims that the regularization parameter can be easily chosen by feasible points of NRM and its dual problem, when the rank of the desired solution is no more than a given constant. In particular, we apply this idea to NRM with least square and Huber functions, and establish the easily calculated formula of regularization parameters. Finally, we report numerical results on some signal shapes, which state that our proposed rule shrinks the interval of the regularization parameter efficiently.
△ Less
Submitted 15 September, 2019;
originally announced September 2019.
-
Tuning parameter selection rules for nuclear norm regularized multivariate linear regression
Authors:
Pan Shang,
Lingchen Kong
Abstract:
We consider the tuning parameter selection rules for nuclear norm regularized multivariate linear regression (NMLR) in high-dimensional setting. High-dimensional multivariate linear regression is widely used in statistics and machine learning, and regularization technique is commonly applied to deal with the special structures in high-dimensional data. As we know, how to select the tuning paramete…
▽ More
We consider the tuning parameter selection rules for nuclear norm regularized multivariate linear regression (NMLR) in high-dimensional setting. High-dimensional multivariate linear regression is widely used in statistics and machine learning, and regularization technique is commonly applied to deal with the special structures in high-dimensional data. As we know, how to select the tuning parameter is an essential issue for regularization approach and it directly affects the model estimation performance. To the best of our knowledge, there are no rules about the tuning parameter selection for NMLR from the point of view of optimization. In order to establish such rules, we study the duality theory of NMLR. Then, we claim the choice of tuning parameter for NMLR is based on the sample data and the solution of NMLR dual problem, which is a projection on a nonempty, closed and convex set. Moreover, based on the (firm) nonexpansiveness and the idempotence of the projection operator, we build four tuning parameter selection rules PSR, PSRi, PSRfn and PSR+. Furthermore, we give a sequence of tuning parameters and the corresponding intervals for every rule, which states that the rank of the estimation coefficient matrix is no more than a fixed number for the tuning parameter in the given interval. The relationships between these rules are also discussed and PSR+ is the most efficient one to select the tuning parameter. Finally, the numerical results are reported on simulation and real data, which show that these four tuning parameter selection rules are valuable.
△ Less
Submitted 19 January, 2019;
originally announced January 2019.
-
Asymptotic stability of a Korteweg-de Vries equation with a two-dimensional center manifold
Authors:
Shuxia Tang,
Jixun Chu,
Peipei Shang,
Jean-Michel Coron
Abstract:
Local asymptotic stability analysis is conducted for an initial-boundary-value problem of a Korteweg-de Vries equation posed on a finite interval $\left[0, 2π\sqrt{7/3}\right]$. The equation comes with a Dirichlet boundary condition at the left end-point and both of the Dirichlet and Neumann homogeneous boundary conditions at the right end-point. It is known that the associated linearized equation…
▽ More
Local asymptotic stability analysis is conducted for an initial-boundary-value problem of a Korteweg-de Vries equation posed on a finite interval $\left[0, 2π\sqrt{7/3}\right]$. The equation comes with a Dirichlet boundary condition at the left end-point and both of the Dirichlet and Neumann homogeneous boundary conditions at the right end-point. It is known that the associated linearized equation around the origin is not asymptotically stable. In this paper, the nonlinear Korteweg-de Vries equation is proved to be locally asymptotically stable around the origin through the center manifold method. In particular, the existence of a two-dimensional local center manifold is presented, which is locally exponentially attractive. By analyzing the Korteweg-de Vries equation restricted on the local center manifold, a polynomial decay rate of the solution is obtained.
△ Less
Submitted 5 April, 2016;
originally announced April 2016.
-
Well-posedness and exact controllability of the mass balance equations for an extrusion process
Authors:
Mamadou Diagne,
Peipei Shang,
Zhiqiang Wang
Abstract:
In this paper, we study the well-posedness and exact controllability of a physical model for a food extrusion process in the isothermal case. The model expresses the mass balance in the extruder chamber and consists of a hyperbolic Partial Differential Equation (PDE) and a nonlinear Ordinary Differential Equation (ODE) whose dynamics describes the evolution of a moving interface. By suitable chang…
▽ More
In this paper, we study the well-posedness and exact controllability of a physical model for a food extrusion process in the isothermal case. The model expresses the mass balance in the extruder chamber and consists of a hyperbolic Partial Differential Equation (PDE) and a nonlinear Ordinary Differential Equation (ODE) whose dynamics describes the evolution of a moving interface. By suitable change of coordinates and fixed point arguments, we prove the existence, uniqueness and regularity of the solution, and finally the exact controllability of the coupled system.
△ Less
Submitted 13 July, 2015;
originally announced July 2015.
-
Feedback stabilization for the mass balance equations of a food extrusion process
Authors:
Mamadou Diagne,
Peipei Shang,
Zhiqiang Wang
Abstract:
In this paper, we study the stabilization problem for a food extrusion process in the isothermal case. The model expresses the mass conservation in the extruder chamber and consists of a hyperbolic Partial Differential Equation (PDE) and a nonlinear Ordinary Differential Equation (ODE) whose dynamics describes the evolution of a moving interface. By using a Lyapunov approach, we obtain the exponen…
▽ More
In this paper, we study the stabilization problem for a food extrusion process in the isothermal case. The model expresses the mass conservation in the extruder chamber and consists of a hyperbolic Partial Differential Equation (PDE) and a nonlinear Ordinary Differential Equation (ODE) whose dynamics describes the evolution of a moving interface. By using a Lyapunov approach, we obtain the exponential stabilization for the closed-loop system under natural feedback controls through indirect measurements.
△ Less
Submitted 1 February, 2015;
originally announced February 2015.
-
Well-posedness of the extrusion model described by coupled hyperbolic systems with a free boundary
Authors:
Peipei Shang,
Mamadou Diagne,
Zhiqiang Wang
Abstract:
In this paper, we consider the well-posedness of the Cauchy problem for a physical model of the extrusion process, which is described by two systems of conservation laws with a free boundary. By suitable change of coordinates and fixed point argument, we obtain the existence, uniqueness and regularity of the weak solution to this Cauchy problem.
In this paper, we consider the well-posedness of the Cauchy problem for a physical model of the extrusion process, which is described by two systems of conservation laws with a free boundary. By suitable change of coordinates and fixed point argument, we obtain the existence, uniqueness and regularity of the weak solution to this Cauchy problem.
△ Less
Submitted 15 April, 2014; v1 submitted 13 April, 2014;
originally announced April 2014.
-
Optimization of an Amplification Protocol for Misfolded Proteins by using Relaxed Control
Authors:
Jean-Michel Coron,
Pierre Gabriel,
Peipei Shang
Abstract:
We investigate an optimal control problem which arises in the optimization of an amplification technique for misfolded proteins. The improvement of this technique may play a role in the detection of prion diseases. The model consists in a linear system of differential equations with a nonlinear control. The appearance of oscillations in the numerical simulations is understood by using the Perron a…
▽ More
We investigate an optimal control problem which arises in the optimization of an amplification technique for misfolded proteins. The improvement of this technique may play a role in the detection of prion diseases. The model consists in a linear system of differential equations with a nonlinear control. The appearance of oscillations in the numerical simulations is understood by using the Perron and Floquet eigenvalue theory for nonnegative irreductible matrices. Then to overcome the unsolvability of the optimal control, we relax the problem. In the two dimensional case we solve explicitely the optimal relaxed control problem when the final time is large enough.
△ Less
Submitted 29 January, 2014; v1 submitted 10 September, 2013;
originally announced September 2013.
-
Asymptotic stability of a nonlinear Korteweg-de Vries equation with a critical length
Authors:
Jixun Chu,
Jean-Michel Coron,
Peipei Shang
Abstract:
We study an initial-boundary-value problem of a nonlinear Korteweg-de Vries equation posed on a finite interval (0,2pi). The whole system has Dirichlet boundary condition at the left end-point, and both of Dirichlet and Neumann homogeneous boundary conditions at the right end-point. It is known that the origin is not asymptotically stable for the linearized system around the origin. We prove that…
▽ More
We study an initial-boundary-value problem of a nonlinear Korteweg-de Vries equation posed on a finite interval (0,2pi). The whole system has Dirichlet boundary condition at the left end-point, and both of Dirichlet and Neumann homogeneous boundary conditions at the right end-point. It is known that the origin is not asymptotically stable for the linearized system around the origin. We prove that the origin is (locally) asymptotically stable for the nonlinear system.
△ Less
Submitted 16 June, 2013;
originally announced June 2013.
-
Optimal control of cell mass and maturity in a model of follicular ovulation
Authors:
Frédérique Clément,
Jean-Michel Coron,
Peipei Shang
Abstract:
In this paper, we study optimal control problems associated with a scalar hyperbolic conservation law modeling the development of ovarian follicles. Changes in the age and maturity of follicular cells are described by a 2D conservation law, where the control terms act on the velocities. The control problem consists in optimizing the follicular cell resources so that the follicular maturity reaches…
▽ More
In this paper, we study optimal control problems associated with a scalar hyperbolic conservation law modeling the development of ovarian follicles. Changes in the age and maturity of follicular cells are described by a 2D conservation law, where the control terms act on the velocities. The control problem consists in optimizing the follicular cell resources so that the follicular maturity reaches a maximal value in fixed time. Formulating the optimal control problem within a hybrid framework, we prove necessary optimality conditions in the form of Hybrid Maximum Principle. Then we derive the optimal strategy and show that there exists at least one optimal bang-bang control with one single switching time.
△ Less
Submitted 15 October, 2012; v1 submitted 9 February, 2012;
originally announced February 2012.
-
Cauchy problem for multiscale conservation laws: Application to structured cell populations
Authors:
Peipei Shang
Abstract:
In this paper, we study a vector conservation law that models the growth and selection of ovarian follicles. During each ovarian cycle, only a definite number of follicles ovulate, while the others undergo a degeneration process called atresia. This work is motivated by a multiscale mathematical model starting on the cellular scale, where ovulation or atresia result from a hormonally controlled se…
▽ More
In this paper, we study a vector conservation law that models the growth and selection of ovarian follicles. During each ovarian cycle, only a definite number of follicles ovulate, while the others undergo a degeneration process called atresia. This work is motivated by a multiscale mathematical model starting on the cellular scale, where ovulation or atresia result from a hormonally controlled selection process. A two-dimensional conservation law describes the age and maturity structuration of the follicular cell populations. The densities intersect through a coupled hyperbolic system between different follicles and cell phases, which results in a vector conservation law and coupling boundary conditions. The maturity velocity functions possess both a local and nonlocal character. We prove the existence and uniqueness of the weak solution to the Cauchy problem with bounded initial and boundary data.
△ Less
Submitted 11 October, 2010;
originally announced October 2010.
-
Analysis and control of a scalar conservation law modeling a highly re-entrant manufacturing system
Authors:
Peipei Shang,
Zhiqiang Wang
Abstract:
In this paper, we study a scalar conservation law that models a highly re-entrant manufacturing system as encountered in semi-conductor production. As a generalization of \cite{CKWang}, the velocity function possesses both the local and nonlocal character. We prove the existence and uniqueness of the weak solution to the Cauchy problem with initial and boundary data in $L^{\infty}$. We also obtain…
▽ More
In this paper, we study a scalar conservation law that models a highly re-entrant manufacturing system as encountered in semi-conductor production. As a generalization of \cite{CKWang}, the velocity function possesses both the local and nonlocal character. We prove the existence and uniqueness of the weak solution to the Cauchy problem with initial and boundary data in $L^{\infty}$. We also obtain the stability (continuous dependence) of both the solution and the out-flux with respect to the initial and boundary data. Finally, we prove the existence of an optimal control that minimizes, in the $L^p$-sense with $p\in [1,\infty)$, the difference between the actual out-flux and a forecast demand over a fixed time period.
△ Less
Submitted 23 March, 2010;
originally announced March 2010.