Showing 1–50 of 50 results for author: Misra, S

On Stability of Syzygy Bundles

Authors: Snehajit Misra, Nabanita Ray

Abstract: In this article, we investigate the stability of syzygy bundles corresponding to ample and globally generated vector bundles on smooth irreducible projective surfaces. In this article, we investigate the stability of syzygy bundles corresponding to ample and globally generated vector bundles on smooth irreducible projective surfaces. △ Less

Submitted 27 May, 2024; originally announced May 2024.

On Serrano's conjecture on Projective bundles

Authors: Snehajit Misra

Abstract: In this article, we investigate Serrano's conjecture for strictly nef divisors on projective bundles over higher dimensional smooth projective varieties. In this article, we investigate Serrano's conjecture for strictly nef divisors on projective bundles over higher dimensional smooth projective varieties. △ Less

Submitted 9 May, 2024; originally announced May 2024.

Sample-Based Conservative Bias Linear Power Flow Approximations

Authors: Paprapee Buason, Sidhant Misra, Daniel K. Molzahn

Abstract: The power flow equations are central to many problems in power system planning, analysis, and control. However, their inherent non-linearity and non-convexity present substantial challenges during problem-solving processes, especially for optimization problems. Accordingly, linear approximations are commonly employed to streamline computations, although this can often entail compromises in accurac… ▽ More The power flow equations are central to many problems in power system planning, analysis, and control. However, their inherent non-linearity and non-convexity present substantial challenges during problem-solving processes, especially for optimization problems. Accordingly, linear approximations are commonly employed to streamline computations, although this can often entail compromises in accuracy and feasibility. This paper proposes an approach termed Conservative Bias Linear Approximations (CBLA) for addressing these limitations. By minimizing approximation errors across a specified operating range while incorporating conservativeness (over- or under-estimating quantities of interest), CBLA strikes a balance between accuracy and tractability by maintaining linear constraints. By allowing users to design loss functions tailored to the specific approximated function, the bias approximation approach significantly enhances approximation accuracy. We illustrate the effectiveness of our proposed approach through several test cases. △ Less

Submitted 15 April, 2024; originally announced April 2024.

Adaptive Power Flow Approximations with Second-Order Sensitivity Insights

Authors: Paprapee Buason, Sidhant Misra, Jean-Paul Watson, Daniel K. Molzahn

Abstract: The power flow equations are fundamental to power system planning, analysis, and control. However, the inherent non-linearity and non-convexity of these equations present formidable obstacles in problem-solving processes. To mitigate these challenges, recent research has proposed adaptive power flow linearizations that aim to achieve accuracy over wide operating ranges. The accuracy of these appro… ▽ More The power flow equations are fundamental to power system planning, analysis, and control. However, the inherent non-linearity and non-convexity of these equations present formidable obstacles in problem-solving processes. To mitigate these challenges, recent research has proposed adaptive power flow linearizations that aim to achieve accuracy over wide operating ranges. The accuracy of these approximations inherently depends on the curvature of the power flow equations within these ranges, which necessitates looking at second-order sensitivities. In this paper, we leverage second-order sensitivities to both analyze and improve power flow approximations. We evaluate the curvature across broad operational ranges and subsequently utilize this information to inform the computation of various sampling-based power flow approximation techniques. Additionally, we leverage second-order sensitivities to guide the development of rational approximations that yield linear constraints in optimization problems. This approach is extended to enhance accuracy beyond the limitations of linear functions across varied operational scenarios. △ Less

Submitted 5 April, 2024; originally announced April 2024.

An Efficient Quantum Algorithm for Linear System Problem in Tensor Format

Authors: Zeguan Wu, Sidhant Misra, Tamás Terlaky, Xiu Yang, Marc Vuffray

Abstract: Solving linear systems is at the foundation of many algorithms. Recently, quantum linear system algorithms (QLSAs) have attracted great attention since they converge to a solution exponentially faster than classical algorithms in terms of the problem dimension. However, low-complexity circuit implementations of the oracles assumed in these QLSAs constitute the major bottleneck for practical quantu… ▽ More Solving linear systems is at the foundation of many algorithms. Recently, quantum linear system algorithms (QLSAs) have attracted great attention since they converge to a solution exponentially faster than classical algorithms in terms of the problem dimension. However, low-complexity circuit implementations of the oracles assumed in these QLSAs constitute the major bottleneck for practical quantum speed-up in solving linear systems. In this work, we focus on the application of QLSAs for linear systems that are expressed as a low rank tensor sums, which arise in solving discretized PDEs. Previous works uses modified Krylov subspace methods to solve such linear systems with a per-iteration complexity being polylogarithmic of the dimension but with no guarantees on the total convergence cost. We propose a quantum algorithm based on the recent advances on adiabatic-inspired QLSA and perform a detailed analysis of the circuit depth of its implementation. We rigorously show that the total complexity of our implementation is polylogarithmic in the dimension, which is comparable to the per-iteration complexity of the classical heuristic methods. △ Less

Submitted 28 March, 2024; originally announced March 2024.

MSC Class: 65F05; 68Q12; 81P68

Stochastic Finite Volume Method for Uncertainty Management in Gas Pipeline Network Flows

Authors: Saif R. Kazi, Sidhant Misra, Svetlana Tokareva, Kaarthik Sundar, Anatoly Zlotnik

Abstract: Natural gas consumption by users of pipeline networks is subject to increasing uncertainty that originates from the intermittent nature of electric power loads serviced by gas-fired generators. To enable computationally efficient optimization of gas network flows subject to uncertainty, we develop a finite volume representation of stochastic solutions of hyperbolic partial differential equation (P… ▽ More Natural gas consumption by users of pipeline networks is subject to increasing uncertainty that originates from the intermittent nature of electric power loads serviced by gas-fired generators. To enable computationally efficient optimization of gas network flows subject to uncertainty, we develop a finite volume representation of stochastic solutions of hyperbolic partial differential equation (PDE) systems on graph-connected domains with nodal coupling and boundary conditions. The representation is used to express the physical constraints in stochastic optimization problems for gas flow allocation subject to uncertain parameters. The method is based on the stochastic finite volume approach that was recently developed for uncertainty quantification in transient flows represented by hyperbolic PDEs on graphs. In this study, we develop optimization formulations for steady-state gas flow over actuated transport networks subject to probabilistic constraints. In addition to the distributions for the physical solutions, we examine the dual variables that are produced by way of the optimization, and interpret them as price distributions that quantify the financial volatility that arises through demand uncertainty modeled in an optimization-driven gas market mechanism. We demonstrate the computation and distributional analysis using a single-pipe example and a small test network. △ Less

Submitted 26 March, 2024; originally announced March 2024.

Report number: LA-UR-24-22647 MSC Class: 65Kxx; 90C35; 90C15

An exactly solvable asymmetric $K$-exclusion process

Authors: Arvind Ayyer, Samarth Misra

Abstract: We study an interacting particle process on a finite ring with $L$ sites with at most $K$ particles per site, in which particles hop to nearest neighbors with rates given in terms of $t$-deformed integers and asymmetry parameter $q$, where $t>0$ and $q \geq 0$ are parameters. This model, which we call the $(q, t)$~$K$-ASEP, reduces to the usual ASEP on the ring when $K = 1$ and to a model studied… ▽ More We study an interacting particle process on a finite ring with $L$ sites with at most $K$ particles per site, in which particles hop to nearest neighbors with rates given in terms of $t$-deformed integers and asymmetry parameter $q$, where $t>0$ and $q \geq 0$ are parameters. This model, which we call the $(q, t)$~$K$-ASEP, reduces to the usual ASEP on the ring when $K = 1$ and to a model studied by Schütz and Sandow (\emph{Phys. Rev. E}, 1994) when $t = q = 1$. This is a special case of the misanthrope process and as a consequence, the steady state does not depend on $q$ and is of product form, generalizing the same phenomena for the ASEP. What is interesting here is the steady state weights are given by explicit formulas involving $t$-binomial coefficients, and are palindromic polynomials in $t$. Interestingly, although the $(q, t)$~$K$-ASEP does not satisfy particle-hole symmetry, its steady state does. We analyze the density and calculate the most probable number of particles at a site in the steady state in various regimes of $t$. Lastly, we construct a two-dimensional exclusion process on a discrete cylinder with height $K$ and circumference $L$ which projects to the $(q, t)$~$K$-ASEP and whose steady state distribution is also of product form. We believe this model will serve as an illustrative example in constructing two-dimensional analogues of misanthrope processes. Simulations are attached as ancillary files. △ Less

Submitted 12 April, 2024; v1 submitted 5 October, 2023; originally announced October 2023.

Comments: 35 pages, 4 figures, simulations are also available at http://www.math.iisc.ac.in/~arvind/KASEP/, signification corrections, many new references

MSC Class: 82C23; 82C22; 60J10; 05A10

Some results on Seshadri constants of vector bundles

Authors: Indranil Biswas, Krishna Hanumanthu, Snehajit Misra

Abstract: We study Seshadri constants of certain ample vector bundles on projective varieties. Our main motivation is the following question: Under what conditions are the Seshadri constants of ample vector bundles at least 1 at all points of the variety. We exhibit some conditions under which this question has an affirmative answer. We primarily consider ample bundles on projective spaces and Hirzebruch su… ▽ More We study Seshadri constants of certain ample vector bundles on projective varieties. Our main motivation is the following question: Under what conditions are the Seshadri constants of ample vector bundles at least 1 at all points of the variety. We exhibit some conditions under which this question has an affirmative answer. We primarily consider ample bundles on projective spaces and Hirzebruch surfaces. We also show that Seshadri constants of ample vector bundles can be arbitrarily small. △ Less

Submitted 8 August, 2023; v1 submitted 28 March, 2023; originally announced March 2023.

Comments: 18 pages; minor changes to the previous version; final version; to appear in Forum Mathematicum

MSC Class: 14C20; 14J60

On the Emerging Potential of Quantum Annealing Hardware for Combinatorial Optimization

Authors: Byron Tasseff, Tameem Albash, Zachary Morrell, Marc Vuffray, Andrey Y. Lokhov, Sidhant Misra, Carleton Coffrin

Abstract: Over the past decade, the usefulness of quantum annealing hardware for combinatorial optimization has been the subject of much debate. Thus far, experimental benchmarking studies have indicated that quantum annealing hardware does not provide an irrefutable performance gain over state-of-the-art optimization methods. However, as this hardware continues to evolve, each new iteration brings improved… ▽ More Over the past decade, the usefulness of quantum annealing hardware for combinatorial optimization has been the subject of much debate. Thus far, experimental benchmarking studies have indicated that quantum annealing hardware does not provide an irrefutable performance gain over state-of-the-art optimization methods. However, as this hardware continues to evolve, each new iteration brings improved performance and warrants further benchmarking. To that end, this work conducts an optimization performance assessment of D-Wave Systems' most recent Advantage Performance Update computer, which can natively solve sparse unconstrained quadratic optimization problems with over 5,000 binary decision variables and 40,000 quadratic terms. We demonstrate that classes of contrived problems exist where this quantum annealer can provide run time benefits over a collection of established classical solution methods that represent the current state-of-the-art for benchmarking quantum annealing hardware. Although this work does not present strong evidence of an irrefutable performance benefit for this emerging optimization technology, it does exhibit encouraging progress, signaling the potential impacts on practical optimization tasks in the future. △ Less

Submitted 9 October, 2022; originally announced October 2022.

Report number: LA-UR-22-29705

Slope Semistability and Positive cones of Grassmann bundles

Authors: Snehajit Misra, Nabanita Ray

Abstract: Let $E$ be a vector bundle of rank $r$ on a smooth complex projective variety $X$. In this article, we compute the nef and pseudoeffective cones of divisors in the Grassmann bundle $Gr_X(k,E)$ parametrizing $k$-dimensional subspaces of the fibers of $E$, where $1\leq k \leq rank(E)$, under assumptions on $X$ as well as on the vector bundle $E$. In particular, we show that nef cone and the pseudoef… ▽ More Let $E$ be a vector bundle of rank $r$ on a smooth complex projective variety $X$. In this article, we compute the nef and pseudoeffective cones of divisors in the Grassmann bundle $Gr_X(k,E)$ parametrizing $k$-dimensional subspaces of the fibers of $E$, where $1\leq k \leq rank(E)$, under assumptions on $X$ as well as on the vector bundle $E$. In particular, we show that nef cone and the pseudoeffective cone of $Gr_X(k,E)$ coincide if and only if $E$ is a slope semistable bundle on $X$ with $c_2(End(E))=0$. We also discuss about the nefness and ampleness of the universal quotient bundle $Q_k$ on $Gr_X(k,E)$. △ Less

Submitted 23 May, 2022; originally announced May 2022.

Comments: Comments are welcome. arXiv admin note: text overlap with arXiv:2203.07007

On pseudoeffective cones of projective bundles and volume function

Authors: Snehajit Misra, Anoop Singh

Abstract: In this article, we compute the pseudo-effective cones of various projective bundles $\mathbb{P}_X(E)$ over higher dimensional varieties $X$ under some assumptions on $X$ as well as on the vector bundle $E$. We also compute the volume function on fibre product $\mathbb{P}(E)\times_C\mathbb{P}(F)$ of two projective bundles over a smooth irreducible complex projective curve $C$. In particular, we sh… ▽ More In this article, we compute the pseudo-effective cones of various projective bundles $\mathbb{P}_X(E)$ over higher dimensional varieties $X$ under some assumptions on $X$ as well as on the vector bundle $E$. We also compute the volume function on fibre product $\mathbb{P}(E)\times_C\mathbb{P}(F)$ of two projective bundles over a smooth irreducible complex projective curve $C$. In particular, we show that the volume function on the fiber product of two ruled surfaces is of polynomial type. △ Less

Submitted 9 May, 2024; v1 submitted 14 March, 2022; originally announced March 2022.

Comments: Revised Version, 30 Pages, Comments are Welcome

MSC Class: Primary 14C20; 14E30; 14E99; Secondary 14D20; 14D06

Seshadri constants of parabolic vector bundles

Authors: Indranil Biswas, Krishna Hanumanthu, Snehajit Misra, Nabanita Ray

Abstract: Let $X$ be a complex projective variety, and let $E_{\ast}$ be a parabolic vector bundle on $X$. We introduce the notion of \textit{parabolic Seshadri constants} of $E_{\ast}$. It is shown that these constants are analogous to the classical Seshadri constants of vector bundles, in particular, they have parallel definitions and properties. We prove a Seshadri criterion for parabolic ampleness of… ▽ More Let $X$ be a complex projective variety, and let $E_{\ast}$ be a parabolic vector bundle on $X$. We introduce the notion of \textit{parabolic Seshadri constants} of $E_{\ast}$. It is shown that these constants are analogous to the classical Seshadri constants of vector bundles, in particular, they have parallel definitions and properties. We prove a Seshadri criterion for parabolic ampleness of $E_{\ast}$ in terms of parabolic Seshadri constants. We also compute parabolic Seshadri constants for symmetric powers and tensor products of parabolic vector bundles. △ Less

Submitted 7 June, 2023; v1 submitted 9 March, 2022; originally announced March 2022.

Comments: 25 pages; final version; to appear in Documenta Mathematica

MSC Class: 14C20; 14J60

DNN-based Policies for Stochastic AC OPF

Authors: Sarthak Gupta, Sidhant Misra, Deepjyoti Deka, Vassilis Kekatos

Abstract: A prominent challenge to the safe and optimal operation of the modern power grid arises due to growing uncertainties in loads and renewables. Stochastic optimal power flow (SOPF) formulations provide a mechanism to handle these uncertainties by computing dispatch decisions and control policies that maintain feasibility under uncertainty. Most SOPF formulations consider simple control policies such… ▽ More A prominent challenge to the safe and optimal operation of the modern power grid arises due to growing uncertainties in loads and renewables. Stochastic optimal power flow (SOPF) formulations provide a mechanism to handle these uncertainties by computing dispatch decisions and control policies that maintain feasibility under uncertainty. Most SOPF formulations consider simple control policies such as affine policies that are mathematically simple and resemble many policies used in current practice. Motivated by the efficacy of machine learning (ML) algorithms and the potential benefits of general control policies for cost and constraint enforcement, we put forth a deep neural network (DNN)-based policy that predicts the generator dispatch decisions in real time in response to uncertainty. The weights of the DNN are learnt using stochastic primal-dual updates that solve the SOPF without the need for prior generation of training labels and can explicitly account for the feasibility constraints in the SOPF. The advantages of the DNN policy over simpler policies and their efficacy in enforcing safety limits and producing near optimal solutions are demonstrated in the context of a chance constrained formulation on a number of test cases. △ Less

Submitted 4 December, 2021; originally announced December 2021.

Stability of pullback of orbifold bundles

Authors: Soumyadip Das, Snehajit Misra

Abstract: In this article, we study the behavior of the stability of pullback of a vector bundle under a finite morphism from a (not necessarily smooth) stacky curve to an orbifold curve. We establish a categorical equivalence between proper formal orbifold curves and proper orbifold curves in the sense of Deligne-Mumford stacks. Using this identification, we define the notion of slope $P$-(semi)stability o… ▽ More In this article, we study the behavior of the stability of pullback of a vector bundle under a finite morphism from a (not necessarily smooth) stacky curve to an orbifold curve. We establish a categorical equivalence between proper formal orbifold curves and proper orbifold curves in the sense of Deligne-Mumford stacks. Using this identification, we define the notion of slope $P$-(semi)stability of vector bundles on proper formal orbifold curves $(X,P)$. We establish some equivalent conditions for a stacky genuinely ramified morphism, analogous to the case of curves. Finally, we show that for a cover of an orbifold curve arising as a cartesian pullback via a genuinely ramified morphism of smooth projective connected curves, the orbifold slope stability is preserved under the pullback. △ Less

Submitted 4 November, 2022; v1 submitted 30 November, 2021; originally announced November 2021.

Comments: The second author requested to withdraw from the project. An updated version with complete results on this problem will be posted under the authorship of the first author

MSC Class: 14D20; 14D23; 14H60 (Primary) 14D21; 14D22 (Secondary)

On the relative logarithmic connections and relative residue formula

Authors: Snehajit Misra, Anoop Singh

Abstract: We investigate the relative logarithmic connections on a holomorphic vector bundle over a complex analytic family. We give a sufficient condition for the existence of a relative logarithmic connection on a holomorphic vector bundle singular over a relative simple normal crossing divisor. We define the relative residue of relative logarithmic connection and express relative Chern classes of a holom… ▽ More We investigate the relative logarithmic connections on a holomorphic vector bundle over a complex analytic family. We give a sufficient condition for the existence of a relative logarithmic connection on a holomorphic vector bundle singular over a relative simple normal crossing divisor. We define the relative residue of relative logarithmic connection and express relative Chern classes of a holomorphic vector bundle in terms of relative residues. △ Less

Submitted 13 August, 2021; originally announced August 2021.

Comments: Comments are welcome

Robust Gas Pipeline Network Expansion Planning to Support Power System Reliability

Authors: Kaarthik Sundar, Sidhant Misra, Anatoly Zlotnik, Russell Bent

Abstract: We examine the problem of optimal transport capacity expansion planning for a gas pipeline network to service the growing demand of gas-fired power plants that are increasingly used to provide base load, flexibility, and reserve generation for bulk electric system. The aim is to determine the minimal cost set of additional pipes and gas compressors that can be added to the network to provide the a… ▽ More We examine the problem of optimal transport capacity expansion planning for a gas pipeline network to service the growing demand of gas-fired power plants that are increasingly used to provide base load, flexibility, and reserve generation for bulk electric system. The aim is to determine the minimal cost set of additional pipes and gas compressors that can be added to the network to provide the additional capacity to service future loads. This combinatorial optimization problem is initially formulated as a mixed-integer nonlinear program, which we then extend to account for the variability that is inherent to the demands of gas-fired electricity production and uncertainty in expected future loads. We consider here steady-state flow modeling while ensuring that the solution is feasible for all possible values of interval uncertainty in loads, which results in a challenging semi-infinite problem. We apply previously derived monotonicity properties that enable simplification of the problem to require constraint satisfaction in the two extremal scenarios only, and then formulate the robust gas pipeline network expansion planning problem using a mixed-integer second order cone formulation. We consider case studies on the Belgian network test case to examine the performance of the proposed approach. △ Less

Submitted 25 January, 2021; originally announced January 2021.

Comments: 8 pages

Report number: LA-UR-19-30191

Deployable, Data-Driven Unmanned Vehicle Navigation System in GPS-Denied, Feature-Deficient Environments

Authors: Sohum Misra, Kaarthik Sundar, Rajnikant Sharma, Kevin Brink

Abstract: This paper presents a novel data-driven navigation system to navigate an Unmanned Vehicle (UV) in GPS-denied, feature-deficient environments such as tunnels, or mines. The method utilizes landmarks that vehicle can deploy and measure range from to enable localization as the vehicle traverses its pre-defined path through the tunnel. A key question that arises in such scenario is to estimate and red… ▽ More This paper presents a novel data-driven navigation system to navigate an Unmanned Vehicle (UV) in GPS-denied, feature-deficient environments such as tunnels, or mines. The method utilizes landmarks that vehicle can deploy and measure range from to enable localization as the vehicle traverses its pre-defined path through the tunnel. A key question that arises in such scenario is to estimate and reduce the number of landmarks that needs to be deployed for localization before the start of the mission, given some information about the environment. The main focus is to keep the maximum position uncertainty at a desired value. In this article, we develop a novel vehicle navigation system in GPS-denied, feature-deficient environment by combining techniques from estimation, machine learning, and mixed-integer convex optimization. This article develops a novel, systematic method to perform localization and navigate the UV through the environment with minimum number of landmarks while maintaining desired localization accuracy. We also present extensive simulation experiments on different scenarios that corroborate the effectiveness of the proposed navigation system. △ Less

Submitted 2 November, 2021; v1 submitted 24 January, 2021; originally announced January 2021.

Comments: 37 pages

Report number: LA-UR-21-20249

Deep Learning for Individual Heterogeneity: An Automatic Inference Framework

Authors: Max H. Farrell, Tengyuan Liang, Sanjog Misra

Abstract: We develop methodology for estimation and inference using machine learning to enrich economic models. Our framework takes a standard economic model and recasts the parameters as fully flexible nonparametric functions, to capture the rich heterogeneity based on potentially high dimensional or complex observable characteristics. These "parameter functions" retain the interpretability, economic meani… ▽ More We develop methodology for estimation and inference using machine learning to enrich economic models. Our framework takes a standard economic model and recasts the parameters as fully flexible nonparametric functions, to capture the rich heterogeneity based on potentially high dimensional or complex observable characteristics. These "parameter functions" retain the interpretability, economic meaning, and discipline of classical parameters. Deep learning is particularly well-suited to structured modeling of heterogeneity in economics. We show how to design the network architecture to match the structure of the economic model, delivering novel methodology that moves deep learning beyond prediction. We prove convergence rates for the estimated parameter functions. These functions are the key inputs into the finite-dimensional parameter of inferential interest. We obtain inference based on a novel influence function calculation that covers any second-stage parameter and any machine-learning-enriched model that uses a smooth per-observation loss function. No additional derivations are required. The score can be taken directly to data, using automatic differentiation if needed. The researcher need only define the original model and define the parameter of interest. A key insight is that we need not write down the influence function in order to evaluate it on the data. Our framework gives new results for a host of contexts, covering such diverse examples as price elasticities, willingness-to-pay, and surplus measures in binary or multinomial choice models, effects of continuous treatment variables, fractional outcome models, count data, heterogeneous production functions, and more. We apply our methodology to a large scale advertising experiment for short-term loans. We show how economically meaningful estimates and inferences can be made that would be unavailable without our results. △ Less

Submitted 23 July, 2021; v1 submitted 27 October, 2020; originally announced October 2020.

Monotonicity Properties of Physical Network Flows and Application to Robust Optimal Allocation

Authors: Sidhant Misra, Marc Vuffray, Anatoly Zlotnik

Abstract: We derive conditions for monotonicity properties that characterize general flows of a commodity over a network, where the flow is described by potential and flow dynamics on the edges, as well as potential continuity and Kirchhoff-Neumann mass balance requirements at nodes. The transported commodity may be injected or withdrawn at any of the network nodes, and its movement throughout the network i… ▽ More We derive conditions for monotonicity properties that characterize general flows of a commodity over a network, where the flow is described by potential and flow dynamics on the edges, as well as potential continuity and Kirchhoff-Neumann mass balance requirements at nodes. The transported commodity may be injected or withdrawn at any of the network nodes, and its movement throughout the network is controlled by nodal actuators. For a class of dissipative nonlinear parabolic partial differential equation (PDE) systems on networks, we derive conditions for monotonicity properties in steady-state flow, as well as for propagation of monotone ordering of states with respect to time-varying boundary condition parameters. In the latter case, initial conditions, as well as time-varying parameters in the coupling conditions at vertices, provide an initial boundary value problem (IBVP). We prove that ordering properties of the solution to the IBVP are preserved when the initial conditions and the parameters of the time-varying coupling law are appropriately ordered. Then, we prove that when monotone ordering is not preserved, the first crossing of solutions occurs at a network node. We consider the implications for robust optimization and optimal control formulations and real-time monitoring of uncertain dynamic flows on networks, and discuss application to subsonic compressible fluid flow with energy dissipation on physical networks. The main result and monitoring policy are demonstrated for gas pipeline test networks and a case study using data corresponding to a real working system. We propose applications of this general result to the control and monitoring of natural gas transmission networks. △ Less

Submitted 15 July, 2020; originally announced July 2020.

Comments: arXiv admin note: text overlap with arXiv:1601.05102

Pseudo-effective cones of projective bundles and weak Zariski decomposition

Authors: Snehajit Misra

Abstract: In this article, we consider the projective bundle $\mathbb{P}_X(E)$ over a smooth complex projective variety $X$, where $E$ is a semistable bundle on $X$ with $c_2(End(E)) =0$. We give a necessary and sufficient condition to get the equality $ Nef^1\bigl(\mathbb{P}_X(E)\bigr) = \overline{Eff}^1\bigl(\mathbb{P}_X(E)\bigr)$ of nef cone and pseudoeffective cone of divisors in $\mathbb{P}_X(E)$. As a… ▽ More In this article, we consider the projective bundle $\mathbb{P}_X(E)$ over a smooth complex projective variety $X$, where $E$ is a semistable bundle on $X$ with $c_2(End(E)) =0$. We give a necessary and sufficient condition to get the equality $ Nef^1\bigl(\mathbb{P}_X(E)\bigr) = \overline{Eff}^1\bigl(\mathbb{P}_X(E)\bigr)$ of nef cone and pseudoeffective cone of divisors in $\mathbb{P}_X(E)$. As an application of our result, we show the equality of nef and pseudoeffective cones of divisors of projective bundles over some special varieties. In particular, we show that weak Zariski decomposition exists on these projective bundles. We also show that a semistable bundle $E$ of rank $r \geq 2$ with $c_2\bigl(End(E)\bigr) = 0$ on a smooth complex projective variety of Picard number 1 is $k$-homogeneous i.e. $\overline{Eff}^k\bigl(\mathbb{P}_X(E)\bigr) = Nef^k\bigl(\mathbb{P}_{X}(E)\bigr)$ for all $1 \leq k < r$. Finally, we show that weak Zariski decomposition exists for a fibre product $\mathbb{P}_C(E)\times_C\mathbb{P}(E')$ over a smooth projective curve $C$. △ Less

Submitted 26 January, 2021; v1 submitted 18 May, 2020; originally announced May 2020.

Comments: Final Version. To appear in European Journal of Mathematics

Stochastic AC Optimal Power Flow: A Data-Driven Approach

Authors: Ilyes Mezghani, Sidhant Misra, Deepjyoti Deka

Abstract: There is an emerging need for efficient solutions to stochastic AC Optimal Power Flow ({AC-}OPF) to ensure optimal and reliable grid operations in the presence of increasing demand and generation uncertainty. This paper presents a highly scalable data-driven algorithm for stochastic AC-OPF that has extremely low sample requirement. The novelty behind the algorithm's performance involves an iterati… ▽ More There is an emerging need for efficient solutions to stochastic AC Optimal Power Flow ({AC-}OPF) to ensure optimal and reliable grid operations in the presence of increasing demand and generation uncertainty. This paper presents a highly scalable data-driven algorithm for stochastic AC-OPF that has extremely low sample requirement. The novelty behind the algorithm's performance involves an iterative scenario design approach that merges information regarding constraint violations in the system with data-driven sparse regression. Compared to conventional methods with random scenario sampling, our approach is able to provide feasible operating points for realistic systems with much lower sample requirements. Furthermore, multiple sub-tasks in our approach can be easily paralleled and based on historical data to enhance its performance and application. We demonstrate the computational improvements of our approach through simulations on different test cases in the IEEE PES PGLib-OPF benchmark library. △ Less

Submitted 8 June, 2020; v1 submitted 21 October, 2019; originally announced October 2019.

Comments: a version of this paper will appear in the proceedings of the 21st Power Systems Computation Conference (PSCC 2020)

Efficient Polynomial Chaos Expansion for Uncertainty Quantification in Power Systems

Authors: David Métivier, Marc Vuffray, Sidhant Misra

Abstract: Growing uncertainty from renewable energy integration and distributed energy resources motivate the need for advanced tools to quantify the effect of uncertainty and assess the risks it poses to secure system operation. Polynomial chaos expansion (PCE) has been recently proposed as a tool for uncertainty quantification in power systems. The method produces results that are highly accurate, but has… ▽ More Growing uncertainty from renewable energy integration and distributed energy resources motivate the need for advanced tools to quantify the effect of uncertainty and assess the risks it poses to secure system operation. Polynomial chaos expansion (PCE) has been recently proposed as a tool for uncertainty quantification in power systems. The method produces results that are highly accurate, but has proved to be computationally challenging to scale to large systems. We propose a modified algorithm based on PCE with significantly improved computational efficiency that retains the desired high level of accuracy of the standard PCE. Our method uses computational enhancements by exploiting the sparsity structure and algebraic properties of the power flow equations. We show the scalability of the method on the 1354 pegase test system, assess the quality of the uncertainty quantification in terms of accuracy and robustness, and demonstrate an example application to solving the chance constrained optimal power flow problem. △ Less

Submitted 14 October, 2019; originally announced October 2019.

Report number: LA-UR-19-30262

Credible Interdiction for Transmission Systems

Authors: Kaarthik Sundar, Sidhant Misra, Russell Bent, Feng Pan

Abstract: This paper presents novel formulations and algorithms for $N$-$k$ interdiction problem in transmission networks. In particular, it formulates spatial and topological resource constraints on attackers for $N$-$k$ interdiction problems and illustrates the formulation with two new classes of $N$-$k$ attacks: (i) Spatial $N$-$k$ attacks where the attack is constrained by geographic distance of a bus c… ▽ More This paper presents novel formulations and algorithms for $N$-$k$ interdiction problem in transmission networks. In particular, it formulates spatial and topological resource constraints on attackers for $N$-$k$ interdiction problems and illustrates the formulation with two new classes of $N$-$k$ attacks: (i) Spatial $N$-$k$ attacks where the attack is constrained by geographic distance of a bus chosen by an attacker and (ii) Topological $N$-$k$ attacks where the attack is constrained to connected components. These two specific types of $N$-$k$ attacks compute interdiction plans designed to better model localized attacks, such as those induced by natural disasters or physical attacks. We then formulate these two resource-constrained interdiction problems as bilevel, max-min optimization problems and present a novel constraint generation algorithm to solve these formulations. Detailed case studies analyzing the behavior of spatially and topologically resource-constrained problems and comparing them to the traditional $N$-$k$ interdiction problem are also presented. △ Less

Submitted 30 November, 2020; v1 submitted 17 April, 2019; originally announced April 2019.

Report number: LA-UR-19-23362

Nef cones of projective bundles over surfaces and Seshadri constants

Authors: Snehajit Misra, Nabanita Ray

Abstract: In this article, we give a description of the closed cone of curves of the projective bundle $\mathbb{P}(E)$ over a smooth projective variety $X$. Using duality, we then calculate the nef cone of divisors in $\mathbb{P}(E)$ over some special surfaces $X$ and for some special bundles on $X$. As an application, we also calculate the Seshadri constants of semistable ample vector bundles with vanishin… ▽ More In this article, we give a description of the closed cone of curves of the projective bundle $\mathbb{P}(E)$ over a smooth projective variety $X$. Using duality, we then calculate the nef cone of divisors in $\mathbb{P}(E)$ over some special surfaces $X$ and for some special bundles on $X$. As an application, we also calculate the Seshadri constants of semistable ample vector bundles with vanishing discriminant on some special ruled surfaces at special points. △ Less

Submitted 4 August, 2021; v1 submitted 3 April, 2019; originally announced April 2019.

Comments: Final Version. To appear in Osaka Journal of Mathematics

Journal ref: Osaka Journal of Mathematics, 59 (3), 639-651 (2022)

Efficient Learning of Discrete Graphical Models

Authors: Marc Vuffray, Sidhant Misra, Andrey Y. Lokhov

Abstract: Graphical models are useful tools for describing structured high-dimensional probability distributions. Development of efficient algorithms for learning graphical models with least amount of data remains an active research topic. Reconstruction of graphical models that describe the statistics of discrete variables is a particularly challenging problem, for which the maximum likelihood approach is… ▽ More Graphical models are useful tools for describing structured high-dimensional probability distributions. Development of efficient algorithms for learning graphical models with least amount of data remains an active research topic. Reconstruction of graphical models that describe the statistics of discrete variables is a particularly challenging problem, for which the maximum likelihood approach is intractable. In this work, we provide the first sample-efficient method based on the Interaction Screening framework that allows one to provably learn fully general discrete factor models with node-specific discrete alphabets and multi-body interactions, specified in an arbitrary basis. We identify a single condition related to model parametrization that leads to rigorous guarantees on the recovery of model structure and parameters in any error norm, and is readily verifiable for a large class of models. Importantly, our bounds make explicit distinction between parameters that are proper to the model and priors used as an input to the algorithm. Finally, we show that the Interaction Screening framework includes all models previously considered in the literature as special cases, and for which our analysis shows a systematic improvement in sample complexity. △ Less

Submitted 16 November, 2021; v1 submitted 1 February, 2019; originally announced February 2019.

Comments: Accepted to Advances in Neural Information Processing Systems 33 (NeurIPS 2020), see https://proceedings.neurips.cc/paper/2020/hash/9d702ffd99ad9c70ac37e506facc8c38-Abstract.html

Routing Multiple Unmanned Vehicles in GPS-Denied Environments

Authors: Bingyu Wang, Sohum Misra, Sivakumar Rathinam, Rajnikant Sharma, Kaarthik Sundar

Abstract: This article aims to develop novel path planning algorithms required to deploy multiple unmanned vehicles in Global Positioning System (GPS) denied environments. Unmanned vehicles (ground or aerial) are ideal platforms for executing monitoring and data gathering tasks in civil infrastructure management, agriculture, public safety, law enforcement, disaster relief and transportation. Significant ad… ▽ More This article aims to develop novel path planning algorithms required to deploy multiple unmanned vehicles in Global Positioning System (GPS) denied environments. Unmanned vehicles (ground or aerial) are ideal platforms for executing monitoring and data gathering tasks in civil infrastructure management, agriculture, public safety, law enforcement, disaster relief and transportation. Significant advancement in the area of path planning for unmanned vehicles over the last decade has resulted in a suite of algorithms that can handle heterogeneity, motion and other on-board resource constraints for these vehicles. However, most of these routing and path planning algorithms rely on the availability of the GPS information. Unintentional and intentional interference and design errors can cause GPS service outages, which in turn, can crucially affect all the systems that depend on GPS information. This article addresses a multiple vehicle path planning problem that arises while deploying a team of unmanned vehicles for monitoring applications in GPS-denied environments and presents a mathematical formulation and algorithms for solving the problem. Simulation results are also presented to corroborate the performance of the proposed algorithms. △ Less

Submitted 31 December, 2018; originally announced January 2019.

Comments: 10 pages. arXiv admin note: text overlap with arXiv:1708.03269

Nef cone and Seshadri constants on products of projective bundles over curves

Authors: Rupam Karmakar, Snehajit Misra

Abstract: Let $X = \mathbb{P}(E_1) \times_C \mathbb{P}(E_2)$ where $C$ is a smooth curve and let $E_1$, $E_2$ be vector bundles over $C$. In this paper, we extend the results in \cite{K-M-R} by computing the nef cone of $X$ without restriction on the rank or semistability of $E_1$ and $E_2$. We also study the Seshadri constants of ample line bundles on $X$. We calculate the Seshadri constants in some cases… ▽ More Let $X = \mathbb{P}(E_1) \times_C \mathbb{P}(E_2)$ where $C$ is a smooth curve and let $E_1$, $E_2$ be vector bundles over $C$. In this paper, we extend the results in \cite{K-M-R} by computing the nef cone of $X$ without restriction on the rank or semistability of $E_1$ and $E_2$. We also study the Seshadri constants of ample line bundles on $X$. We calculate the Seshadri constants in some cases and give bounds in some of the remaining cases. △ Less

Submitted 29 February, 2020; v1 submitted 10 December, 2018; originally announced December 2018.

Comments: Final version. To appear in Journal of Ramanujan Mathematical Society

Deep Neural Networks for Estimation and Inference

Authors: Max H. Farrell, Tengyuan Liang, Sanjog Misra

Abstract: We study deep neural networks and their use in semiparametric inference. We establish novel rates of convergence for deep feedforward neural nets. Our new rates are sufficiently fast (in some cases minimax optimal) to allow us to establish valid second-step inference after first-step estimation with deep learning, a result also new to the literature. Our estimation rates and semiparametric inferen… ▽ More We study deep neural networks and their use in semiparametric inference. We establish novel rates of convergence for deep feedforward neural nets. Our new rates are sufficiently fast (in some cases minimax optimal) to allow us to establish valid second-step inference after first-step estimation with deep learning, a result also new to the literature. Our estimation rates and semiparametric inference results handle the current standard architecture: fully connected feedforward neural networks (multi-layer perceptrons), with the now-common rectified linear unit activation function and a depth explicitly diverging with the sample size. We discuss other architectures as well, including fixed-width, very deep networks. We establish nonasymptotic bounds for these deep nets for a general class of nonparametric regression-type loss functions, which includes as special cases least squares, logistic regression, and other generalized linear models. We then apply our theory to develop semiparametric inference, focusing on causal parameters for concreteness, such as treatment effects, expected welfare, and decomposition effects. Inference in many other semiparametric contexts can be readily obtained. We demonstrate the effectiveness of deep learning with a Monte Carlo analysis and an empirical application to direct mail marketing. △ Less

Submitted 18 September, 2019; v1 submitted 26 September, 2018; originally announced September 2018.

Journal ref: Econometrica, vol 89, no 1, 181-213, 2021

Optimization-Based Bound Tightening using a Strengthened QC-Relaxation of the Optimal Power Flow Problem

Authors: Kaarthik Sundar, Harsha Nagarajan, Sidhant Misra, Mowen Lu, Carleton Coffrin, Russell Bent

Abstract: This article develops a strengthened convex quadratic convex (QC) relaxation of the AC Optimal Power Flow (AC-OPF) problem and presents an optimization-based bound-tightening (OBBT) algorithm to compute tight, feasible bounds on the voltage magnitude variables for each bus and the phase angle difference variables for each branch in the network. Theoretical properties of the strengthened QC relaxat… ▽ More This article develops a strengthened convex quadratic convex (QC) relaxation of the AC Optimal Power Flow (AC-OPF) problem and presents an optimization-based bound-tightening (OBBT) algorithm to compute tight, feasible bounds on the voltage magnitude variables for each bus and the phase angle difference variables for each branch in the network. Theoretical properties of the strengthened QC relaxation that show its dominance over the other variants of the QC relaxation studied in the literature are also derived. The effectiveness of the strengthened QC relaxation is corroborated via extensive numerical results on benchmark AC-OPF test networks. In particular, the results demonstrate that the proposed relaxation consistently provides the tightest variable bounds and optimality gaps with negligible impacts on runtime performance. △ Less

Submitted 29 January, 2019; v1 submitted 12 September, 2018; originally announced September 2018.

Stable Higgs Bundles on ruled surfaces

Authors: Snehajit Misra

Abstract: Let $π: X = \mathbb{P}_C(E) \longrightarrow C$ be a ruled surface over an algebraically closed field $k$ of characteristic 0, with a fixed polarization $L$ on $X$. In this paper, we show that pullback of a (semi)stable Higgs bundle on $C$ under $π$ is a $L$-(semi)stable Higgs bundle. Conversely, if $(V,θ)$ is a $L$-(semi)stable Higgs bundle on $X$ with $c_1(V)= π^*(\bf d \rm)$ for some divisor… ▽ More Let $π: X = \mathbb{P}_C(E) \longrightarrow C$ be a ruled surface over an algebraically closed field $k$ of characteristic 0, with a fixed polarization $L$ on $X$. In this paper, we show that pullback of a (semi)stable Higgs bundle on $C$ under $π$ is a $L$-(semi)stable Higgs bundle. Conversely, if $(V,θ)$ is a $L$-(semi)stable Higgs bundle on $X$ with $c_1(V)= π^*(\bf d \rm)$ for some divisor $\bf d \rm $ of degree $d$ on $C$ and $c_2(V)=0$, then there exists a (semi)stable Higgs bundle $(W,ψ)$ of degree $d$ on $C$ whose pullback under $π$ is isomorphic to $(V,θ)$. As a consequence, we get an isomorphism between the corresponding moduli spaces of (semi)stable Higgs bundles. We also show the existence of non-trivial stable Higgs bundle on $X$ whenever $g(C)\geq 2$ and the base field is $\mathbb{C}$. △ Less

Submitted 26 January, 2021; v1 submitted 10 May, 2018; originally announced May 2018.

Comments: Final Version

Journal ref: Indian Journal of Pure and Applied Mathematics, 51, 735-747 (2020)

Chance-Constrained Optimization for Non-Linear Network Flow Problems

Authors: Tillmann Weisser, Line Roald, Sidhant Misra

Abstract: Many engineered systems, such as energy and transportation infrastructures, are networks governed by non-linear physical laws. A primary challenge for operators of these networks is to achieve optimal utilization while maintaining safety and feasibility, especially in the face of uncertainty regarding the system model. To address this problem, we formulate a Chance Constrained Optimal Physical Net… ▽ More Many engineered systems, such as energy and transportation infrastructures, are networks governed by non-linear physical laws. A primary challenge for operators of these networks is to achieve optimal utilization while maintaining safety and feasibility, especially in the face of uncertainty regarding the system model. To address this problem, we formulate a Chance Constrained Optimal Physical Network Flow (CC-OPNF) problem that attempts to optimize the system while satisfying safety limits with a high probability. However, the non-linear equality constraints representing the network physics introduce modelling and optimization challenges which make the chance constraints numerically intractable in their original form. The main contribution of the paper is to present a method to obtain tractable polynomial approximations to the chance constraints using Semidefinite Programming (SDP). The method uses a combination of existing semi-algebraic techniques for projection and volume computation in combination with novel set manipulations to provide conservative inner approximations to the chance constraints. In addition, we develop a new two-step procedure to improve computational speed. While the method is applicable to general physical network flow problems with polynomial constraints, we use the AC optimal power flow problem for electric grids as an example to demonstrate the method numerically. △ Less

Submitted 7 March, 2018; originally announced March 2018.

Learning for Constrained Optimization: Identifying Optimal Active Constraint Sets

Authors: Sidhant Misra, Line Roald, Yeesian Ng

Abstract: In many engineered systems, optimization is used for decision making at time-scales ranging from real-time operation to long-term planning. This process often involves solving similar optimization problems over and over again with slightly modified input parameters, often under tight latency requirements. We consider the problem of using the information available through this repeated solution pro… ▽ More In many engineered systems, optimization is used for decision making at time-scales ranging from real-time operation to long-term planning. This process often involves solving similar optimization problems over and over again with slightly modified input parameters, often under tight latency requirements. We consider the problem of using the information available through this repeated solution process to directly learn a model of the optimal solution as a function of the input parameters, thus reducing the need to solve computationally expensive large-scale parametric programs in real time. Our proposed method is based on learning relevant sets of active constraints, from which the optimal solution can be obtained efficiently. Using active sets as features preserves information about the physics of the system, enables interpretable models, accounts for relevant safety constraints, and is easy to represent and encode. However, the total number of active sets is also very large, as it grows exponentially with system size. The key contribution of this paper is a streaming algorithm that learns the relevant active sets from training samples consisting of the input parameters and the corresponding optimal solution, without any assumptions on the problem structure. The algorithm comes with theoretical performance guarantees, and is known to converge fast for problem instances with a small number of relevant active sets. It can thus be used to establish the practicability of the learning method. Through extensive experiments on the Optimal Power Flow problem, we observe that often only a few active sets are relevant in practice, suggesting that the active sets is the appropriate level of abstraction for a learning algorithm to target. △ Less

Submitted 16 January, 2019; v1 submitted 26 February, 2018; originally announced February 2018.

Landmark Placement for Localization in a GPS-denied Environment

Authors: Kaarthik Sundar, Shriram Srinivasan, Sohum Misra, Sivakumar Rathinam, Rajnikant Sharma

Abstract: Path planning algorithms for unmanned aerial or ground vehicles, in many surveillance applications, rely on Global Positioning System (GPS) information for localization. However, disruption of GPS signals, by intention or otherwise, can render these plans and algorithms ineffective. This article provides a way of addressing this issue by utilizing stationary landmarks to aid localization in such G… ▽ More Path planning algorithms for unmanned aerial or ground vehicles, in many surveillance applications, rely on Global Positioning System (GPS) information for localization. However, disruption of GPS signals, by intention or otherwise, can render these plans and algorithms ineffective. This article provides a way of addressing this issue by utilizing stationary landmarks to aid localization in such GPS-disrupted or GPS-denied environment. In particular, given the vehicle's path, we formulate a landmark-placement problem and present algorithms to place the minimum number of landmarks while satisfying the localization, sensing, and collision-avoidance constraints. The performance of such a placement is also evaluated via extensive simulations on ground robots. △ Less

Submitted 10 July, 2018; v1 submitted 21 February, 2018; originally announced February 2018.

Comments: 7 pages, accepted to American Control Conference 2018

Statistical Learning For DC Optimal Power Flow

Authors: Yeesian Ng, Sidhant Misra, Line A. Roald, Scott Backhaus

Abstract: The optimal power flow problem plays an important role in the market clearing and operation of electric power systems. However, with increasing uncertainty from renewable energy operation, the optimal operating point of the system changes more significantly in real-time. In this paper, we aim at develo** control policies that are able to track the optimal set-point with high probability. The app… ▽ More The optimal power flow problem plays an important role in the market clearing and operation of electric power systems. However, with increasing uncertainty from renewable energy operation, the optimal operating point of the system changes more significantly in real-time. In this paper, we aim at develo** control policies that are able to track the optimal set-point with high probability. The approach is based on the observation that the OPF solution corresponding to a certain uncertainty realization is a basic feasible solution, which provides an affine control policy. The optimality of this basis policy is restricted to uncertainty realizations that share the same set of active constraints. We propose an ensemble control policy that combines several basis policies to improve performance. Although the number of possible bases is exponential in the size of the system, we show that only a few of them are relevant to system operation. We adopt a statistical learning approach to learn these important bases, and provide theoretical results that validate our observations. For most systems, we observe that efficient ensemble policies constructed using as few as ten bases, are able to obtain optimal solutions with high probability. △ Less

Submitted 23 January, 2018; originally announced January 2018.

Fast and Robust Determination of Power System Emergency Control Actions

Authors: Sidhant Misra, Line Roald, Marc Vuffray, Michael Chertkov

Abstract: This paper outlines an optimization framework for choosing fast and reliable control actions in a transmission grid emergency situation. We consider contractual load shedding and generation re-dispatch as exemplary emergency actions. To achieve computational efficiency and scalability, this novel formulation of the robust corrective action optimization is stated in terms of voltages and currents,… ▽ More This paper outlines an optimization framework for choosing fast and reliable control actions in a transmission grid emergency situation. We consider contractual load shedding and generation re-dispatch as exemplary emergency actions. To achieve computational efficiency and scalability, this novel formulation of the robust corrective action optimization is stated in terms of voltages and currents, as opposed to standard formulation in terms of power flows and voltages. The current-voltage formulation is natural for expressing voltage and thermal transmission line constraints, and its major advantage is in the linearity of the power flow equations. The complexity of the current-voltage formulation, which is mainly related to the transformation of voltages and currents into active and reactive power injections, can be largely avoided by stating the cost function directly in terms of currents and using linearized or robust estimates for load and generation constraints. The paper considers five different optimization problem formulations, including the full current-voltage formulation, as well as two convex and two linear approximation to the problem. In a case study on an illustrative case study for the IEEE RTS96 system, we demonstrate pros and cons of the different formulations based on simulations for both normal and contingency operation. △ Less

Submitted 22 July, 2017; originally announced July 2017.

Targeted Undersmoothing

Authors: Christian Hansen, Damian Kozbur, Sanjog Misra

Abstract: This paper proposes a post-model selection inference procedure, called targeted undersmoothing, designed to construct uniformly valid confidence sets for a broad class of functionals of sparse high-dimensional statistical models. These include dense functionals, which may potentially depend on all elements of an unknown high-dimensional parameter. The proposed confidence sets are based on an initi… ▽ More This paper proposes a post-model selection inference procedure, called targeted undersmoothing, designed to construct uniformly valid confidence sets for a broad class of functionals of sparse high-dimensional statistical models. These include dense functionals, which may potentially depend on all elements of an unknown high-dimensional parameter. The proposed confidence sets are based on an initially selected model and two additionally selected models, an upper model and a lower model, which enlarge the initially selected model. We illustrate application of the procedure in two empirical examples. The first example considers estimation of heterogeneous treatment effects using data from the Job Training Partnership Act of 1982, and the second example looks at estimating profitability from a mailing strategy based on estimated heterogeneous treatment effects in a direct mail marketing campaign. We also provide evidence on the finite sample performance of the proposed targeted undersmoothing procedure through a series of simulation experiments. △ Less

Submitted 7 June, 2018; v1 submitted 22 June, 2017; originally announced June 2017.

Information Theoretic Optimal Learning of Gaussian Graphical Models

Authors: Sidhant Misra, Marc Vuffray, Andrey Y. Lokhov

Abstract: What is the optimal number of independent observations from which a sparse Gaussian Graphical Model can be correctly recovered? Information-theoretic arguments provide a lower bound on the minimum number of samples necessary to perfectly identify the support of any multivariate normal distribution as a function of model parameters. For a model defined on a sparse graph with $p$ nodes, a maximum de… ▽ More What is the optimal number of independent observations from which a sparse Gaussian Graphical Model can be correctly recovered? Information-theoretic arguments provide a lower bound on the minimum number of samples necessary to perfectly identify the support of any multivariate normal distribution as a function of model parameters. For a model defined on a sparse graph with $p$ nodes, a maximum degree $d$ and minimum normalized edge strength $κ$, this necessary number of samples scales at least as $d \log p/κ^2$. The sample complexity requirements of existing methods for perfect graph reconstruction exhibit dependency on additional parameters that do not enter in the lower bound. The question of whether the lower bound is tight and achievable by a polynomial time algorithm remains open. In this paper, we constructively answer this question and propose an algorithm, termed DICE, whose sample complexity matches the information-theoretic lower bound up to a universal constant factor. We also propose a related algorithm SLICE that has a slightly higher sample complexity, but can be implemented as a mixed integer quadratic program which makes it attractive in practice. Importantly, SLICE retains a critical advantage of DICE in that its sample complexity only depends on quantities present in the information theoretic lower bound. We anticipate that this result will stimulate future search of computationally efficient sample-optimal algorithms. △ Less

Submitted 17 November, 2018; v1 submitted 14 March, 2017; originally announced March 2017.

Corrective Control to Handle Forecast Uncertainty: A Chance Constrained Optimal Power Flow

Authors: Line Roald, Sidhant Misra, Thilo Krause, Goran Andersson

Abstract: Higher shares of electricity generation from renewable energy sources and market liberalization is increasing uncertainty in power systems operation. At the same time, operation is becoming more flexible with improved control systems and new technology such as phase shifting transformers (PSTs) and high voltage direct current connections (HVDC). Previous studies have shown that the use of correcti… ▽ More Higher shares of electricity generation from renewable energy sources and market liberalization is increasing uncertainty in power systems operation. At the same time, operation is becoming more flexible with improved control systems and new technology such as phase shifting transformers (PSTs) and high voltage direct current connections (HVDC). Previous studies have shown that the use of corrective control in response to outages contributes to a reduction in operating cost, while maintaining N-1 security. In this work, we propose a method to extend the use of corrective control of PSTs and HVDCs to react to uncertainty. We characterize the uncertainty as continuous random variables, and define the corrective control actions through affine control policies. This allows us to efficiently model control reactions to a large number of uncertainty sources. The control policies are then included in a chance constrained optimal power flow formulation, which guarantees that the system constraints are enforced with a desired probability. By applying an analytical reformulation of the chance constraints, we obtain a second-order cone problem for which we develop an efficient solution algorithm. In a case study for the IEEE 118 bus system, we show that corrective control for uncertainty leads to a decrease in operational cost, while maintaining system security. Further, we demonstrate the scalability of the method by solving the problem for the IEEE 300 bus and the Polish system test cases. △ Less

Submitted 7 September, 2016; originally announced September 2016.

Comments: 13 pages

Graphical Models for Optimal Power Flow

Authors: Krishnamurthy Dvijotham, Pascal Van Hentenryck, Michael Chertkov, Sidhant Misra, Marc Vuffray

Abstract: Optimal power flow (OPF) is the central optimization problem in electric power grids. Although solved routinely in the course of power grid operations, it is known to be strongly NP-hard in general, and weakly NP-hard over tree networks. In this paper, we formulate the optimal power flow problem over tree networks as an inference problem over a tree-structured graphical model where the nodal varia… ▽ More Optimal power flow (OPF) is the central optimization problem in electric power grids. Although solved routinely in the course of power grid operations, it is known to be strongly NP-hard in general, and weakly NP-hard over tree networks. In this paper, we formulate the optimal power flow problem over tree networks as an inference problem over a tree-structured graphical model where the nodal variables are low-dimensional vectors. We adapt the standard dynamic programming algorithm for inference over a tree-structured graphical model to the OPF problem. Combining this with an interval discretization of the nodal variables, we develop an approximation algorithm for the OPF problem. Further, we use techniques from constraint programming (CP) to perform interval computations and adaptive bound propagation to obtain practically efficient algorithms. Compared to previous algorithms that solve OPF with optimality guarantees using convex relaxations, our approach is able to work for arbitrary distribution networks and handle mixed-integer optimization problems. Further, it can be implemented in a distributed message-passing fashion that is scalable and is suitable for "smart grid" applications like control of distributed energy resources. We evaluate our technique numerically on several benchmark networks and show that practical OPF problems can be solved effectively using this approach. △ Less

Submitted 21 June, 2016; originally announced June 2016.

Comments: To appear in Proceedings of the 22nd International Conference on Principles and Practice of Constraint Programming (CP 2016(

Interaction Screening: Efficient and Sample-Optimal Learning of Ising Models

Authors: Marc Vuffray, Sidhant Misra, Andrey Y. Lokhov, Michael Chertkov

Abstract: We consider the problem of learning the underlying graph of an unknown Ising model on p spins from a collection of i.i.d. samples generated from the model. We suggest a new estimator that is computationally efficient and requires a number of samples that is near-optimal with respect to previously established information-theoretic lower-bound. Our statistical estimator has a physical interpretation… ▽ More We consider the problem of learning the underlying graph of an unknown Ising model on p spins from a collection of i.i.d. samples generated from the model. We suggest a new estimator that is computationally efficient and requires a number of samples that is near-optimal with respect to previously established information-theoretic lower-bound. Our statistical estimator has a physical interpretation in terms of "interaction screening". The estimator is consistent and is efficiently implemented using convex optimization. We prove that with appropriate regularization, the estimator recovers the underlying graph using a number of samples that is logarithmic in the system size p and exponential in the maximum coupling-intensity and maximum node-degree. △ Less

Submitted 19 December, 2016; v1 submitted 23 May, 2016; originally announced May 2016.

Comments: To be published in Advances in Neural Information Processing Systems 30

Journal ref: Advances in Neural Information Processing Systems, 2595--2603, 2016

A Note on Alternating Minimization Algorithm for the Matrix Completion Problem

Authors: David Gamarnik, Sidhant Misra

Abstract: We consider the problem of reconstructing a low rank matrix from a subset of its entries and analyze two variants of the so-called Alternating Minimization algorithm, which has been proposed in the past. We establish that when the underlying matrix has rank $r=1$, has positive bounded entries, and the graph $\mathcal{G}$ underlying the revealed entries has bounded degree and diameter which is at m… ▽ More We consider the problem of reconstructing a low rank matrix from a subset of its entries and analyze two variants of the so-called Alternating Minimization algorithm, which has been proposed in the past. We establish that when the underlying matrix has rank $r=1$, has positive bounded entries, and the graph $\mathcal{G}$ underlying the revealed entries has bounded degree and diameter which is at most logarithmic in the size of the matrix, both algorithms succeed in reconstructing the matrix approximately in polynomial time starting from an arbitrary initialization. We further provide simulation results which suggest that the second algorithm which is based on the message passing type updates, performs significantly better. △ Less

Submitted 5 February, 2016; originally announced February 2016.

Comments: 8 pages, 2 figures

Unit Commitment with N-1 Security and Wind Uncertainty

Authors: Kaarthik Sundar, Harsha Nagarajan, Miles Lubin, Line Roald, Sidhant Misra, Russell Bent, Daniel Bienstock

Abstract: As renewable wind energy penetration rates continue to increase, one of the major challenges facing grid operators is the question of how to control transmission grids in a reliable and a cost-efficient manner. The stochastic nature of wind forces an alteration of traditional methods for solving day-ahead and look-ahead unit commitment and dispatch. In particular, uncontrollable wind generation in… ▽ More As renewable wind energy penetration rates continue to increase, one of the major challenges facing grid operators is the question of how to control transmission grids in a reliable and a cost-efficient manner. The stochastic nature of wind forces an alteration of traditional methods for solving day-ahead and look-ahead unit commitment and dispatch. In particular, uncontrollable wind generation increases the risk of random component failures. To address these questions, we present an N-1 Security and Chance-Constrained Unit Commitment (SCCUC) that includes the modeling of generation reserves that respond to wind fluctuations and tertiary reserves to account for single component outages. The basic formulation is reformulated as a mixed-integer second-order cone problem to limit the probability of failure. We develop three different algorithms to solve the problem to optimality and present a detailed case study on the IEEE RTS-96 single area system. The case study assesses the economic impacts due to contingencies and various degrees of wind power penetration into the system and also corroborates the effectiveness of the algorithms. △ Less

Submitted 30 January, 2016; originally announced February 2016.

Comments: 7 pages, 3 figures

Monotone Order Properties for Control of Nonlinear Parabolic PDE on Graphs

Authors: Sidhant Misra, Marc Vuffray, Anatoly Zlotnik, Michael Chertkov

Abstract: We derive conditions for the propagation of monotone ordering properties for a class of nonlinear parabolic partial differential equation (PDE) systems on metric graphs. For such systems, PDE equations with a general nonlinear dissipation term define evolution on each edge, and balance laws create Kirchhoff-Neumann boundary conditions at the vertices. Initial conditions, as well as time-varying pa… ▽ More We derive conditions for the propagation of monotone ordering properties for a class of nonlinear parabolic partial differential equation (PDE) systems on metric graphs. For such systems, PDE equations with a general nonlinear dissipation term define evolution on each edge, and balance laws create Kirchhoff-Neumann boundary conditions at the vertices. Initial conditions, as well as time-varying parameters in the coupling conditions at vertices, provide an initial value problem (IVP). We first prove that ordering properties of the solution to the IVP are preserved when the initial conditions and time-varying coupling law parameters at vertices are appropriately ordered. In addition, we prove that when monotone ordering is not preserved, the first crossing of solutions occurs at a graph vertex. We consider the implications for robust optimal control formulations and real-time monitoring involving uncertain dynamic flows on networks, and discuss application to subsonic compressible fluid flow with energy dissipation on physical networks. △ Less

Submitted 27 June, 2016; v1 submitted 19 January, 2016; originally announced January 2016.

Chance Constrained Optimal Power Flow with Curtailment and Reserves from Wind Power Plants

Authors: Line Roald, Sidhant Misra, Michael Chertkov, Scott Backhaus, Göran Andersson

Abstract: Over the past years, the share of electricity production from wind power plants has increased to significant levels in several power systems across Europe and the United States. In order to cope with the fluctuating and partially unpredictable nature of renewable energy sources, transmission system operators (TSOs) have responded by increasing their reserve capacity requirements and by requiring w… ▽ More Over the past years, the share of electricity production from wind power plants has increased to significant levels in several power systems across Europe and the United States. In order to cope with the fluctuating and partially unpredictable nature of renewable energy sources, transmission system operators (TSOs) have responded by increasing their reserve capacity requirements and by requiring wind power plants to be capable of providing reserves or following active power set-point signals. This paper addresses the issue of efficiently incorporating these new types of wind power control in the day-ahead operational planning. We review the technical requirements the wind power plants must fulfill, and propose a mathematical framework for modeling wind power control. The framework is based on an optimal power flow formulation with weighted chance constraints, which accounts for the uncertainty of wind power forecasts and allows us to limit the risk of constraint violations. In a case study based on the IEEE 118 bus system, we use the developed method to assess the effectiveness of different types of wind power control in terms of operational cost, system security and wind power curtailment. △ Less

Submitted 17 January, 2016; originally announced January 2016.

Comments: 7 Pages

Monotonicity of Actuated Flows on Dissipative Transport Networks

Authors: Anatoly Zlotnik, Sidhant Misra, Marc Vuffray, Michael Chertkov

Abstract: We derive a monotonicity property for general, transient flows of a commodity transferred throughout a network, where the flow is characterized by density and mass flux dynamics on the edges with density continuity and mass balance conditions at the nodes. The dynamics on each edge are represented by a general system of partial differential equations that approximates subsonic compressible fluid f… ▽ More We derive a monotonicity property for general, transient flows of a commodity transferred throughout a network, where the flow is characterized by density and mass flux dynamics on the edges with density continuity and mass balance conditions at the nodes. The dynamics on each edge are represented by a general system of partial differential equations that approximates subsonic compressible fluid flow with energy dissipation. The transferred commodity may be injected or withdrawn at any of the nodes, and is propelled throughout the network by nodally located compressors. These compressors are controllable actuators that provide a means to manipulate flows through the network, which we therefore consider as a control system. A canonical problem requires compressor control protocols to be chosen such that time-varying nodal commodity withdrawal profiles are delivered and the density remains within strict limits while an economic or operational cost objective is optimized. In this manuscript, we consider the situation where each nodal commodity withdrawal profile is uncertain, but is bounded within known maximum and minimum time-dependent limits. We introduce the monotone parameterized control system property, and prove that general dynamic dissipative network flows possess this characteristic under certain conditions. This property facilitates very efficient formulation of optimal control problems for such systems in which the solutions must be robust with respect to commodity withdrawal uncertainty. We discuss several applications in which such control problems arise and where monotonicity enables simplified characterization of system behavior. △ Less

Submitted 30 March, 2016; v1 submitted 24 November, 2015; originally announced November 2015.

MSC Class: 34C12; 35R02

Maximum Throughput Problem in Dissipative Flow Networks with Application to Natural Gas Systems

Authors: Sidhant Misra, Marc Vuffray, Michael Chertkov

Abstract: We consider a dissipative flow network that obeys the standard linear nodal flow conservation, and where flows on edges are driven by potential difference between adjacent nodes. We show that in the case when the flow is a monotonically increasing function of the potential difference, solution of the network flow equations is unique and can be equivalently recast as the solution of a strictly conv… ▽ More We consider a dissipative flow network that obeys the standard linear nodal flow conservation, and where flows on edges are driven by potential difference between adjacent nodes. We show that in the case when the flow is a monotonically increasing function of the potential difference, solution of the network flow equations is unique and can be equivalently recast as the solution of a strictly convex optimization problem. We also analyze the maximum throughput problem on such networks seeking to maximize the amount of flow that can be delivered to the loads while satisfying bounds on the node potentials. When the dissipation function is differentiable we develop a representation of the maximum throughput problem in the form of a twice differentiable biconvex optimization problem exploiting the variational representation of the network flow equations. In the process we prove a special case of a certain monotonicity property of dissipative flow networks. When the dissipation function follows a power law with exponent greater than one, we suggest a mixed integer convex relaxation of the maximum throughput problem. Finally, we illustrate application of these general results to balanced, i.e. steady, natural gas networks also validating the theory results through simulations on a test case. △ Less

Submitted 9 April, 2015; originally announced April 2015.

Comments: 7 page, 1 figure

Monotonicity of Dissipative Flow Networks Renders Robust Maximum Profit Problem Tractable: General Analysis and Application to Natural Gas Flows

Authors: Marc Vuffray, Sidhant Misra, Michael Chertkov

Abstract: We consider general, steady, balanced flows of a commodity over a network where an instance of the network flow is characterized by edge flows and nodal potentials. Edge flows in and out of a node are assumed to be conserved, thus representing standard network flow relations. The remaining freedom in the flow distribution over the network is constrained by potentials so that the difference of pote… ▽ More We consider general, steady, balanced flows of a commodity over a network where an instance of the network flow is characterized by edge flows and nodal potentials. Edge flows in and out of a node are assumed to be conserved, thus representing standard network flow relations. The remaining freedom in the flow distribution over the network is constrained by potentials so that the difference of potentials at the head and the tail of an edge is expressed as a nonlinear function of the edge flow. We consider networks with nodes divided into three categories: sources that inject flows into the network for a certain cost, terminals which buy the flow at a fixed price and "internal" customers each withdrawing an uncertain amount of flow, which has a priority and thus it is not priced. Our aim is to operate the network such that the profit, i.e. amount of flow sold to terminals minus cost of injection, is maximized, while maintaining the potentials within prescribed bounds. We also require that the operating point is robust with respect to the uncertainty of customers' withdrawals. In this setting we prove that potentials are monotonic functions of the withdrawals. This observation enables us to replace in the maximum profit optimization infinitely many nodal constraints, each representing a particular value of withdrawal uncertainty, by only two constraints representing the cases where all nodes with uncertainty consume their minimum and maximum amounts respectively. We illustrate this general result on example of the natural gas transmission network. In this enabling example gas withdrawals by consumers are assumed uncertain, the potentials are gas pressures squared, the potential drop functions are bilinear in the flow and its intensity with an added tunable factor representing compression. △ Less

Submitted 3 April, 2015; originally announced April 2015.

Comments: 8 pages, 2 figures

Optimal Power Flow with Weighted Chance Constraints and General Policies for Generation Control

Authors: Line Roald, Sidhant Misra, Michael Chertkov, Göran Andersson

Abstract: Due to the increasing amount of electricity generated from renewable sources, uncertainty in power system operation will grow. This has implications for tools such as Optimal Power Flow (OPF), an optimization problem widely used in power system operations and planning, which should be adjusted to account for this uncertainty. One way to handle the uncertainty is to formulate a Chance Constrained O… ▽ More Due to the increasing amount of electricity generated from renewable sources, uncertainty in power system operation will grow. This has implications for tools such as Optimal Power Flow (OPF), an optimization problem widely used in power system operations and planning, which should be adjusted to account for this uncertainty. One way to handle the uncertainty is to formulate a Chance Constrained OPF (CC-OPF) which limits the probability of constraint violation to a predefined value. However, existing CC-OPF formulations and solutions are not immune to drawbacks. On one hand, they only consider affine policies for generation control, which are not always realistic and may be sub-optimal. On the other hand, the standard CC-OPF formulations do not distinguish between large and small violations, although those might carry significantly different risk. In this paper, we introduce the Weighted CC-OPF (WCC-OPF) that can handle general control policies while preserving convexity and allowing for efficient computation. The weighted chance constraints account for the size of violations through a weighting function, which assigns a higher risk to a higher overloads. We prove that the problem remains convex for any convex weighting function, and for very general generation control policies. In a case study, we compare the performance of the new WCC-OPF and the standard CC-OPF and demonstrate that WCC-OPF effectively reduces the number of severe overloads. Furthermore, we compare an affine generation control policy with a more general policy, and show that the additional flexibility allow for a lower cost while maintaining the same level of risk. △ Less

Submitted 31 March, 2015; originally announced April 2015.

Comments: 7 pages, 3 figures

Report number: LA-UR-15-22263

Giant Component in Random Multipartite Graphs with Given Degree Sequences

Authors: David Gamarnik, Sidhant Misra

Abstract: We study the problem of the existence of a giant component in a random multipartite graph. We consider a random multipartite graph with $p$ parts generated according to a given degree sequence $n_i^{\mathbf{d}}(n)$ which denotes the number of vertices in part $i$ of the multipartite graph with degree given by the vector $\mathbf{d}$. We assume that the empirical distribution of the degree sequence… ▽ More We study the problem of the existence of a giant component in a random multipartite graph. We consider a random multipartite graph with $p$ parts generated according to a given degree sequence $n_i^{\mathbf{d}}(n)$ which denotes the number of vertices in part $i$ of the multipartite graph with degree given by the vector $\mathbf{d}$. We assume that the empirical distribution of the degree sequence converges to a limiting probability distribution. Under certain mild regularity assumptions, we characterize the conditions under which, with high probability, there exists a component of linear size. The characterization involves checking whether the Perron-Frobenius norm of the matrix of means of a certain associated edge-biased distribution is greater than unity. We also specify the size of the giant component when it exists. We use the exploration process of Molloy and Reed combined with techniques from the theory of multidimensional Galton-Watson processes to establish this result. △ Less

Submitted 22 January, 2014; v1 submitted 3 June, 2013; originally announced June 2013.

Comments: 26 pages

Strong spatial mixing for list coloring of graphs

Authors: David Gamarnik, Dmitry Katz, Sidhant Misra

Abstract: The property of spatial mixing and strong spatial mixing in spin systems has been of interest because of its implications on uniqueness of Gibbs measures on infinite graphs and efficient approximation of counting problems that are otherwise known to be #P hard. In the context of coloring, strong spatial mixing has been established for regular trees when $q \geq α^{*} Δ+ 1$ where $q$ the number of… ▽ More The property of spatial mixing and strong spatial mixing in spin systems has been of interest because of its implications on uniqueness of Gibbs measures on infinite graphs and efficient approximation of counting problems that are otherwise known to be #P hard. In the context of coloring, strong spatial mixing has been established for regular trees when $q \geq α^{*} Δ+ 1$ where $q$ the number of colors, $Δ$ is the degree and $α^* = 1.763..$ is the unique solution to $xe^{-1/x} = 1$. It has also been established for bounded degree lattice graphs whenever $q \geq α^* Δ- β$ for some constant $β$, where $Δ$ is the maximum vertex degree of the graph. The latter uses a technique based on recursively constructed coupling of Markov chains whereas the former is based on establishing decay of correlations on the tree. We establish strong spatial mixing of list colorings on arbitrary bounded degree triangle-free graphs whenever the size of the list of each vertex $v$ is at least $αΔ(v) + β$ where $Δ(v)$ is the degree of vertex $v$ and $α> α^*$ and $β$ is a constant that only depends on $α$. We do this by proving the decay of correlations via recursive contraction of the distance between the marginals measured with respect to a suitably chosen error function. △ Less

Submitted 5 July, 2012; originally announced July 2012.