Showing 1–29 of 29 results for author: Mak, W

Robust Calibration For Improved Weather Prediction Under Distributional Shift

Authors: Sankalp Gilda, Neel Bhandari, Wendy Mak, Andrea Panizza

Abstract: In this paper, we present results on improving out-of-domain weather prediction and uncertainty estimation as part of the \texttt{Shifts Challenge on Robustness and Uncertainty under Real-World Distributional Shift} challenge. We find that by leveraging a mixture of experts in conjunction with an advanced data augmentation technique borrowed from the computer vision domain, in conjunction with rob… ▽ More In this paper, we present results on improving out-of-domain weather prediction and uncertainty estimation as part of the \texttt{Shifts Challenge on Robustness and Uncertainty under Real-World Distributional Shift} challenge. We find that by leveraging a mixture of experts in conjunction with an advanced data augmentation technique borrowed from the computer vision domain, in conjunction with robust \textit{post-hoc} calibration of predictive uncertainties, we can potentially achieve more accurate and better-calibrated results with deep neural networks than with boosted tree models for tabular data. We quantify our predictions using several metrics and propose several future lines of inquiry and experimentation to boost performance. △ Less

Submitted 7 January, 2024; originally announced January 2024.

Comments: Presented at the Bayesian Deep Learning workshop at NeurIPS 2021

Compact Optimization Learning for AC Optimal Power Flow

Authors: Seonho Park, Wenbo Chen, Terrence W. K. Mak, Pascal Van Hentenryck

Abstract: This paper reconsiders end-to-end learning approaches to the Optimal Power Flow (OPF). Existing methods, which learn the input/output map** of the OPF, suffer from scalability issues due to the high dimensionality of the output space. This paper first shows that the space of optimal solutions can be significantly compressed using principal component analysis (PCA). It then proposes Compact Learn… ▽ More This paper reconsiders end-to-end learning approaches to the Optimal Power Flow (OPF). Existing methods, which learn the input/output map** of the OPF, suffer from scalability issues due to the high dimensionality of the output space. This paper first shows that the space of optimal solutions can be significantly compressed using principal component analysis (PCA). It then proposes Compact Learning, a new method that learns in a subspace of the principal components before translating the vectors into the original output space. This compression reduces the number of trainable parameters substantially, improving scalability and effectiveness. Compact Learning is evaluated on a variety of test cases from the PGLib with up to 30,000 buses. The paper also shows that the output of Compact Learning can be used to warm-start an exact AC solver to restore feasibility, while bringing significant speed-ups. △ Less

Submitted 17 May, 2023; v1 submitted 20 January, 2023; originally announced January 2023.

Comments: IEEE TPS revision

Bucketized Active Sampling for Learning ACOPF

Authors: Michael Klamkin, Mathieu Tanneau, Terrence W. K. Mak, Pascal Van Hentenryck

Abstract: This paper considers optimization proxies for Optimal Power Flow (OPF), i.e., machine-learning models that approximate the input/output relationship of OPF. Recent work has focused on showing that such proxies can be of high fidelity. However, their training requires significant data, each instance necessitating the (offline) solving of an OPF for a sample of the input distribution. To meet the re… ▽ More This paper considers optimization proxies for Optimal Power Flow (OPF), i.e., machine-learning models that approximate the input/output relationship of OPF. Recent work has focused on showing that such proxies can be of high fidelity. However, their training requires significant data, each instance necessitating the (offline) solving of an OPF for a sample of the input distribution. To meet the requirements of market-clearing applications, this paper proposes Bucketized Active Sampling (BAS), a novel active learning framework that aims at training the best possible OPF proxy within a time limit. BAS partitions the input distribution into buckets and uses an acquisition function to determine where to sample next. By applying the same partitioning to the validation set, BAS leverages labeled validation samples in the selection of unlabeled samples. BAS also relies on an adaptive learning rate that increases and decreases over time. Experimental results demonstrate the benefits of BAS. △ Less

Submitted 2 October, 2023; v1 submitted 15 August, 2022; originally announced August 2022.

Learning Regionally Decentralized AC Optimal Power Flows with ADMM

Authors: Terrence W. K. Mak, Minas Chatzos, Mathieu Tanneau, Pascal Van Hentenryck

Abstract: One potential future for the next generation of smart grids is the use of decentralized optimization algorithms and secured communications for coordinating renewable generation (e.g., wind/solar), dispatchable devices (e.g., coal/gas/nuclear generations), demand response, battery & storage facilities, and topology optimization. The Alternating Direction Method of Multipliers (ADMM) has been widely… ▽ More One potential future for the next generation of smart grids is the use of decentralized optimization algorithms and secured communications for coordinating renewable generation (e.g., wind/solar), dispatchable devices (e.g., coal/gas/nuclear generations), demand response, battery & storage facilities, and topology optimization. The Alternating Direction Method of Multipliers (ADMM) has been widely used in the community to address such decentralized optimization problems and, in particular, the AC Optimal Power Flow (AC-OPF). This paper studies how machine learning may help in speeding up the convergence of ADMM for solving AC-OPF. It proposes a novel decentralized machine-learning approach, namely ML-ADMM, where each agent uses deep learning to learn the consensus parameters on the coupling branches. The paper also explores the idea of learning only from ADMM runs that exhibit high-quality convergence properties, and proposes filtering mechanisms to select these runs. Experimental results on test cases based on the French system demonstrate the potential of the approach in speeding up the convergence of ADMM significantly. △ Less

Submitted 22 January, 2023; v1 submitted 8 May, 2022; originally announced May 2022.

Comments: 14 pages

SNP2Vec: Scalable Self-Supervised Pre-Training for Genome-Wide Association Study

Authors: Samuel Cahyawijaya, Tiezheng Yu, Zihan Liu, Tiffany T. W. Mak, Xiaopu Zhou, Nancy Y. Ip, Pascale Fung

Abstract: Self-supervised pre-training methods have brought remarkable breakthroughs in the understanding of text, image, and speech. Recent developments in genomics has also adopted these pre-training methods for genome understanding. However, they focus only on understanding haploid sequences, which hinders their applicability towards understanding genetic variations, also known as single nucleotide polym… ▽ More Self-supervised pre-training methods have brought remarkable breakthroughs in the understanding of text, image, and speech. Recent developments in genomics has also adopted these pre-training methods for genome understanding. However, they focus only on understanding haploid sequences, which hinders their applicability towards understanding genetic variations, also known as single nucleotide polymorphisms (SNPs), which is crucial for genome-wide association study. In this paper, we introduce SNP2Vec, a scalable self-supervised pre-training approach for understanding SNP. We apply SNP2Vec to perform long-sequence genomics modeling, and we evaluate the effectiveness of our approach on predicting Alzheimer's disease risk in a Chinese cohort. Our approach significantly outperforms existing polygenic risk score methods and all other baselines, including the model that is trained entirely with haploid sequences. We release our code and dataset on https://github.com/HLTCHKUST/snp2vec. △ Less

Submitted 13 April, 2022; originally announced April 2022.

Spatial Network Decomposition for Fast and Scalable AC-OPF Learning

Authors: Minas Chatzos, Terrence W. K. Mak, Pascal Van Hentenryck

Abstract: This paper proposes a novel machine-learning approach for predicting AC-OPF solutions that features a fast and scalable training. It is motivated by the two critical considerations: (1) the fact that topology optimization and the stochasticity induced by renewable energy sources may lead to fundamentally different AC-OPF instances; and (2) the significant training time needed by existing machine-l… ▽ More This paper proposes a novel machine-learning approach for predicting AC-OPF solutions that features a fast and scalable training. It is motivated by the two critical considerations: (1) the fact that topology optimization and the stochasticity induced by renewable energy sources may lead to fundamentally different AC-OPF instances; and (2) the significant training time needed by existing machine-learning approaches for predicting AC-OPF. The proposed approach is a 2-stage methodology that exploits a spatial decomposition of the power network that is viewed as a set of regions. The first stage learns to predict the flows and voltages on the buses and lines coupling the regions, and the second stage trains, in parallel, the machine-learning models for each region. Experimental results on the French transmission system (up to 6,700 buses and 9,000 lines) demonstrate the potential of the approach. Within a short training time, the approach predicts AC-OPF solutions with very high fidelity and minor constraint violations, producing significant improvements over the state-of-the-art. The results also show that the predictions can seed a load flow optimization to return a feasible solution within 0.03% of the AC-OPF objective, while reducing running times significantly. △ Less

Submitted 17 January, 2021; originally announced January 2021.

Load Encoding for Learning AC-OPF

Authors: Terrence W. K. Mak, Ferdinando Fioretto, Pascal VanHentenryck

Abstract: The AC Optimal Power Flow (AC-OPF) problem is a core building block in electrical transmission system. It seeks the most economical active and reactive generation dispatch to meet demands while satisfying transmission operational limits. It is often solved repeatedly, especially in regions with large penetration of wind farms to avoid violating operational and physical limits. Recent work has show… ▽ More The AC Optimal Power Flow (AC-OPF) problem is a core building block in electrical transmission system. It seeks the most economical active and reactive generation dispatch to meet demands while satisfying transmission operational limits. It is often solved repeatedly, especially in regions with large penetration of wind farms to avoid violating operational and physical limits. Recent work has shown that deep learning techniques have huge potential in providing accurate approximations of AC-OPF solutions. However, deep learning approaches often suffer from scalability issues, especially when applied to real life power grids. This paper focuses on the scalability limitation and proposes a load compression embedding scheme to reduce training model sizes using a 3-step approach. The approach is evaluated experimentally on large-scale test cases from the PGLib, and produces an order of magnitude improvements in training convergence and prediction accuracy. △ Less

Submitted 14 March, 2023; v1 submitted 11 January, 2021; originally announced January 2021.

Comments: 5 pages, IEEE PES Annual Meeting version

Effects of biased and unbiased illuminations on dopant-free GaAs/AlGaAs 2DEGs

Authors: A. Shetty, F. Sfigakis, W. Y. Mak, K. Das Gupta, B. Buonacorsi, M. C. Tam, H. S. Kim, I. Farrer, A. F. Croxall, H. E. Beere, A. R. Hamilton, M. Pepper, D. G. Austing, S. A. Studenikin, A. Sachrajda, M. E. Reimer, Z. R. Wasilewski, D. A. Ritchie, J. Baugh

Abstract: Illumination is performed at low temperature on dopant-free two-dimensional electron gases (2DEGs) of varying depths, under unbiased (gates grounded) and biased (gates at a positive or negative voltage) conditions. Unbiased illuminations in 2DEGs located more than 70 nm away from the surface result in a gain in mobility at a given electron density, primarily driven by the reduction of background i… ▽ More Illumination is performed at low temperature on dopant-free two-dimensional electron gases (2DEGs) of varying depths, under unbiased (gates grounded) and biased (gates at a positive or negative voltage) conditions. Unbiased illuminations in 2DEGs located more than 70 nm away from the surface result in a gain in mobility at a given electron density, primarily driven by the reduction of background impurities. In 2DEGs closer to the surface, unbiased illuminations result in a mobility loss, driven by an increase in surface charge density. Biased illuminations performed with positive applied gate voltages result in a mobility gain, whereas those performed with negative applied voltages result in a mobility loss. The magnitude of the mobility gain (loss) weakens with 2DEG depth, and is likely driven by a reduction (increase) in surface charge density. Remarkably, this mobility gain/loss is fully reversible by performing another biased illumination with the appropriate gate voltage, provided both n-type and p-type ohmic contacts are present. Experimental results are modeled with Boltzmann transport theory, and possible mechanisms are discussed. △ Less

Submitted 21 December, 2021; v1 submitted 28 December, 2020; originally announced December 2020.

Comments: 18 pages, 13 figures; one paragraph rephrased on page 8

High-Fidelity Machine Learning Approximations of Large-Scale Optimal Power Flow

Authors: Minas Chatzos, Ferdinando Fioretto, Terrence W. K. Mak, Pascal Van Hentenryck

Abstract: The AC Optimal Power Flow (AC-OPF) is a key building block in many power system applications. It determines generator setpoints at minimal cost that meet the power demands while satisfying the underlying physical and operational constraints. It is non-convex and NP-hard, and computationally challenging for large-scale power systems. Motivated by the increased stochasticity in generation schedules… ▽ More The AC Optimal Power Flow (AC-OPF) is a key building block in many power system applications. It determines generator setpoints at minimal cost that meet the power demands while satisfying the underlying physical and operational constraints. It is non-convex and NP-hard, and computationally challenging for large-scale power systems. Motivated by the increased stochasticity in generation schedules and increasing penetration of renewable sources, this paper explores a deep learning approach to deliver highly efficient and accurate approximations to the AC-OPF. In particular, the paper proposes an integration of deep neural networks and Lagrangian duality to capture the physical and operational constraints. The resulting model, called OPF-DNN, is evaluated on real case studies from the French transmission system, with up to 3,400 buses and 4,500 lines. Computational results show that OPF-DNN produces highly accurate AC-OPF approximations whose costs are within 0.01% of optimality. OPF-DNN generates, in milliseconds, solutions that capture the problem constraints with high fidelity. △ Less

Submitted 29 June, 2020; originally announced June 2020.

Bilevel Optimization for Differentially Private Optimization in Energy Systems

Authors: Terrence W. K. Mak, Ferdinando Fioretto, Pascal Van Hentenryck

Abstract: This paper studies how to apply differential privacy to constrained optimization problems whose inputs are sensitive. This task raises significant challenges since random perturbations of the input data often render the constrained optimization problem infeasible or change significantly the nature of its optimal solutions. To address this difficulty, this paper proposes a bilevel optimization mode… ▽ More This paper studies how to apply differential privacy to constrained optimization problems whose inputs are sensitive. This task raises significant challenges since random perturbations of the input data often render the constrained optimization problem infeasible or change significantly the nature of its optimal solutions. To address this difficulty, this paper proposes a bilevel optimization model that can be used as a post-processing step: It redistributes the noise introduced by a differentially private mechanism optimally while restoring feasibility and near-optimality. The paper shows that, under a natural assumption, this bilevel model can be solved efficiently for real-life large-scale nonlinear nonconvex optimization problems with sensitive customer data. The experimental results demonstrate the accuracy of the privacy-preserving mechanism and showcases significant benefits compared to standard approaches. △ Less

Submitted 5 January, 2021; v1 submitted 26 January, 2020; originally announced January 2020.

Comments: 9 pages

Lagrangian Duality for Constrained Deep Learning

Authors: Ferdinando Fioretto, Pascal Van Hentenryck, Terrence WK Mak, Cuong Tran, Federico Baldo, Michele Lombardi

Abstract: This paper explores the potential of Lagrangian duality for learning applications that feature complex constraints. Such constraints arise in many science and engineering domains, where the task amounts to learning optimization problems which must be solved repeatedly and include hard physical and operational constraints. The paper also considers applications where the learning task must enforce c… ▽ More This paper explores the potential of Lagrangian duality for learning applications that feature complex constraints. Such constraints arise in many science and engineering domains, where the task amounts to learning optimization problems which must be solved repeatedly and include hard physical and operational constraints. The paper also considers applications where the learning task must enforce constraints on the predictor itself, either because they are natural properties of the function to learn or because it is desirable from a societal standpoint to impose them. This paper demonstrates experimentally that Lagrangian duality brings significant benefits for these applications. In energy domains, the combination of Lagrangian duality and deep learning can be used to obtain state-of-the-art results to predict optimal power flows, in energy systems, and optimal compressor settings, in gas networks. In transprecision computing, Lagrangian duality can complement deep learning to impose monotonicity constraints on the predictor without sacrificing accuracy. Finally, Lagrangian duality can be used to enforce fairness constraints on a predictor and obtain state-of-the-art results when minimizing disparate treatments. △ Less

Submitted 6 April, 2020; v1 submitted 25 January, 2020; originally announced January 2020.

Privacy-Preserving Obfuscation for Distributed Power Systems

Authors: Terrence W. K. Mak, Ferdinando Fioretto, Pascal Van Hentenryck

Abstract: This paper considers the problem of releasing privacy-preserving load data of a decentralized operated power system. The paper focuses on data used to solve Optimal Power Flow (OPF) problems and proposes a distributed algorithm that complies with the notion of Differential Privacy, a strong privacy framework used to bound the risk of re-identification. The problem is challenging since the applicat… ▽ More This paper considers the problem of releasing privacy-preserving load data of a decentralized operated power system. The paper focuses on data used to solve Optimal Power Flow (OPF) problems and proposes a distributed algorithm that complies with the notion of Differential Privacy, a strong privacy framework used to bound the risk of re-identification. The problem is challenging since the application of traditional differential privacy mechanisms to the load data fundamentally changes the nature of the underlying optimization problem and often leads to severe feasibility issues. The proposed differentially private distributed algorithm is based on the Alternating Direction Method of Multipliers (ADMM) and guarantees that the released privacy-preserving data retains high fidelity and satisfies the AC power flow constraints. Experimental results on a variety of OPF benchmarks demonstrate the effectiveness of the approach. △ Less

Submitted 7 October, 2019; originally announced October 2019.

Comments: Total 10 pages: main body 8 pages, reference 1 page, appendix 2 pages

Journal ref: IEEE Transactions on Power Systems ( Volume: 35 , Issue: 2 , March 2020 )

Predicting AC Optimal Power Flows: Combining Deep Learning and Lagrangian Dual Methods

Authors: Ferdinando Fioretto, Terrence W. K. Mak, Pascal Van Hentenryck

Abstract: The Optimal Power Flow (OPF) problem is a fundamental building block for the optimization of electrical power systems. It is nonlinear and nonconvex and computes the generator setpoints for power and voltage, given a set of load demands. It is often needed to be solved repeatedly under various conditions, either in real-time or in large-scale studies. This need is further exacerbated by the increa… ▽ More The Optimal Power Flow (OPF) problem is a fundamental building block for the optimization of electrical power systems. It is nonlinear and nonconvex and computes the generator setpoints for power and voltage, given a set of load demands. It is often needed to be solved repeatedly under various conditions, either in real-time or in large-scale studies. This need is further exacerbated by the increasing stochasticity of power systems due to renewable energy sources in front and behind the meter. To address these challenges, this paper presents a deep learning approach to the OPF. The learning model exploits the information available in the prior states of the system (which is commonly available in practical applications), as well as a dual Lagrangian method to satisfy the physical and engineering constraints present in the OPF. The proposed model is evaluated on a large collection of realistic power systems. The experimental results show that its predictions are highly accurate with average errors as low as 0.2%. Additionally, the proposed approach is shown to improve the accuracy of widely adopted OPF linear DC approximation by at least two orders of magnitude. △ Less

Submitted 3 December, 2019; v1 submitted 18 September, 2019; originally announced September 2019.

Comments: A version of this paper appears in AAAI 2020

The Power Grid Library for Benchmarking AC Optimal Power Flow Algorithms

Authors: Sogol Babaeinejadsarookolaee, Adam Birchfield, Richard D. Christie, Carleton Coffrin, Christopher DeMarco, Ruisheng Diao, Michael Ferris, Stephane Fliscounakis, Scott Greene, Renke Huang, Cedric Josz, Roman Korab, Bernard Lesieutre, Jean Maeght, Terrence W. K. Mak, Daniel K. Molzahn, Thomas J. Overbye, Patrick Panciatici, Byungkwon Park, Jonathan Snodgrass, Ahmad Tbaileh, Pascal Van Hentenryck, Ray Zimmerman

Abstract: In recent years, the power systems research community has seen an explosion of novel methods for formulating the AC power flow equations. Consequently, benchmarking studies using the seminal AC Optimal Power Flow (AC-OPF) problem have emerged as the primary method for evaluating these emerging methods. However, it is often difficult to directly compare these studies due to subtle differences in th… ▽ More In recent years, the power systems research community has seen an explosion of novel methods for formulating the AC power flow equations. Consequently, benchmarking studies using the seminal AC Optimal Power Flow (AC-OPF) problem have emerged as the primary method for evaluating these emerging methods. However, it is often difficult to directly compare these studies due to subtle differences in the AC-OPF problem formulation as well as the network, generation, and loading data that are used for evaluation. To help address these challenges, this IEEE PES Task Force report proposes a standardized AC-OPF mathematical formulation and the PGLib-OPF networks for benchmarking AC-OPF algorithms. A motivating study demonstrates some limitations of the established network datasets in the context of benchmarking AC-OPF algorithms and a validation study demonstrates the efficacy of using the PGLib-OPF networks for this purpose. In the interest of scientific discourse and future additions, the PGLib-OPF benchmark library is open-access and all the of network data is provided under a creative commons license. △ Less

Submitted 4 January, 2021; v1 submitted 7 August, 2019; originally announced August 2019.

Report number: LA-UR-18-29054

Privacy-Preserving Obfuscation of Critical Infrastructure Networks

Authors: Ferdinando Fioretto, Terrence W. K. Mak, Pascal Van Hentenryck

Abstract: The paper studies how to release data about a critical infrastructure network (e.g., the power network or a transportation network) without disclosing sensitive information that can be exploited by malevolent agents, while preserving the realism of the network. It proposes a novel obfuscation mechanism that combines several privacy-preserving building blocks with a bi-level optimization model to s… ▽ More The paper studies how to release data about a critical infrastructure network (e.g., the power network or a transportation network) without disclosing sensitive information that can be exploited by malevolent agents, while preserving the realism of the network. It proposes a novel obfuscation mechanism that combines several privacy-preserving building blocks with a bi-level optimization model to significantly improve accuracy. The obfuscation is evaluated for both realism and privacy properties on real energy and transportation networks. Experimental results show the obfuscation mechanism substantially reduces the potential damage of an attack exploiting the released data to harm the real network. △ Less

Submitted 24 May, 2019; v1 submitted 23 May, 2019; originally announced May 2019.

Comments: A version of this paper appears in the Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence (IJCAI-19), 2019

Differential Privacy for Power Grid Obfuscation

Authors: Ferdinando Fioretto, Terrence W. K. Mak, Pascal Van Hentenryck

Abstract: The availability of high-fidelity energy networks brings significant value to academic and commercial research. However, such releases also raise fundamental concerns related to privacy and security as they can reveal sensitive commercial information and expose system vulnerabilities. This paper investigates how to release power networks where the parameters of transmission lines and transformers… ▽ More The availability of high-fidelity energy networks brings significant value to academic and commercial research. However, such releases also raise fundamental concerns related to privacy and security as they can reveal sensitive commercial information and expose system vulnerabilities. This paper investigates how to release power networks where the parameters of transmission lines and transformers are obfuscated. It does so by using the framework of Differential Privacy (DP), that provides strong privacy guarantees and has attracted significant attention in recent years. Unfortunately, simple DP mechanisms often result in AC-infeasible networks. To address these concerns, this paper presents a novel differential privacy mechanism that guarantees AC-feasibility and largely preserves the fidelity of the obfuscated network. Experimental results also show that the obfuscation significantly reduces the potential damage of an attacker exploiting the release of the dataset. △ Less

Submitted 22 May, 2019; v1 submitted 21 January, 2019; originally announced January 2019.

Journal ref: IEEE Transactions on Smart Grid, vol. 11, no. 2, pp. 1356-1366, March 2020

Phase Transitions for Optimality Gaps in Optimal Power Flows A Study on the French Transmission Network

Authors: Terrence W. K. Mak, Lyndon Shi, Pascal Van Hentenryck

Abstract: This paper investigates phase transitions on the optimality gaps in Optimal Power Flow (OPF) problem on real-world power transmission systems operated in France. The experimental results study optimal power flow solutions for more than 6000 scenarios on the networks with various load profiles, voltage feasibility regions, and generation capabilities. The results show that bifurcations between prim… ▽ More This paper investigates phase transitions on the optimality gaps in Optimal Power Flow (OPF) problem on real-world power transmission systems operated in France. The experimental results study optimal power flow solutions for more than 6000 scenarios on the networks with various load profiles, voltage feasibility regions, and generation capabilities. The results show that bifurcations between primal solutions and the QC, SOCP, and SDP relaxation techniques frequently occur when approaching congestion points. Moreover, the results demonstrate the existence of multiple bifurcations for certain scenarios when load demands are increased uniformly. Preliminary analysis on these bifurcations were performed. △ Less

Submitted 14 July, 2018; originally announced July 2018.

Recurrent Neural Network Language Model Adaptation Derived Document Vector

Authors: Wei Li, Brian Kan Wing Mak

Abstract: In many natural language processing (NLP) tasks, a document is commonly modeled as a bag of words using the term frequency-inverse document frequency (TF-IDF) vector. One major shortcoming of the frequency-based TF-IDF feature vector is that it ignores word orders that carry syntactic and semantic relationships among the words in a document, and they can be important in some NLP tasks such as genr… ▽ More In many natural language processing (NLP) tasks, a document is commonly modeled as a bag of words using the term frequency-inverse document frequency (TF-IDF) vector. One major shortcoming of the frequency-based TF-IDF feature vector is that it ignores word orders that carry syntactic and semantic relationships among the words in a document, and they can be important in some NLP tasks such as genre classification. This paper proposes a novel distributed vector representation of a document: a simple recurrent-neural-network language model (RNN-LM) or a long short-term memory RNN language model (LSTM-LM) is first created from all documents in a task; some of the LM parameters are then adapted by each document, and the adapted parameters are vectorized to represent the document. The new document vectors are labeled as DV-RNN and DV-LSTM respectively. We believe that our new document vectors can capture some high-level sequential information in the documents, which other current document representations fail to capture. The new document vectors were evaluated in the genre classification of documents in three corpora: the Brown Corpus, the BNC Baby Corpus and an artificially created Penn Treebank dataset. Their classification performances are compared with the performance of TF-IDF vector and the state-of-the-art distributed memory model of paragraph vector (PV-DM). The results show that DV-LSTM significantly outperforms TF-IDF and PV-DM in most cases, and combinations of the proposed document vectors with TF-IDF or PV-DM may further improve performance. △ Less

Submitted 1 November, 2016; originally announced November 2016.

Efficient Dynamic Compressor Optimization in Natural Gas Transmission Systems

Authors: Terrence W. K. Mak, Pascal Van Hentenryck, Anatoly Zlotnik, Hassan Hijazi, Russell Bent

Abstract: The growing reliance of electric power systems on gas-fired generation to balance intermittent sources of renewable energy has increased the variation and volume of flows through natural gas transmission pipelines. Adapting pipeline operations to maintain efficiency and security under these new conditions requires optimization methods that account for transients and that can quickly compute soluti… ▽ More The growing reliance of electric power systems on gas-fired generation to balance intermittent sources of renewable energy has increased the variation and volume of flows through natural gas transmission pipelines. Adapting pipeline operations to maintain efficiency and security under these new conditions requires optimization methods that account for transients and that can quickly compute solutions in reaction to generator re-dispatch. This paper presents an efficient scheme to minimize compression costs under dynamic conditions where deliveries to customers are described by time-dependent mass flow. The optimization scheme relies on a compact representation of gas flow physics, a trapezoidal discretization in time and space, and a two-stage approach to minimize energy costs and maximize smoothness. The resulting large-scale nonlinear programs are solved using a modern interior-point method. The proposed optimization scheme is validated against an integration of dynamic equations with adaptive time-step**, as well as a recently proposed state-of-the-art optimal control method. The comparison shows that the solutions are feasible for the continuous problem and also practical from an operational standpoint. The results also indicate that our scheme provides at least an order of magnitude reduction in computation time relative to the state-of-the-art and scales to large gas transmission networks with more than 6000 kilometers of total pipeline. △ Less

Submitted 23 November, 2015; originally announced November 2015.

Leveraging on Easy Java Simulation tool and open source computer simulation library to create interactive digital media for mass customization of high school physics curriculum

Authors: Loo Kang Wee, Wai Keong Mak

Abstract: This paper highlights the diverse possibilities in the rich community of educators from the Conceptual Learning of Science (CoLoS) and Open Source Physics (OSP) movement to engage, enable and empower educators and students, to create interactive digital media through computer modeling. This concept revolves around a paradigmatic shift towards participatory learning through immersive computer model… ▽ More This paper highlights the diverse possibilities in the rich community of educators from the Conceptual Learning of Science (CoLoS) and Open Source Physics (OSP) movement to engage, enable and empower educators and students, to create interactive digital media through computer modeling. This concept revolves around a paradigmatic shift towards participatory learning through immersive computer modeling, as opposed to using technology for information transmission. We aim to engage high school educators to professionally develop themselves by creating and customizing simulations possible through Easy Java Simulation (Ejs) and its learning community. Ejs allows educators to be designers of learning environments through modifying source codes of the simulation. Educators can conduct lessons with students' using these interactive digital simulations and rapidly enhance the simulation through changing the source codes personally. Ejs toolkit, its library of simulations and growing community contributed simulation codes, in a Web 2.0 environment, potentially allows for rapid proliferation of mass customized virtual laboratories simulation with educators as designers of learning environment. Our journey of remixing this simulation created an educator customized interactive digital media virtual laboratory for advancing learning physics by inquiry. The process of creating a simulation also has desirable pedagogical value that will be challenging to bring to high school students to learn by modeling.The impediments to using this method are discussed. △ Less

Submitted 1 July, 2012; originally announced July 2012.

Comments: 7 pages, 17 figures, 3rd Redesigning Pedagogy International Conference 01-03 June 2009, Singapore . http://conference.nie.edu.sg/2009/

Ultra-shallow quantum dots in an undoped GaAs/AlGaAs 2D electron gas

Authors: W. Y. Mak, F. Sfigakis, K. Das Gupta, O. Klochan, H. E. Beere, I. Farrer, J. P. Griffiths, G. A. C. Jones, A. R. Hamilton, D. A. Ritchie

Abstract: We report quantum dots fabricated on very shallow 2-dimensional electron gases, only 30 nm below the surface, in undoped GaAs/AlGaAs heterostructures grown by molecular beam epitaxy. Due to the absence of dopants, an improvement of more than one order of magnitude in mobility (at 2E11 /cm^2) with respect to doped heterostructures with similar depths is observed. These undoped wafers can easily be… ▽ More We report quantum dots fabricated on very shallow 2-dimensional electron gases, only 30 nm below the surface, in undoped GaAs/AlGaAs heterostructures grown by molecular beam epitaxy. Due to the absence of dopants, an improvement of more than one order of magnitude in mobility (at 2E11 /cm^2) with respect to doped heterostructures with similar depths is observed. These undoped wafers can easily be gated with surface metallic gates patterned by e-beam lithography, as demonstrated here from single-level transport through a quantum dot showing large charging energies (up to 1.75 meV) and excited state energies (up to 0.5 meV). △ Less

Submitted 16 March, 2013; v1 submitted 21 December, 2011; originally announced December 2011.

Comments: 4 pages, 4 figures; added figures, references, equations, and text; results/conclusions otherwise unchanged

Journal ref: Applied Physics Letters 102, 103507 (2013)

Linear non-hysteretic gating of a very high density 2DEG in an undoped metal-semiconductor-metal sandwich structure

Authors: K. Das Gupta, A. F. Croxall, W. Y. Mak, H. E. Beere, C. A. Nicoll, I. Farrer, F. Sfigakis, D. A. Ritchie

Abstract: Modulation doped GaAs-AlGaAs quantum well based structures are usually used to achieve very high mobility 2-dimensional electron (or hole) gases. Usually high mobilities ($>10^{7}{\rm{cm}^{2}\rm{V}^{-1}\rm{s}^{-1}}$) are achieved at high densities. A loss of linear gateability is often associated with the highest mobilites, on account of a some residual hop** or parallel conduction in the doped… ▽ More Modulation doped GaAs-AlGaAs quantum well based structures are usually used to achieve very high mobility 2-dimensional electron (or hole) gases. Usually high mobilities ($>10^{7}{\rm{cm}^{2}\rm{V}^{-1}\rm{s}^{-1}}$) are achieved at high densities. A loss of linear gateability is often associated with the highest mobilites, on account of a some residual hop** or parallel conduction in the doped regions. We have developed a method of using fully undoped GaAs-AlGaAs quantum wells, where densities $\approx{6\times10^{11}\rm{cm}^{-2}}$ can be achieved while maintaining fully linear and non-hysteretic gateability. We use these devices to understand the possible mobility limiting mechanisms at very high densities. △ Less

Submitted 18 November, 2011; originally announced November 2011.

Comments: 4 pages, 3 eps figures

Distinguishing impurity concentrations in GaAs and AlGaAs, using very shallow undoped heterostructures

Authors: W. Y. Mak, K. Das Gupta, H. E. Beere, I. Farrer, F. Sfigakis, D. A. Ritchie

Abstract: We demonstrate a method of making a very shallow, gateable, undoped 2-dimensional electron gas. We have developed a method of making very low resistivity contacts to these structures and systematically studied the evolution of the mobility as a function of the depth of the 2DEG (from 300nm to 30nm). We demonstrate a way of extracting quantitative information about the background impurity concentra… ▽ More We demonstrate a method of making a very shallow, gateable, undoped 2-dimensional electron gas. We have developed a method of making very low resistivity contacts to these structures and systematically studied the evolution of the mobility as a function of the depth of the 2DEG (from 300nm to 30nm). We demonstrate a way of extracting quantitative information about the background impurity concentration in GaAs and AlGaAs, the interface roughness and the charge in the surface states from the data. This information is very useful from the perspective of molecular beam epitaxy (MBE) growth. It is difficult to fabricate such shallow high-mobility 2DEGs using modulation do** due to the need to have a large enough spacer layer to reduce scattering and switching noise from remote ionsied dopants. △ Less

Submitted 6 July, 2010; originally announced July 2010.

Comments: 4 pages, 5 eps figures

Journal ref: Applied Physics Letters 97, 242107 (2010)

Slowdown and splitting of gap solitons in apodized Bragg gratings

Authors: William C. K. Mak, Boris A. Malomed, Pak L. Chu

Abstract: We study the motion of gap solitons in two models of apodized nonlinear fiber Bragg gratings (BGs), with the local reflectivity (LR) varying along the fiber. A single step of LR, and a periodic array of alternating steps with opposite signs (a "Bragg superstructure") are considered. A challenging possibility is to slow down and eventually halt the soliton by passing it through the step of increa… ▽ More We study the motion of gap solitons in two models of apodized nonlinear fiber Bragg gratings (BGs), with the local reflectivity (LR) varying along the fiber. A single step of LR, and a periodic array of alternating steps with opposite signs (a "Bragg superstructure") are considered. A challenging possibility is to slow down and eventually halt the soliton by passing it through the step of increasing reflectivity, thus capturing a pulse of standing light. First, we develop an analytical approach, assuming adiabatic evolution of the soliton, and making use of the energy conservation and balance equation for the momentum. Comparison with simulations shows that the analytical approximation is quite accurate (unless the inhomogeneity is too steep): the soliton is either transmitted across the step or bounces back. If the step is narrow, systematic simulations demontrate that the soliton splits into transmitted and reflected pulses (splitting of a BG soliton which hits a chirped grating was observed in experiments). Moving through the periodic "superstructure", the soliton accummulates distortion and suffers radiation loss if the structure is composed of narrow steps. The soliton moves without any loss or irreversible deformation through the array of sufficiently broad steps. △ Less

Submitted 14 May, 2004; originally announced May 2004.

Comments: to appear in a special issue on Wave-Optical Engineering, Journal of Modern Optics

Linearized Perturbations of a Black Hole: Continuum Spectrum

Authors: P. T. Leung, Alec Maassen_van_den_Brink, K. W. Mak, K. Young

Abstract: Linearized perturbations of a Schwarzschild black hole are described, for each angular momentum $\ell$, by the well-studied discrete quasinormal modes (QNMs), and in addition a continuum. The latter is characterized by a cut strength $q(γ>0)$ for frequencies $ω= -iγ$. We show that: (a) $q(γ\downarrow0) \propto γ$, (b) $q(Γ) = 0$ at $Γ= (\ell+2)!/[6(\ell-2)!]$, and (c) $q(γ)$ oscillates with peri… ▽ More Linearized perturbations of a Schwarzschild black hole are described, for each angular momentum $\ell$, by the well-studied discrete quasinormal modes (QNMs), and in addition a continuum. The latter is characterized by a cut strength $q(γ>0)$ for frequencies $ω= -iγ$. We show that: (a) $q(γ\downarrow0) \propto γ$, (b) $q(Γ) = 0$ at $Γ= (\ell+2)!/[6(\ell-2)!]$, and (c) $q(γ)$ oscillates with period $\sim 1$ ($2M\equiv1$). For $\ell=2$, a pair of QNMs are found beyond the cut on the unphysical sheet very close to $Γ$, leading to a large dipole in the Green's function_near_ $Γ$. For a source near the horizon and a distant observer, the continuum contribution relative to that of the QNMs is small. △ Less

Submitted 8 July, 2003; v1 submitted 7 July, 2003; originally announced July 2003.

Comments: REVTeX4, 10pp., 10 EPS figure files. v2: corrected Ref. [28]

Formation of a Standing-Light Pulse through Collision of Gap Solitons

Authors: William C. K. Mak, Boris A. Malomed, Pak L. Chu

Abstract: Results of a systematic theoretical study of collisions between moving solitons in a fiber grating are presented. Various outcomes of the collision are identified, the most interesting one being merger of the solitons into a single zero-velocity pulse, which suggests a way to create pulses of ``standing light". The merger occurs with the solitons whose energy takes values between 0.15 and 0.35 o… ▽ More Results of a systematic theoretical study of collisions between moving solitons in a fiber grating are presented. Various outcomes of the collision are identified, the most interesting one being merger of the solitons into a single zero-velocity pulse, which suggests a way to create pulses of ``standing light". The merger occurs with the solitons whose energy takes values between 0.15 and 0.35 of the limit value, while their velocity is limited by about 0.2 of the limit light velocity in the fiber. If the energy is larger, another noteworthy outcome is acceleration of the solitons as a result of the collision. In the case of mutual passage of the solitons, inelasticity of the collision is quantified by the energy-loss share. Past the soliton's stability limit, the collision results in strong deformation and subsequent destruction of the solitons. Simulations of multiple collisions of two solitons in a fiber-loop configuration are performed too. In this case, the maximum velocity admitting the merger increases to about 0.4 of the limit velocity. Influence of an attractive local defect on the collision is also studied, with a conclusion that the defect does not alter the overall picture, although it traps a small-amplitude pulse. Related effects in single-soliton dynamics are considered too, such as transformation of an input sech signal into a gap soliton (which is quantified by the share of lost energy), and the rate of decay of a quiescent gap soliton in a finite fiber grating, due to energy leakage through loose edges. △ Less

Submitted 14 April, 2003; originally announced April 2003.

Comments: 28 pages, 8 figures, Physical Review E, in press

Unconventional Gravitational Excitation of a Schwarzschild Black Hole

Authors: P. T. Leung, Alec Maassen van den Brink, K. W. Mak, K. Young

Abstract: Besides the well-known quasinormal modes, the gravitational spectrum of a Schwarzschild black hole also has a continuum part on the negative imaginary frequency axis. The latter is studied numerically for quadrupole waves. The results show unexpected striking behavior near the algebraically special frequency $Ω=-4i$. This reveals a pair of unconventional damped modes very near $Ω$, confirmed ana… ▽ More Besides the well-known quasinormal modes, the gravitational spectrum of a Schwarzschild black hole also has a continuum part on the negative imaginary frequency axis. The latter is studied numerically for quadrupole waves. The results show unexpected striking behavior near the algebraically special frequency $Ω=-4i$. This reveals a pair of unconventional damped modes very near $Ω$, confirmed analytically. △ Less

Submitted 23 March, 2003; v1 submitted 6 January, 2003; originally announced January 2003.

Comments: REVTeX4, 4pp, 6 EPS figure files. N.B.: "Alec" is my first, and "Maassen van den Brink" my family name. v2: better pole placement in Fig. 1. v3: fixed Refs. [9,20]. v4: added context on "area quantum" research; trimmed one Fig.; textual clarifications

Journal ref: Class.Quant.Grav. 20 (2003) L217-3532

Interaction of a soliton with a local defect in a fiber Bragg grating

Authors: William C. K. Mak, Pak L. Chu, Boris A. Malomed

Abstract: We study the interactions of a Bragg-grating soliton with a localized attractive defect which is a combined perturbation of the grating and refractive index. A family of exact analytical solutions for solitons trapped by the delta-like defect is found. Direct simulations demonstrate that, up to the numerical accuracy available, the trapped soliton is stable at a single value of its intrinsic par… ▽ More We study the interactions of a Bragg-grating soliton with a localized attractive defect which is a combined perturbation of the grating and refractive index. A family of exact analytical solutions for solitons trapped by the delta-like defect is found. Direct simulations demonstrate that, up to the numerical accuracy available, the trapped soliton is stable at a single value of its intrinsic parameter ("mass"). Trapped solitons with larger mass relax to the stable one through the emission of radiation, while the solitons with smaller mass decay. Depending on values of parameters, simulations of collisions between moving solitons and the defect show that the soliton can get captured, pass through, or even bounce from the defect. If the defect is strong and the soliton is heavy enough, it may split, as a result of the collision, into three fragments: trapped, transmitted, and reflected ones. △ Less

Submitted 12 December, 2002; originally announced December 2002.

Comments: a latex text file and 11 jpg files with figures; an extended version of the paper will appear in Journal of the Optical Society of America B

Interaction of a soliton with a localized gain in a fiber Bragg grating

Authors: William C. K. Mak, Pak L. Chu, Boris A. Malomed

Abstract: A model of a lossy nonlinear fiber grating with a "hot spot", which combines a local gain and an attractive perturbation of the refractive index, is introduced. A family of exact solutions for pinned solitons is found in the absence of loss and gain. In the presence of the loss and localized gain, an instability threshold of the zero solution is found. If the loss and gain are small, it is predi… ▽ More A model of a lossy nonlinear fiber grating with a "hot spot", which combines a local gain and an attractive perturbation of the refractive index, is introduced. A family of exact solutions for pinned solitons is found in the absence of loss and gain. In the presence of the loss and localized gain, an instability threshold of the zero solution is found. If the loss and gain are small, it is predicted what soliton is selected by the energy-balance condition. Direct simulations demonstrate that only one pinned soliton is stable in the conservative model: solitons with a larger energy relax to it via emission of radiation, while those with a smaller energy decay. In the model with the loss and gain, stable pinned pulses demonstrate persistent internal vibrations and emission of radiation. If these solitons are nearly stationary, the prediction based on the energy balance underestimates the necessary gain by 10% to 15% (due to radiation loss). If the loss and gain are larger, the intrinsic vibrations of the pinned soliton become chaotic. The local gain alone, without the attractive perturbation of the local refractive index, cannot maintain a stable pinned soliton. For collisions of moving solitons with the "hot spot", passage and capture regimes are identified, the capture actually implying splitting of the soliton. △ Less

Submitted 3 December, 2002; originally announced December 2002.

Comments: a revtex text file and 17 ps files with figures; submitted to Physical Review E