-
Are Vision xLSTM Embedded UNet More Reliable in Medical 3D Image Segmentation?
Authors:
Pallabi Dutta,
Soham Bose,
Swalpa Kumar Roy,
Sushmita Mitra
Abstract:
The advancement of develo** efficient medical image segmentation has evolved from initial dependence on Convolutional Neural Networks (CNNs) to the present investigation of hybrid models that combine CNNs with Vision Transformers. Furthermore, there is an increasing focus on creating architectures that are both high-performing in medical image segmentation tasks and computationally efficient to…
▽ More
The advancement of develo** efficient medical image segmentation has evolved from initial dependence on Convolutional Neural Networks (CNNs) to the present investigation of hybrid models that combine CNNs with Vision Transformers. Furthermore, there is an increasing focus on creating architectures that are both high-performing in medical image segmentation tasks and computationally efficient to be deployed on systems with limited resources. Although transformers have several advantages like capturing global dependencies in the input data, they face challenges such as high computational and memory complexity. This paper investigates the integration of CNNs and Vision Extended Long Short-Term Memory (Vision-xLSTM) models by introducing a novel approach called UVixLSTM. The Vision-xLSTM blocks captures temporal and global relationships within the patches extracted from the CNN feature maps. The convolutional feature reconstruction path upsamples the output volume from the Vision-xLSTM blocks to produce the segmentation output. Our primary objective is to propose that Vision-xLSTM forms a reliable backbone for medical image segmentation tasks, offering excellent segmentation performance and reduced computational complexity. UVixLSTM exhibits superior performance compared to state-of-the-art networks on the publicly-available Synapse dataset. Code is available at: https://github.com/duttapallabi2907/UVixLSTM
△ Less
Submitted 24 June, 2024;
originally announced June 2024.
-
Compressed Online Learning of Conditional Mean Embedding
Authors:
Boya Hou,
Sina Sanjari,
Alec Koppel,
Subhonmesh Bose
Abstract:
The conditional mean embedding (CME) encodes Markovian stochastic kernels through their actions on probability distributions embedded within the reproducing kernel Hilbert spaces (RKHS). The CME plays a key role in several well-known machine learning tasks such as reinforcement learning, analysis of dynamical systems, etc. We present an algorithm to learn the CME incrementally from data via an ope…
▽ More
The conditional mean embedding (CME) encodes Markovian stochastic kernels through their actions on probability distributions embedded within the reproducing kernel Hilbert spaces (RKHS). The CME plays a key role in several well-known machine learning tasks such as reinforcement learning, analysis of dynamical systems, etc. We present an algorithm to learn the CME incrementally from data via an operator-valued stochastic gradient descent. As is well-known, function learning in RKHS suffers from scalability challenges from large data. We utilize a compression mechanism to counter the scalability challenge. The core contribution of this paper is a finite-sample performance guarantee on the last iterate of the online compressed operator learning algorithm with fast-mixing Markovian samples, when the target CME may not be contained in the hypothesis space. We illustrate the efficacy of our algorithm by applying it to the analysis of an example dynamical system.
△ Less
Submitted 12 May, 2024;
originally announced May 2024.
-
Addressing Heterogeneity in Federated Load Forecasting with Personalization Layers
Authors:
Shourya Bose,
Yu Zhang,
Kibaek Kim
Abstract:
The advent of smart meters has enabled pervasive collection of energy consumption data for training short-term load forecasting models. In response to privacy concerns, federated learning (FL) has been proposed as a privacy-preserving approach for training, but the quality of trained models degrades as client data becomes heterogeneous. In this paper we propose the use of personalization layers fo…
▽ More
The advent of smart meters has enabled pervasive collection of energy consumption data for training short-term load forecasting models. In response to privacy concerns, federated learning (FL) has been proposed as a privacy-preserving approach for training, but the quality of trained models degrades as client data becomes heterogeneous. In this paper we propose the use of personalization layers for load forecasting in a general framework called PL-FL. We show that PL-FL outperforms FL and purely local training, while requiring lower communication bandwidth than FL. This is done through extensive simulations on three different datasets from the NREL ComStock repository.
△ Less
Submitted 1 April, 2024;
originally announced April 2024.
-
Wholesale Market Participation of DERA: DSO-DERA-ISO Coordination
Authors:
Cong Chen,
Subhonmesh Bose,
Timothy D. Mount,
Lang Tong
Abstract:
Distributed energy resource aggregators (DERAs) must share the distribution network together with the distribution utility in order to participate in the wholesale electricity markets that are operated by independent system operators (ISOs). We propose a forward auction that a distribution system operator (DSO) can utilize to allocate distribution network access limits to DERAs. As long as the DER…
▽ More
Distributed energy resource aggregators (DERAs) must share the distribution network together with the distribution utility in order to participate in the wholesale electricity markets that are operated by independent system operators (ISOs). We propose a forward auction that a distribution system operator (DSO) can utilize to allocate distribution network access limits to DERAs. As long as the DERAs operate within their acquired limits, these limits define operating envelopes that guarantee distribution network security, thus defining a mechanism that requires no real-time intervention from the DSOs for DERAs to participate in the wholesale markets. Our auctions take the form of robust and risk-sensitive markets with bids/offers from DERAs and utility's operational costs. Properties of the proposed auction, e.g., resulting surpluses of DSO and the DERAs, and the auction prices, along with empirical performance studies, are presented.
△ Less
Submitted 7 January, 2024; v1 submitted 4 July, 2023;
originally announced July 2023.
-
On LinDistFlow Model Congestion Pricing: Bounding the Changes in Power Tariffs
Authors:
Shourya Bose,
Kejun Chen,
Yu Zhang
Abstract:
The optimal power flow (OPF) problem is an important mathematical program that aims at obtaining the best operating point of an electric power grid. The optimization problem typically minimizes the total generation cost subject to certain physical constraints of the system. The so-called linearized distribution flow (LinDistFlow) model leverages a set of linear equations to approximate the nonline…
▽ More
The optimal power flow (OPF) problem is an important mathematical program that aims at obtaining the best operating point of an electric power grid. The optimization problem typically minimizes the total generation cost subject to certain physical constraints of the system. The so-called linearized distribution flow (LinDistFlow) model leverages a set of linear equations to approximate the nonlinear AC power flows. In this paper, we consider an OPF problem based on the LinDistFlow model for a single-phase radial power network. We derive closed-form solutions to the marginal values of both real and reactive power demands. We also derive upper bounds on the congestion price (a.k.a. `shadow price'), which denotes the change in marginal demand prices when the apparent power flow limits of certain lines are binding at optimum. Various cases of our result are discussed while simulations are carried out on a $141$-bus radial power network.
△ Less
Submitted 30 April, 2023;
originally announced May 2023.
-
Unsupervised Deep Learning for AC Optimal Power Flow via Lagrangian Duality
Authors:
Kejun Chen,
Shourya Bose,
Yu Zhang
Abstract:
Non-convex AC optimal power flow (AC-OPF) is a fundamental optimization problem in power system analysis. The computational complexity of conventional solvers is typically high and not suitable for large-scale networks in real-time operation. Hence, deep learning based approaches have gained intensive attention to conduct the time-consuming training process offline. Supervised learning methods may…
▽ More
Non-convex AC optimal power flow (AC-OPF) is a fundamental optimization problem in power system analysis. The computational complexity of conventional solvers is typically high and not suitable for large-scale networks in real-time operation. Hence, deep learning based approaches have gained intensive attention to conduct the time-consuming training process offline. Supervised learning methods may yield a feasible AC-OPF solution with a small optimality gap. However, they often need conventional solvers to generate the training dataset. This paper proposes an end-to-end unsupervised learning based framework for AC-OPF. We develop a deep neural network to output a partial set of decision variables while the remaining variables are recovered by solving AC power flow equations. The fast decoupled power flow solver is adopted to further reduce the computational time. In addition, we propose using a modified augmented Lagrangian function as the training loss. The multipliers are adjusted dynamically based on the degree of constraint violation. Extensive numerical test results corroborate the advantages of our proposed approach over some existing methods.
△ Less
Submitted 7 December, 2022;
originally announced December 2022.
-
DSO-DERA Coordination for the Wholesale Market Participation of Distributed Energy Resources
Authors:
Cong Chen,
Subhonmesh Bose,
Lang Tong
Abstract:
We design a coordination mechanism between a distribution system operator (DSO) and distributed energy resource aggregators (DERAs) participating directly in the wholesale electricity market. Aimed at ensuring system reliability while providing open access to DERAs, the coordination mechanism includes a forward auction that allocates access limits to aggregators based on aggregators' bids that rep…
▽ More
We design a coordination mechanism between a distribution system operator (DSO) and distributed energy resource aggregators (DERAs) participating directly in the wholesale electricity market. Aimed at ensuring system reliability while providing open access to DERAs, the coordination mechanism includes a forward auction that allocates access limits to aggregators based on aggregators' bids that represent their benefits of aggregation. The proposed coordination mechanism results in decoupled DSO and DERAs operations that satisfy the network constraints, independent of the stochasticity of the renewables, wholesale real-time locational marginal prices, and individual DERA's aggregation policy. Optimal bidding strategies by competitive aggregators are also derived. The efficiency of the coordination mechanism and the locational price distribution at buses of a radial distribution grid are demonstrated for a 141-bus radial network.
△ Less
Submitted 29 November, 2022;
originally announced November 2022.
-
Controlling a Markov Decision Process with an Abrupt Change in the Transition Kernel
Authors:
Nathan Dahlin,
Subhonmesh Bose,
Venugopal V. Veeravalli
Abstract:
We consider the control of a Markov decision process (MDP) that undergoes an abrupt change in its transition kernel (mode). We formulate the problem of minimizing regret under control-switching based on mode change detection, compared to a mode-observing controller, as an optimal stop** problem. Using a sequence of approximations, we reduce it to a quickest change detection (QCD) problem with Ma…
▽ More
We consider the control of a Markov decision process (MDP) that undergoes an abrupt change in its transition kernel (mode). We formulate the problem of minimizing regret under control-switching based on mode change detection, compared to a mode-observing controller, as an optimal stop** problem. Using a sequence of approximations, we reduce it to a quickest change detection (QCD) problem with Markovian data, for which we characterize a state-dependent threshold-type optimal change detection policy. Numerical experiments illustrate various properties of our control-switching policy.
△ Less
Submitted 8 October, 2022;
originally announced October 2022.
-
Co-optimization of Battery Routing and Load Restoration for Microgrids with Mobile Energy Storage Systems
Authors:
Shourya Bose,
Sifat Chowdhury,
Yu Zhang
Abstract:
Mobile energy storage systems (MESS) offer great operational flexibility to enhance the resiliency of distribution systems in an emergency condition. The optimal placement and sizing of those units are pivotal for quickly restoring the curtailed loads. In this paper, we propose a model for load restoration in a microgrid while concurrently optimizing the MESS routes required for the same. The mode…
▽ More
Mobile energy storage systems (MESS) offer great operational flexibility to enhance the resiliency of distribution systems in an emergency condition. The optimal placement and sizing of those units are pivotal for quickly restoring the curtailed loads. In this paper, we propose a model for load restoration in a microgrid while concurrently optimizing the MESS routes required for the same. The model is formulated as a mixed integer second order cone program by considering the state of charge and evolution of the lower and upper bounds of battery capacities. Simulation results tested on the IEEE 123- bus benchmark system demonstrate the efficacy of the proposed model.
△ Less
Submitted 24 May, 2022;
originally announced May 2022.
-
Differentially Private Load Restoration for Microgrids with Distributed Energy Storage
Authors:
Shourya Bose,
Yu Zhang
Abstract:
Distributed energy storage systems (ESSs) can be efficiently leveraged for load restoration (LR) for a microgrid (MG) in island mode. When the ESSs are owned by third parties rather than the MG operator (MGO), the ESS operating setpoints may be considered as private information of their respective owners. Therefore, efforts must be put forth to avoid the disclosure through adversarial analysis of…
▽ More
Distributed energy storage systems (ESSs) can be efficiently leveraged for load restoration (LR) for a microgrid (MG) in island mode. When the ESSs are owned by third parties rather than the MG operator (MGO), the ESS operating setpoints may be considered as private information of their respective owners. Therefore, efforts must be put forth to avoid the disclosure through adversarial analysis of load setpoints. In his paper, we consider a scenario where LR takes place in a MG by determining load and ESS power injections through the solution of an AC optimal power flow (AC-OPF) problem. Since the charge/discharge mode at any given time is assumed to be private, we develop a differentially-private mechanism which restores load while maintaining privacy of ESS mode data. The performance of the proposed mechanism is demonstrated for a 33-bus MG.
△ Less
Submitted 29 April, 2022;
originally announced April 2022.
-
Conditional Value at Risk-Sensitive Solar Hosting Capacity Analysis in Distribution Networks
Authors:
Avinash N. Madavan,
Nathan Dahlin,
Subhonmesh Bose,
Lang Tong
Abstract:
Solar hosting capacity analysis (HCA) assesses the ability of a distribution network to host distributed solar generation without seriously violating distribution network constraints. In this paper, we consider risk-sensitive HCA that limits the risk of network constraint violations with a collection of scenarios of solar irradiance and nodal power demands, where risk is modeled via the conditiona…
▽ More
Solar hosting capacity analysis (HCA) assesses the ability of a distribution network to host distributed solar generation without seriously violating distribution network constraints. In this paper, we consider risk-sensitive HCA that limits the risk of network constraint violations with a collection of scenarios of solar irradiance and nodal power demands, where risk is modeled via the conditional value at risk (CVaR) measure. First, we consider the question of maximizing aggregate installed solar capacities, subject to risk constraints and solve it as a second-order cone program (SOCP) with a standard conic relaxation of the feasible set with power flow equations. Second, we design an incremental algorithm to decide whether a configuration of solar installations has acceptable risk of constraint violations, modeled via CVaR. The algorithm circumvents explicit risk computation by incrementally constructing inner and outer polyhedral approximations of the set of acceptable solar installation configurations from prior such tests conducted. Our numerical examples study the impact of risk parameters, the number of scenarios and the scalability of our framework.
△ Less
Submitted 19 April, 2022;
originally announced April 2022.
-
Load Restoration in Islanded Microgrids: Formulation and Solution Strategies
Authors:
Shourya Bose,
Yu Zhang
Abstract:
Adverse circumstances such as extreme weather events can cause significant disruptions to normal operation of electric distribution systems (DS), which includes isolating parts of the DS due to damaged transmission equipment. In this paper, we consider the problem of load restoration in a microgrid (MG) that is islanded from the upstream DS. The MG contains sources of distributed generation such a…
▽ More
Adverse circumstances such as extreme weather events can cause significant disruptions to normal operation of electric distribution systems (DS), which includes isolating parts of the DS due to damaged transmission equipment. In this paper, we consider the problem of load restoration in a microgrid (MG) that is islanded from the upstream DS. The MG contains sources of distributed generation such as microturbines and renewable energy sources, as well as energy storage systems (ESS). We formulate the load restoration task as a non-convex optimization problem. This problem embodies the physics of the MG by leveraging a branch flow model, while incorporating salient phenomenon in islanded MGs such as the need for internal frequency regulation, and complementarity requirements arising in ESS operations. Since the formulated optimization problem is non-convex, we introduce a convex relaxation which can be solved through model predictive control as a baseline method. However, in order to solve the problem considering its full non-convexity, we leverage a policy-learning method called constrained policy optimization, a tailored version of which is used as our proposed algorithm. The aforementioned approaches, along with an additional deep learning method are compared through extensive simulations.
△ Less
Submitted 22 September, 2023; v1 submitted 3 November, 2021;
originally announced November 2021.
-
SVM and ANN based Classification of EMG signals by using PCA and LDA
Authors:
Hritam Basak,
Alik Roy,
Jeet Bandhu Lahiri,
Sayantan Bose,
Soumyadeep Patra
Abstract:
In recent decades, biomedical signals have been used for communication in Human-Computer Interfaces (HCI) for medical applications; an instance of these signals are the myoelectric signals (MES), which are generated in the muscles of the human body as unidimensional patterns. Because of this, the methods and algorithms developed for pattern recognition in signals can be applied for their analyses…
▽ More
In recent decades, biomedical signals have been used for communication in Human-Computer Interfaces (HCI) for medical applications; an instance of these signals are the myoelectric signals (MES), which are generated in the muscles of the human body as unidimensional patterns. Because of this, the methods and algorithms developed for pattern recognition in signals can be applied for their analyses once these signals have been sampled and turned into electromyographic (EMG) signals. Additionally, in recent years, many researchers have dedicated their efforts to studying prosthetic control utilizing EMG signal classification, that is, by logging a set of MES in a proper range of frequencies to classify the corresponding EMG signals. The feature classification can be carried out on the time domain or by using other domains such as the frequency domain (also known as the spectral domain), time scale, and time-frequency, amongst others. One of the main methods used for pattern recognition in myoelectric signals is the Support Vector Machines (SVM) technique whose primary function is to identify an n-dimensional hyperplane to separate a set of input feature points into different classes. This technique has the potential to recognize complex patterns and on several occasions, it has proven its worth when compared to other classifiers such as Artificial Neural Network (ANN), Linear Discriminant Analysis (LDA), and Principal Component Analysis(PCA). The key concepts underlying the SVM are (a) the hyperplane separator; (b) the kernel function; (c) the optimal separation hyperplane; and (d) a soft margin (hyperplane tolerance).
△ Less
Submitted 22 October, 2021;
originally announced October 2021.
-
Development and accuracy evaluation of Coded Phase-shift 3D scanner
Authors:
Pranav Kant Gaur,
D. M. Sarode,
S. K. Bose
Abstract:
In this paper, we provide an overview of development of a structured light 3D-scanner based on combination of binary-coded patterns and sinusoidal phase-shifted fringe patterns called Coded Phase-shift technique. Further, we describe the experiments performed to evaluate measurement accuracy and precision of the developed system. A study of this kind is expected to be helpful in understanding the…
▽ More
In this paper, we provide an overview of development of a structured light 3D-scanner based on combination of binary-coded patterns and sinusoidal phase-shifted fringe patterns called Coded Phase-shift technique. Further, we describe the experiments performed to evaluate measurement accuracy and precision of the developed system. A study of this kind is expected to be helpful in understanding the basic working of current structured-light 3D scanners and the approaches followed for their performance assessment.
△ Less
Submitted 20 October, 2021;
originally announced October 2021.
-
Impact of Aviation Electrification on Airports: Flight Scheduling and Charging
Authors:
Boya Hou,
Subhonmesh Bose,
Lavanya Marla,
Kiruba Haran
Abstract:
Electrification can help to reduce the carbon footprint of aviation. The transition away from jet fuel-powered conventional airplane towards battery-powered electrified aircraft will impose extra charging requirements on airports. In this paper, we first quantify the increase in energy demands at several airports across the United States (US), when commercial airline carriers partially deploy hybr…
▽ More
Electrification can help to reduce the carbon footprint of aviation. The transition away from jet fuel-powered conventional airplane towards battery-powered electrified aircraft will impose extra charging requirements on airports. In this paper, we first quantify the increase in energy demands at several airports across the United States (US), when commercial airline carriers partially deploy hybrid electric aircraft (HEA). We then illustrate that smart charging and minor modifications to flight schedules can substantially reduce peak power demands, and in turn the needs for grid infrastructure upgrade. Motivated by our data analysis, we then formulate an optimization problem for slot allocation that incorporates HEA charging considerations. This problem jointly decides flight schedules and charging profiles to manage airport congestion and peak power demands. We illustrate the efficacy of our formulation through a case study on the John F. Kennedy International Airport.
△ Less
Submitted 31 May, 2022; v1 submitted 19 August, 2021;
originally announced August 2021.
-
A 51.3 TOPS/W, 134.4 GOPS In-memory Binary Image Filtering in 65nm CMOS
Authors:
Sumon Kumar Bose,
Deepak Singla,
Arindam Basu
Abstract:
Neuromorphic vision sensors (NVS) can enable energy savings due to their event-driven that exploits the temporal redundancy in video streams from a stationary camera. However, noise-driven events lead to the false triggering of the object recognition processor. Image denoise operations require memoryintensive processing leading to a bottleneck in energy and latency. In this paper, we present in-me…
▽ More
Neuromorphic vision sensors (NVS) can enable energy savings due to their event-driven that exploits the temporal redundancy in video streams from a stationary camera. However, noise-driven events lead to the false triggering of the object recognition processor. Image denoise operations require memoryintensive processing leading to a bottleneck in energy and latency. In this paper, we present in-memory filtering (IMF), a 6TSRAM in-memory computing based image denoising for eventbased binary image (EBBI) frame from an NVS. We propose a non-overlap median filter (NOMF) for image denoising. An inmemory computing framework enables hardware implementation of NOMF leveraging the inherent read disturb phenomenon of 6T-SRAM. To demonstrate the energy-saving and effectiveness of the algorithm, we fabricated the proposed architecture in a 65nm CMOS process. As compared to fully digital implementation, IMF enables > 70x energy savings and a > 3x improvement of processing time when tested with the video recordings from a DAVIS sensor and achieves a peak throughput of 134.4 GOPS. Furthermore, the peak energy efficiencies of the NOMF is 51.3 TOPS/W, comparable with state of the art inmemory processors. We also show that the accuracy of the images obtained by NOMF provide comparable accuracy in tracking and classification applications when compared with images obtained by conventional median filtering.
△ Less
Submitted 29 July, 2021; v1 submitted 25 July, 2021;
originally announced July 2021.
-
Distributed Dual Subgradient Methods with Averaging and Applications to Grid Optimization
Authors:
Subhonmesh Bose,
Hoa Dinh Nguyen,
Haitian Liu,
Ye Guo,
Thinh T. Doan,
Carolyn L. Beck
Abstract:
We study finite-time performance of a recently proposed distributed dual subgradient (DDSG) method for convex constrained multi-agent optimization problems. The algorithm enjoys performance guarantees on the last primal iterate, as opposed to those derived for ergodic means for vanilla DDSG algorithms. Our work improves the recently published convergence rate of $\Ocal(\log T/\sqrt{T})$ with decay…
▽ More
We study finite-time performance of a recently proposed distributed dual subgradient (DDSG) method for convex constrained multi-agent optimization problems. The algorithm enjoys performance guarantees on the last primal iterate, as opposed to those derived for ergodic means for vanilla DDSG algorithms. Our work improves the recently published convergence rate of $\Ocal(\log T/\sqrt{T})$ with decaying step-sizes to $\Ocal(1/\sqrt{T})$ with constant step-size on a metric that combines suboptimality and constraint violation. We then numerically evaluate the algorithm on three grid optimization problems. Namely, these are tie-line scheduling in multi-area power systems, coordination of distributed energy resources in radial distribution networks, and joint dispatch of transmission and distribution assets. The DDSG algorithm applies to each problem with various relaxations and linearizations of the power flow equations. The numerical experiments illustrate various properties of the DDSG algorithm--comparison with vanilla DDSG, impact of the number of agents, and why Nesterov-style acceleration fails in DDSG settings.
△ Less
Submitted 26 July, 2023; v1 submitted 14 July, 2021;
originally announced July 2021.
-
ADIC: Anomaly Detection Integrated Circuit in 65nm CMOS utilizing Approximate Computing
Authors:
Bapi Kar,
Pradeep Kumar Gopalakrishnan,
Sumon Kumar Bose,
Mohendra Roy,
Arindam Basu
Abstract:
In this paper, we present a low-power anomaly detection integrated circuit (ADIC) based on a one-class classifier (OCC) neural network. The ADIC achieves low-power operation through a combination of (a) careful choice of algorithm for online learning and (b) approximate computing techniques to lower average energy. In particular, online pseudoinverse update method (OPIUM) is used to train a random…
▽ More
In this paper, we present a low-power anomaly detection integrated circuit (ADIC) based on a one-class classifier (OCC) neural network. The ADIC achieves low-power operation through a combination of (a) careful choice of algorithm for online learning and (b) approximate computing techniques to lower average energy. In particular, online pseudoinverse update method (OPIUM) is used to train a randomized neural network for quick and resource efficient learning. An additional 42% energy saving can be achieved when a lighter version of OPIUM method is used for training with the same number of data samples lead to no significant compromise on the quality of inference. Instead of a single classifier with large number of neurons, an ensemble of K base learner approach is chosen to reduce learning memory by a factor of K. This also enables approximate computing by dynamically varying the neural network size based on anomaly detection. Fabricated in 65nm CMOS, the ADIC has K = 7 Base Learners (BL) with 32 neurons in each BL and dissipates 11.87pJ/OP and 3.35pJ/OP during learning and inference respectively at Vdd = 0.75V when all 7 BLs are enabled. Further, evaluated on the NASA bearing dataset, approximately 80% of the chip can be shut down for 99% of the lifetime leading to an energy efficiency of 0.48pJ/OP, an 18.5 times reduction over full-precision computing running at Vdd = 1.2V throughout the lifetime.
△ Less
Submitted 21 August, 2020;
originally announced August 2020.
-
Deep Image Orientation Angle Detection
Authors:
Subhadip Maji,
Smarajit Bose
Abstract:
Estimating and rectifying the orientation angle of any image is a pretty challenging task. Initial work used the hand engineering features for this purpose, where after the invention of deep learning using convolution-based neural network showed significant improvement in this problem. However, this paper shows that the combination of CNN and a custom loss function specially designed for angles le…
▽ More
Estimating and rectifying the orientation angle of any image is a pretty challenging task. Initial work used the hand engineering features for this purpose, where after the invention of deep learning using convolution-based neural network showed significant improvement in this problem. However, this paper shows that the combination of CNN and a custom loss function specially designed for angles lead to a state-of-the-art results. This includes the estimation of the orientation angle of any image or document at any degree (0 to 360 degree),
△ Less
Submitted 21 June, 2020;
originally announced July 2020.
-
Rotation Invariant Deep CBIR
Authors:
Subhadip Maji,
Smarajit Bose
Abstract:
Introduction of Convolutional Neural Networks has improved results on almost every image-based problem and Content-Based Image Retrieval is not an exception. But the CNN features, being rotation invariant, creates problems to build a rotation-invariant CBIR system. Though rotation-invariant features can be hand-engineered, the retrieval accuracy is very low because by hand engineering only low-lev…
▽ More
Introduction of Convolutional Neural Networks has improved results on almost every image-based problem and Content-Based Image Retrieval is not an exception. But the CNN features, being rotation invariant, creates problems to build a rotation-invariant CBIR system. Though rotation-invariant features can be hand-engineered, the retrieval accuracy is very low because by hand engineering only low-level features can be created, unlike deep learning models that create high-level features along with low-level features. This paper shows a novel method to build a rotational invariant CBIR system by introducing a deep learning orientation angle detection model along with the CBIR feature extraction model. This paper also highlights that this rotation invariant deep CBIR can retrieve images from a large dataset in real-time.
△ Less
Submitted 21 June, 2020;
originally announced June 2020.
-
Coordinated Transaction Scheduling in Multi-Area Electricity Markets: Equilibrium and Learning
Authors:
Mariola Ndrio,
Subhonmesh Bose,
Lang Tong,
Ye Guo
Abstract:
Tie-line scheduling in multi-area power systems in the US largely proceeds through a market-based mechanism called Coordinated Transaction Scheduling (CTS). We analyze this market mechanism through a game-theoretic lens. Our analysis characterizes the effect of market liquidity, market participants' forecasts about inter-area price spreads, transactions fees and coupling of CTS markets with up-to-…
▽ More
Tie-line scheduling in multi-area power systems in the US largely proceeds through a market-based mechanism called Coordinated Transaction Scheduling (CTS). We analyze this market mechanism through a game-theoretic lens. Our analysis characterizes the effect of market liquidity, market participants' forecasts about inter-area price spreads, transactions fees and coupling of CTS markets with up-to-congestion virtual transactions. Using real data, we empirically verify that CTS bidders can employ simple learning algorithms to discover Nash equilibria that support the conclusions drawn from equilibrium analysis.
△ Less
Submitted 30 January, 2021; v1 submitted 5 June, 2020;
originally announced June 2020.
-
A 75kb SRAM in 65nm CMOS for In-Memory Computing Based Neuromorphic Image Denoising
Authors:
Sumon Kumar Bose,
Vivek Mohan,
Arindam Basu
Abstract:
This paper presents an in-memory computing (IMC) architecture for image denoising. The proposed SRAM based in-memory processing framework works in tandem with approximate computing on a binary image generated from neuromorphic vision sensors. Implemented in TSMC 65nm process, the proposed architecture enables approximately 2000X energy savings (approximately 222X from IMC) compared to a digital im…
▽ More
This paper presents an in-memory computing (IMC) architecture for image denoising. The proposed SRAM based in-memory processing framework works in tandem with approximate computing on a binary image generated from neuromorphic vision sensors. Implemented in TSMC 65nm process, the proposed architecture enables approximately 2000X energy savings (approximately 222X from IMC) compared to a digital implementation when tested with the video recordings from a DAVIS sensor and achieves a peak throughput of 1.25-1.66 frames/us.
△ Less
Submitted 23 March, 2020;
originally announced March 2020.
-
A Scalar Parameterized Mechanism for Two-Sided Markets
Authors:
Mariola Ndrio,
Khaled Alshehri,
Subhonmesh Bose
Abstract:
We consider a market in which both suppliers and consumers compete for a product via scalar-parameterized supply offers and demand bids. Scalar-parameterized offers/bids are appealing due to their modeling simplicity and desirable mathematical properties with the most prominent being bounded efficiency loss and price markup under strategic interactions. Our model incorporates production capacity c…
▽ More
We consider a market in which both suppliers and consumers compete for a product via scalar-parameterized supply offers and demand bids. Scalar-parameterized offers/bids are appealing due to their modeling simplicity and desirable mathematical properties with the most prominent being bounded efficiency loss and price markup under strategic interactions. Our model incorporates production capacity constraints and minimum inelastic demand requirements. Under perfect competition, the market mechanism yields allocations that maximize social welfare. When market participants are price-anticipating, we show that there exists a unique Nash equilibrium, and provide an efficient way to compute the resulting market allocation. Moreover, we explicitly characterize the bounds on the welfare loss and prices observed at the Nash equilibrium.
△ Less
Submitted 2 March, 2020;
originally announced March 2020.
-
On Privatizing Equilibrium Computation in Aggregate Games over Networks
Authors:
Shripad Gade,
Anna Winnicki,
Subhonmesh Bose
Abstract:
We propose a distributed algorithm to compute an equilibrium in aggregate games where players communicate over a fixed undirected network. Our algorithm exploits correlated perturbation to obfuscate information shared over the network. We prove that our algorithm does not reveal private information of players to an honest-but-curious adversary who monitors several nodes in the network. In contrast…
▽ More
We propose a distributed algorithm to compute an equilibrium in aggregate games where players communicate over a fixed undirected network. Our algorithm exploits correlated perturbation to obfuscate information shared over the network. We prove that our algorithm does not reveal private information of players to an honest-but-curious adversary who monitors several nodes in the network. In contrast with differential privacy based algorithms, our method does not sacrifice accuracy of equilibrium computation to provide privacy guarantees.
△ Less
Submitted 12 December, 2019;
originally announced December 2019.
-
Control Under Action-Dependent Markov Packet Drops: An Event-Triggered Approach
Authors:
Shourya Bose,
Pavankumar Tallapragada
Abstract:
In this paper, we consider the problem of second moment stabilization of a scalar linear plant with process noise. We assume that the sensor must communicate with the controller over an unreliable channel, whose state evolves according to a Markov chain, with the transition matrix on a timestep depending on whether there is a transmission or not on that timestep. Under such a setting, we propose a…
▽ More
In this paper, we consider the problem of second moment stabilization of a scalar linear plant with process noise. We assume that the sensor must communicate with the controller over an unreliable channel, whose state evolves according to a Markov chain, with the transition matrix on a timestep depending on whether there is a transmission or not on that timestep. Under such a setting, we propose an event-triggered transmission policy which meets the objective of exponential convergence of the second moment of the plant state to an ultimate bound. Furthermore, we provide upper bounds on the transmission fraction of the proposed policy. The guarantees on performance and transmission fraction are verified using simulations.
△ Less
Submitted 27 December, 2019; v1 submitted 8 December, 2019;
originally announced December 2019.
-
Quantifying Market Efficiency Impacts of Aggregated Distributed Energy Resources
Authors:
Khaled Alshehri,
Mariola Ndrio,
Subhonmesh Bose,
Tamer Başar
Abstract:
We focus on the aggregation of distributed energy resources (DERs) through a profit-maximizing intermediary that enables participation of DERs in wholesale electricity markets. Particularly, we study the market efficiency brought in by the large-scale deployment of DERs and explore to what extent such benefits are offset by the profit-maximizing nature of the aggregator. We deploy a game-theoretic…
▽ More
We focus on the aggregation of distributed energy resources (DERs) through a profit-maximizing intermediary that enables participation of DERs in wholesale electricity markets. Particularly, we study the market efficiency brought in by the large-scale deployment of DERs and explore to what extent such benefits are offset by the profit-maximizing nature of the aggregator. We deploy a game-theoretic framework to study the strategic interactions between an aggregator and DER owners. The proposed model takes into account the stochastic nature of the DER supply. We explicitly characterize the equilibrium of the game and provide illustrative examples to quantify the efficiency loss due to the strategic incentives of the aggregator. Our numerical experiments illustrate the impact of uncertainty and amount of DER integration on the overall market efficiency.
△ Less
Submitted 17 April, 2020; v1 submitted 7 November, 2019;
originally announced November 2019.
-
Pricing Economic Dispatch with AC Power Flow via Local Multipliers and Conic Relaxation
Authors:
Mariola Ndrio,
Anna Winnicki,
Subhonmesh Bose
Abstract:
We analyze pricing mechanisms in electricity markets with AC power flow equations that define a nonconvex feasible set for the economic dispatch problem. Specifically, we consider two possible pricing schemes. The first among these prices are derived from Lagrange multipliers that satisfy Karush-Kuhn-Tucker conditions for local optimality of the nonconvex market clearing problem. The second is der…
▽ More
We analyze pricing mechanisms in electricity markets with AC power flow equations that define a nonconvex feasible set for the economic dispatch problem. Specifically, we consider two possible pricing schemes. The first among these prices are derived from Lagrange multipliers that satisfy Karush-Kuhn-Tucker conditions for local optimality of the nonconvex market clearing problem. The second is derived from optimal dual multipliers of the convex semidefinite programming (SDP) based relaxation of the market clearing problem. Relationships between these prices, their revenue adequacy and market equilibrium properties are derived and compared. The SDP prices are shown to equal distribution locational marginal prices derived with second-order conic relaxations of power flow equations over radial distribution networks. We illustrate our theoretical findings through numerical experiments.
△ Less
Submitted 1 October, 2021; v1 submitted 23 October, 2019;
originally announced October 2019.
-
ADEPOS: Anomaly Detection based Power Saving for Predictive Maintenance using Edge Computing
Authors:
Sumon Kumar Bose,
Bapi Kar,
Mohendra Roy,
Pradeep Kumar Gopalakrishnan,
Arindam Basu
Abstract:
In industry 4.0, predictive maintenance(PM) is one of the most important applications pertaining to the Internet of Things(IoT). Machine learning is used to predict the possible failure of a machine before the actual event occurs. However, the main challenges in PM are (a) lack of enough data from failing machines, and (b) paucity of power and bandwidth to transmit sensor data to cloud throughout…
▽ More
In industry 4.0, predictive maintenance(PM) is one of the most important applications pertaining to the Internet of Things(IoT). Machine learning is used to predict the possible failure of a machine before the actual event occurs. However, the main challenges in PM are (a) lack of enough data from failing machines, and (b) paucity of power and bandwidth to transmit sensor data to cloud throughout the lifetime of the machine. Alternatively, edge computing approaches reduce data transmission and consume low energy. In this paper, we propose Anomaly Detection based Power Saving(ADEPOS) scheme using approximate computing through the lifetime of the machine. In the beginning of the machines life, low accuracy computations are used when the machine is healthy. However, on the detection of anomalies, as time progresses, the system is switched to higher accuracy modes. We show using the NASA bearing dataset that using ADEPOS, we need 8.8X less neurons on average and based on post-layout results, the resultant energy savings are 6.4 to 6.65X
△ Less
Submitted 30 October, 2018;
originally announced November 2018.
-
Cash-settled options for wholesale electricity markets
Authors:
Khaled Alshehri,
Subhonmesh Bose,
Tamer Başar
Abstract:
Wholesale electricity market designs in practice do not provide the market participants with adequate mechanisms to hedge their financial risks. Demanders and suppliers will likely face even greater risks with the deepening penetration of variable renewable resources like wind and solar. This paper explores the design of a centralized cash-settled call option market to mitigate such risks. A cash-…
▽ More
Wholesale electricity market designs in practice do not provide the market participants with adequate mechanisms to hedge their financial risks. Demanders and suppliers will likely face even greater risks with the deepening penetration of variable renewable resources like wind and solar. This paper explores the design of a centralized cash-settled call option market to mitigate such risks. A cash-settled call option is a financial instrument that allows its holder the right to claim a monetary reward equal to the positive difference between the real-time price of an underlying commodity and a pre-negotiated strike price for an upfront fee. Through an example, we illustrate that a bilateral call option can reduce the payment volatility of market participants. Then, we design a centralized clearing mechanism for call options that generalizes the bilateral trade. We illustrate through an example how the centralized clearing mechanism generalizes the bilateral trade. Finally, the effect of risk preference of the market participants, as well as some generalizations are discussed.
△ Less
Submitted 2 April, 2017;
originally announced April 2017.
-
Equivalent relaxations of optimal power flow
Authors:
Subhonmesh Bose,
Steven H. Low,
Thanchanok Teeraratkul,
Babak Hassibi
Abstract:
Several convex relaxations of the optimal power flow (OPF) problem have recently been developed using both bus injection models and branch flow models. In this paper, we prove relations among three convex relaxations: a semidefinite relaxation that computes a full matrix, a chordal relaxation based on a chordal extension of the network graph, and a second-order cone relaxation that computes the sm…
▽ More
Several convex relaxations of the optimal power flow (OPF) problem have recently been developed using both bus injection models and branch flow models. In this paper, we prove relations among three convex relaxations: a semidefinite relaxation that computes a full matrix, a chordal relaxation based on a chordal extension of the network graph, and a second-order cone relaxation that computes the smallest partial matrix. We prove a bijection between the feasible sets of the OPF in the bus injection model and the branch flow model, establishing the equivalence of these two models and their second-order cone relaxations. Our results imply that, for radial networks, all these relaxations are equivalent and one should always solve the second-order cone relaxation. For mesh networks, the semidefinite relaxation is tighter than the second-order cone relaxation but requires a heavier computational effort, and the chordal relaxation strikes a good balance. Simulations are used to illustrate these results.
△ Less
Submitted 8 January, 2014;
originally announced January 2014.
-
Optimal Placement of Distributed Energy Storage in Power Networks
Authors:
Christos Thrampoulidis,
Subhonmesh Bose,
Babak Hassibi
Abstract:
We formulate the optimal placement, sizing and control of storage devices in a power network to minimize generation costs with the intent of load shifting. We assume deterministic demand, a linearized DC approximated power flow model and a fixed available storage budget. Our main result proves that when the generation costs are convex and nondecreasing, there always exists an optimal storage capac…
▽ More
We formulate the optimal placement, sizing and control of storage devices in a power network to minimize generation costs with the intent of load shifting. We assume deterministic demand, a linearized DC approximated power flow model and a fixed available storage budget. Our main result proves that when the generation costs are convex and nondecreasing, there always exists an optimal storage capacity allocation that places zero storage at generation-only buses that connect to the rest of the network via single links. This holds regardless of the demand profiles, generation capacities, line-flow limits and characteristics of the storage technologies. Through a counterexample, we illustrate that this result is not generally true for generation buses with multiple connections. For specific network topologies, we also characterize the dependence of the optimal generation cost on the available storage budget, generation capacities and flow constraints.
△ Less
Submitted 15 August, 2014; v1 submitted 22 March, 2013;
originally announced March 2013.