-
Pixel domain implementation of the Minimally Informed CMB MAp foreground Cleaning (MICMAC) method
Authors:
Magdy Morshed,
Arianna Rizzieri,
Clément Leloup,
Josquin Errard,
Radek Stompor
Abstract:
High fidelity separation of astrophysical foreground contributions from the cosmic microwave background (CMB) signal has been recognized as one of the main challenges of modern CMB data analysis, and one which needs to be addressed in a robust way to ensure that the next generation of CMB polarization experiments lives up to its promise. In this work we consider the non-parametric maximum likeliho…
▽ More
High fidelity separation of astrophysical foreground contributions from the cosmic microwave background (CMB) signal has been recognized as one of the main challenges of modern CMB data analysis, and one which needs to be addressed in a robust way to ensure that the next generation of CMB polarization experiments lives up to its promise. In this work we consider the non-parametric maximum likelihood CMB cleaning approach recently proposed by some of the authors which has been shown to match the performance of standard parametric techniques for simple foreground models, while superseding it in cases where the foregrounds do not exhibit a simple frequency dependence. We present a new implementation of the method in pixel space, extending its functionalities to account for spatial variability of the properties of the foregrounds. We describe the algorithmic details of our approach and its validation against the original code as well as the parametric method for various experimental set-ups and different models of the foreground components. We argue that the method provides a compelling alternative to other state-of-the-art techniques.
△ Less
Submitted 28 May, 2024;
originally announced May 2024.
-
The Simons Observatory: Design, integration, and testing of the small aperture telescopes
Authors:
Nicholas Galitzki,
Tran Tsan,
Jake Spisak,
Michael Randall,
Max Silva-Feaver,
Joseph Seibert,
Jacob Lashner,
Shunsuke Adachi,
Sean M. Adkins,
Thomas Alford,
Kam Arnold,
Peter C. Ashton,
Jason E. Austermann,
Carlo Baccigalupi,
Andrew Bazarko,
James A. Beall,
Sanah Bhimani,
Bryce Bixler,
Gabriele Coppi,
Lance Corbett,
Kevin D. Crowley,
Kevin T. Crowley,
Samuel Day-Weiss,
Simon Dicker,
Peter N. Dow
, et al. (55 additional authors not shown)
Abstract:
The Simons Observatory (SO) is a cosmic microwave background (CMB) survey experiment that includes small-aperture telescopes (SATs) observing from an altitude of 5,200 m in the Atacama Desert in Chile. The SO SATs will cover six spectral bands between 27 and 280 GHz to search for primordial B-modes to a sensitivity of $σ(r)=0.002$, with quantified systematic errors well below this value. Each SAT…
▽ More
The Simons Observatory (SO) is a cosmic microwave background (CMB) survey experiment that includes small-aperture telescopes (SATs) observing from an altitude of 5,200 m in the Atacama Desert in Chile. The SO SATs will cover six spectral bands between 27 and 280 GHz to search for primordial B-modes to a sensitivity of $σ(r)=0.002$, with quantified systematic errors well below this value. Each SAT is a self-contained cryogenic telescope with a 35$^\circ$ field of view, 42 cm diameter optical aperture, 40 K half-wave plate, 1 K refractive optics, and $<0.1$ K focal plane that holds $>12,000$ TES detectors. We describe the nominal design of the SATs and present details about the integration and testing for one operating at 93 and 145 GHz.
△ Less
Submitted 10 May, 2024; v1 submitted 9 May, 2024;
originally announced May 2024.
-
The Simons Observatory: Combining cross-spectral foreground cleaning with multi-tracer $B$-mode delensing for improved constraints on inflation
Authors:
Emilie Hertig,
Kevin Wolz,
Toshiya Namikawa,
Antón Baleato Lizancos,
Susanna Azzoni,
Irene Abril-Cabezas,
David Alonso,
Carlo Baccigalupi,
Erminia Calabrese,
Anthony Challinor,
Josquin Errard,
Giulio Fabbian,
Baptiste Jost,
Nicoletta Krachmalnicoff,
Anto I. Lonappan,
Magdy Morshed,
Luca Pagano,
Blake Sherwin
Abstract:
The Simons Observatory (SO), due to start full science operations in early 2025, aims to set tight constraints on inflationary physics by inferring the tensor-to-scalar ratio $r$ from measurements of CMB polarization $B$-modes. Its nominal design targets a precision $σ(r=0) \leq 0.003$ without delensing. Achieving this goal and further reducing uncertainties requires the mitigation of other source…
▽ More
The Simons Observatory (SO), due to start full science operations in early 2025, aims to set tight constraints on inflationary physics by inferring the tensor-to-scalar ratio $r$ from measurements of CMB polarization $B$-modes. Its nominal design targets a precision $σ(r=0) \leq 0.003$ without delensing. Achieving this goal and further reducing uncertainties requires the mitigation of other sources of large-scale $B$-modes such as Galactic foregrounds and weak gravitational lensing. We present an analysis pipeline aiming to estimate $r$ by including delensing within a cross-spectral likelihood, and demonstrate it on SO-like simulations. Lensing $B$-modes are synthesised using internal CMB lensing reconstructions as well as Planck-like CIB maps and LSST-like galaxy density maps. This $B$-mode template is then introduced into SO's power-spectrum-based foreground-cleaning algorithm by extending the likelihood function to include all auto- and cross-spectra between the lensing template and the SAT $B$-modes. Within this framework, we demonstrate the equivalence of map-based and cross-spectral delensing and use it to motivate an optimized pixel-weighting scheme for power spectrum estimation. We start by validating our pipeline in the simplistic case of uniform foreground spectral energy distributions (SEDs). In the absence of primordial $B$-modes, $σ(r)$ decreases by 37% as a result of delensing. Tensor modes at the level of $r=0.01$ are successfully detected by our pipeline. Even with more realistic foreground models including spatial variations in the dust and synchrotron spectral properties, we obtain unbiased estimates of $r$ by employing the moment-expansion method. In this case, delensing-related improvements range between 27% and 31%. These results constitute the first realistic assessment of the delensing performance at SO's nominal sensitivity level. (Abridged)
△ Less
Submitted 2 May, 2024;
originally announced May 2024.
-
Design & Implementation of Automatic Machine Condition Monitoring and Maintenance System in Limited Resource Situations
Authors:
Abu Hanif Md. Ripon,
Muhammad Ahsan Ullah,
Arindam Kumar Paul,
Md. Mortaza Morshed
Abstract:
In the era of the fourth industrial revolution, it is essential to automate fault detection and diagnosis of machineries so that a warning system can be developed that will help to take an appropriate action before any catastrophic damage. Some machines health monitoring systems are used globally but they are expensive and need trained personnel to operate and analyse. Predictive maintenance and o…
▽ More
In the era of the fourth industrial revolution, it is essential to automate fault detection and diagnosis of machineries so that a warning system can be developed that will help to take an appropriate action before any catastrophic damage. Some machines health monitoring systems are used globally but they are expensive and need trained personnel to operate and analyse. Predictive maintenance and occupational health and safety culture are not available due to inadequate infrastructure, lack of skilled manpower, financial crisis, and others in develo** countries. Starting from develo** a cost-effective DAS for collecting fault data in this study, the effect of limited data and resources has been investigated while automating the process. To solve this problem, A feature engineering and data reduction method has been developed combining the concepts from wavelets, differential calculus, and signal processing. Finally, for automating the whole process, all the necessary theoretical and practical considerations to develop a predictive model have been proposed. The DAS successfully collected the required data from the machine that is 89% accurate compared to the professional manual monitoring system. SVM and NN were proposed for the prediction purpose because of their high predicting accuracy greater than 95% during training and 100% during testing the new samples. In this study, the combination of the simple algorithm with a rule-based system instead of a data-intensive system turned out to be hybridization by validating with collected data. The outcome of this research can be instantly applied to small and medium-sized industries for finding other issues and develo** accordingly. As one of the foundational studies in automatic FDD, the findings and procedure of this study can lead others to extend, generalize, or add other dimensions to FDD automation.
△ Less
Submitted 22 January, 2024;
originally announced January 2024.
-
Reduced sensitivity to process, voltage and temperature variations in activated perpendicular magnetic tunnel junctions based stochastic devices
Authors:
Md Golam Morshed,
Laura Rehm,
Ankit Shukla,
Yunkun Xie,
Samiran Ganguly,
Shaloo Rakheja,
Andrew D. Kent,
Avik W. Ghosh
Abstract:
True random number generators (TRNGs) are fundamental building blocks for many applications, such as cryptography, Monte Carlo simulations, neuromorphic computing, and probabilistic computing. While perpendicular magnetic tunnel junctions (pMTJs) based on low-barrier magnets (LBMs) are natural sources of TRNGs, they tend to suffer from device-to-device variability, low speed, and temperature sensi…
▽ More
True random number generators (TRNGs) are fundamental building blocks for many applications, such as cryptography, Monte Carlo simulations, neuromorphic computing, and probabilistic computing. While perpendicular magnetic tunnel junctions (pMTJs) based on low-barrier magnets (LBMs) are natural sources of TRNGs, they tend to suffer from device-to-device variability, low speed, and temperature sensitivity. Instead, medium-barrier magnets (MBMs) operated with nanosecond pulses - denoted, stochastic magnetic actuated random transducer (SMART) devices - are potentially superior candidates for such applications. We present a systematic analysis of spin-torque-driven switching of MBM-based pMTJs (Eb ~ 20 - 40 kBT) as a function of pulse duration (1 ps to 1 ms), by numerically solving their macrospin dynamics using a 1-D Fokker-Planck equation. We investigate the impact of voltage, temperature, and process variations (MTJ dimensions and material parameters) on the switching probability of the device. Our findings indicate SMART devices activated by short-duration pulses (< 1 ns) are much less sensitive to process-voltage-temperature (PVT) variations while consuming lower energy (~ fJ) than the same devices operated with longer pulses. Our results show a path toward building fast, energy-efficient, and robust TRNG hardware units for solving optimization problems.
△ Less
Submitted 28 October, 2023;
originally announced October 2023.
-
Temperature-Resilient True Random Number Generation with Stochastic Actuated Magnetic Tunnel Junction Devices
Authors:
Laura Rehm,
Md Golam Morshed,
Shashank Misra,
Ankit Shukla,
Shaloo Rakheja,
Mustafa Pinarbasi,
Avik W. Ghosh,
Andrew D. Kent
Abstract:
Nanoscale magnetic tunnel junction (MTJ) devices can efficiently convert thermal energy in the environment into random bitstreams for computational modeling and cryptography. We recently showed that perpendicular MTJs activated by nanosecond pulses can generate true random numbers at high data rates. Here, we explore the dependence of probability bias-the deviations from equal probability (50/50)…
▽ More
Nanoscale magnetic tunnel junction (MTJ) devices can efficiently convert thermal energy in the environment into random bitstreams for computational modeling and cryptography. We recently showed that perpendicular MTJs activated by nanosecond pulses can generate true random numbers at high data rates. Here, we explore the dependence of probability bias-the deviations from equal probability (50/50) 0/1 bit outcomes-of such devices on temperature, pulse amplitude, and duration. Our experimental results and device model demonstrate that operation with nanosecond pulses in the ballistic limit minimizes variation of probability bias with temperature to be far lower than that of devices operated with longer-duration pulses. Further, operation in the short-pulse limit reduces the bias variation with pulse amplitude while rendering the device more sensitive to pulse duration. These results are significant for designing TRNG MTJ circuits and establishing operating conditions.
△ Less
Submitted 8 November, 2023; v1 submitted 28 October, 2023;
originally announced October 2023.
-
Phase Change Induced Magnetic Switching through Metal-insulator Transition in VO2/TbFeCo Films
Authors:
Chung T. Ma,
Salinporn Kittiwatnakul,
Apiprach Sittipongpittaya,
Yuhan Wang,
Md Golam Morshed,
Avik W. Ghosh,
S. Joseph Poon
Abstract:
The ability to manipulate spins in magnetic materials is essential in designing spintronics devices. One method for magnetic switching is through strain. In VO2 on TiO2 thin films, while VO2 remains rutile across the metal-insulator transition, the in-plane lattice area expands going from low temperature insulating phase to high temperature conducting phase. In a VO2/TbFeCo bilayer, the expansion…
▽ More
The ability to manipulate spins in magnetic materials is essential in designing spintronics devices. One method for magnetic switching is through strain. In VO2 on TiO2 thin films, while VO2 remains rutile across the metal-insulator transition, the in-plane lattice area expands going from low temperature insulating phase to high temperature conducting phase. In a VO2/TbFeCo bilayer, the expansion of the VO2 lattice area exerts tension on the amorphous TbFeCo layer. Through the strain effect, magnetic properties, including the magnetic anisotropy and magnetization, of TbFeCo can be changed. In this work, the changes in magnetic properties of TbFeCo on VO2/TiO2(011) are demonstrated using anomalous Hall effect measurements. Across the metal-insulator transition, TbFeCo loses perpendicular magnetic anisotropy, and the magnetization in TbFeCo turns from out-of-plane to in-plane. Using atomistic simulations, we confirm these tunable magnetic properties originating from the metal-insulator transition of VO2. This study provides the groundwork for controlling magnetic properties through a phase transition.
△ Less
Submitted 25 October, 2023;
originally announced October 2023.
-
Electromechanical System Design for Self-Balancing Robot
Authors:
Md. Abid Al Morshed,
Md. Mustakim Hayder,
Tayfur Rahman Maruf
Abstract:
Self-balancing robot is based on the principle of Inverted pendulum, which is a two-wheel vehicle balances itself up in the vertical position with reference to the ground. It consists of both hardware and software implementation. Mechanical model based on the state space design of the cart, pendulum system. To find its stable inverted position, we used a generic feedback controller (i.e., PID cont…
▽ More
Self-balancing robot is based on the principle of Inverted pendulum, which is a two-wheel vehicle balances itself up in the vertical position with reference to the ground. It consists of both hardware and software implementation. Mechanical model based on the state space design of the cart, pendulum system. To find its stable inverted position, we used a generic feedback controller (i.e., PID controller). According to the situation we have to control both angel of pendulum and position of cart. Mechanical design consists of two dc gear motor with encoder, one Arduino microcontroller, IMU (inertial mass unit) sensor and motor driver as a basic need. IMU sensor which consists of accelerometer and gyroscope gives the reference acceleration and angle with respect to ground (vertical), When encoder which is attached with the motor gives the speed of the motor. These parameters are taken as the system parameter and determine the external force needed to balance the robot up. It will be prevented from falling by giving acceleration to the wheels according to its inclination from the vertical. If the bot tilts by an angle, then in the frame of the wheels; the center of mass of the bot will experience a pseudo force which will apply a torque opposite to the direction of tilt. We used a HC05 Bluetooth module to control the robot via our smartphone.
△ Less
Submitted 19 October, 2023; v1 submitted 18 October, 2023;
originally announced October 2023.
-
Desalination Performance of Nano porous Mos$_2$ Membrane on Different Salts of Saline Water: A Molecular Dynamics Study
Authors:
Nudrat Nawal,
Md Rashed Nizam,
Priom Das,
A K M Monjur Morshed
Abstract:
The freshwater crisis is a growing concern and a pressing problem for the world because of the increasing population, civilization, and rapid industrial growth. The water treatment facilities are able to supply less than 1% of the total water demand. Water desalination can be a potential solution to deal with this alarming issue. Researchers have been exploring for quite some time to find novel na…
▽ More
The freshwater crisis is a growing concern and a pressing problem for the world because of the increasing population, civilization, and rapid industrial growth. The water treatment facilities are able to supply less than 1% of the total water demand. Water desalination can be a potential solution to deal with this alarming issue. Researchers have been exploring for quite some time to find novel nano-enhanced membranes and manufacturing techniques to increase the efficiency of the desalination process. Graphene and graphene modified membranes showed huge potential as desalination membranes for comparatively easier synthesis process and higher ion rejection rate than conventional filter materials. Currently, single-layer Mos$_2$ has been discovered to have the same potential of water permeability and ion rejection rate as graphene membrane in a more energy-efficient way. For almost analogous nano porous structure of the graphene membrane, almost 70% of the higher water flux is obtained from the Mos$_2$ membrane. In this work, it has been shown that nano porous Mos$_2$ membranes provide a promising result for desalinating other salts of seawater alongside NaCl. We have also observed the effect of variations in ions, pore size, and pressure on water permeation and ion rejection rates in the water desalination process. In this study, water permeation increased significantly by increasing the pore area from 20Å to 80Å. The rate of water filtration increases in proportion to both applied pressure and pore size, sacrificing the ion rejection rate for the type of ions studied. A combination of salt ions in the saline water for desalination has also been studied, where the rejection rates for the different ions are separately represented for various applied pressures. For seawater, the Mos$_2$ membrane has showed quite promising performance in the study of ion variation.
△ Less
Submitted 26 November, 2023; v1 submitted 9 October, 2023;
originally announced October 2023.
-
A True Random Number Generator for Probabilistic Computing using Stochastic Magnetic Actuated Random Transducer Devices
Authors:
Ankit Shukla,
Laura Heller,
Md Golam Morshed,
Laura Rehm,
Avik W. Ghosh,
Andrew D. Kent,
Shaloo Rakheja
Abstract:
Magnetic tunnel junctions (MTJs), which are the fundamental building blocks of spintronic devices, have been used to build true random number generators (TRNGs) with different trade-offs between throughput, power, and area requirements. MTJs with high-barrier magnets (HBMs) have been used to generate random bitstreams with $\lesssim$ 200~Mb/s throughput and pJ/bit energy consumption. A high temper…
▽ More
Magnetic tunnel junctions (MTJs), which are the fundamental building blocks of spintronic devices, have been used to build true random number generators (TRNGs) with different trade-offs between throughput, power, and area requirements. MTJs with high-barrier magnets (HBMs) have been used to generate random bitstreams with $\lesssim$ 200~Mb/s throughput and pJ/bit energy consumption. A high temperature sensitivity, however, adversely affects their performance as a TRNG. Superparamagnetic MTJs employing low-barrier magnets (LBMs) have also been used for TRNG operation. Although LBM-based MTJs can operate at low energy, they suffer from slow dynamics, sensitivity to process variations, and low fabrication yield. In this paper, we model a TRNG based on medium-barrier magnets (MBMs) with perpendicular magnetic anisotropy. The proposed MBM-based TRNG is driven with short voltage pulses to induce ballistic, yet stochastic, magnetization switching. We show that the proposed TRNG can operate at frequencies of about 500~MHz while consuming less than 100~fJ/bit of energy. In the short-pulse ballistic limit, the switching probability of our device shows robustness to variations in temperature and material parameters relative to LBMs and HBMs. Our results suggest that MBM-based MTJs are suitable candidates for building fast and energy-efficient TRNG hardware units for probabilistic computing.
△ Less
Submitted 18 April, 2023;
originally announced April 2023.
-
A Deep Dive into the Computational Fidelity of High Variability Low Energy Barrier Magnet Technology for Accelerating Optimization and Bayesian Problems
Authors:
Md Golam Morshed,
Samiran Ganguly,
Avik W. Ghosh
Abstract:
Low energy barrier magnet (LBM) technology has recently been proposed as a candidate for accelerating algorithms based on energy minimization and probabilistic graphs because their physical characteristics have a one-to-one map** onto the primitives of these algorithms. Many of these algorithms have a much higher tolerance for error compared to high-accuracy numerical computation. LBM, however,…
▽ More
Low energy barrier magnet (LBM) technology has recently been proposed as a candidate for accelerating algorithms based on energy minimization and probabilistic graphs because their physical characteristics have a one-to-one map** onto the primitives of these algorithms. Many of these algorithms have a much higher tolerance for error compared to high-accuracy numerical computation. LBM, however, is a nascent technology, and devices show high sample-to-sample variability. In this work, we take a deep dive into the overall fidelity afforded by this technology in providing computational primitives for these algorithms. We show that while the compute results show finite deviations from zero variability devices, the margin of error is almost always certifiable to a certain percentage. This suggests that LBM technology could be a viable candidate as an accelerator for popular emerging paradigms of computing.
△ Less
Submitted 15 February, 2023;
originally announced February 2023.
-
Choose your tools carefully: A Comparative Evaluation of Deterministic vs. Stochastic and Binary vs. Analog Neuron models for Implementing Emerging Computing Paradigms
Authors:
Md Golam Morshed,
Samiran Ganguly,
Avik W. Ghosh
Abstract:
Neuromorphic computing, commonly understood as a computing approach built upon neurons, synapses, and their dynamics, as opposed to Boolean gates, is gaining large mindshare due to its direct application in solving current and future computing technological problems, such as smart sensing, smart devices, self-hosted and self-contained devices, artificial intelligence (AI) applications, etc. In a l…
▽ More
Neuromorphic computing, commonly understood as a computing approach built upon neurons, synapses, and their dynamics, as opposed to Boolean gates, is gaining large mindshare due to its direct application in solving current and future computing technological problems, such as smart sensing, smart devices, self-hosted and self-contained devices, artificial intelligence (AI) applications, etc. In a largely software-defined implementation of neuromorphic computing, it is possible to throw enormous computational power or optimize models and networks depending on the specific nature of the computational tasks. However, a hardware-based approach needs the identification of well-suited neuronal and synaptic models to obtain high functional and energy efficiency, which is a prime concern in size, weight, and power (SWaP) constrained environments. In this work, we perform a study on the characteristics of hardware neuron models (namely, inference errors, generalizability and robustness, practical implementability, and memory capacity) that have been proposed and demonstrated using a plethora of emerging nano-materials technology-based physical devices, to quantify the performance of such neurons on certain classes of problems that are of great importance in real-time signal processing like tasks in the context of reservoir computing. We find that the answer on which neuron to use for what applications depends on the particulars of the application requirements and constraints themselves, i.e., we need not only a hammer but all sorts of tools in our tool chest for high efficiency and quality neuromorphic computing.
△ Less
Submitted 5 May, 2023; v1 submitted 10 February, 2023;
originally announced February 2023.
-
The Simons Observatory: pipeline comparison and validation for large-scale B-modes
Authors:
K. Wolz,
S. Azzoni,
C. Hervias-Caimapo,
J. Errard,
N. Krachmalnicoff,
D. Alonso,
C. Baccigalupi,
A. Baleato Lizancos,
M. L. Brown,
E. Calabrese,
J. Chluba,
J. Dunkley,
G. Fabbian,
N. Galitzki,
B. Jost,
M. Morshed,
F. Nati
Abstract:
The upcoming Simons Observatory Small Aperture Telescopes aim at achieving a constraint on the primordial tensor-to-scalar ratio $r$ at the level of $σ(r=0)\lesssim0.003$, observing the polarized CMB in the presence of partial sky coverage, cosmic variance, inhomogeneous non-white noise, and Galactic foregrounds. We present three different analysis pipelines able to constrain $r$ given the latest…
▽ More
The upcoming Simons Observatory Small Aperture Telescopes aim at achieving a constraint on the primordial tensor-to-scalar ratio $r$ at the level of $σ(r=0)\lesssim0.003$, observing the polarized CMB in the presence of partial sky coverage, cosmic variance, inhomogeneous non-white noise, and Galactic foregrounds. We present three different analysis pipelines able to constrain $r$ given the latest available instrument performance, and compare their predictions on a set of sky simulations that allow us to explore a number of Galactic foreground models and elements of instrumental noise, relevant for the Simons Observatory. The three pipelines employ different combinations of parametric and non-parametric component separation at the map and power spectrum levels, and use B-mode purification to estimate the CMB B-mode power spectrum. We applied them to a common set of simulated realistic frequency maps, and compared and validated them with focus on their ability to extract robust constraints on the tensor-to-scalar ratio $r$. We evaluated their performance in terms of bias and statistical uncertainty on this parameter. In most of the scenarios the three methodologies achieve similar performance. Nevertheless, several simulations with complex foreground signals lead to a $>2σ$ bias on $r$ if analyzed with the default versions of these pipelines, highlighting the need for more sophisticated pipeline components that marginalize over foreground residuals. We show two such extensions, using power-spectrum-based and map-based methods, that are able to fully reduce the bias on $r$ below the statistical uncertainties in all foreground models explored, at a moderate cost in terms of $σ(r)$.
△ Less
Submitted 9 July, 2024; v1 submitted 8 February, 2023;
originally announced February 2023.
-
Fruit Quality Assessment with Densely Connected Convolutional Neural Network
Authors:
Md. Samin Morshed,
Sabbir Ahmed,
Tasnim Ahmed,
Muhammad Usama Islam,
A. B. M. Ashikur Rahman
Abstract:
Accurate recognition of food items along with quality assessment is of paramount importance in the agricultural industry. Such automated systems can speed up the wheel of the food processing sector and save tons of manual labor. In this connection, the recent advancement of Deep learning-based architectures has introduced a wide variety of solutions offering remarkable performance in several class…
▽ More
Accurate recognition of food items along with quality assessment is of paramount importance in the agricultural industry. Such automated systems can speed up the wheel of the food processing sector and save tons of manual labor. In this connection, the recent advancement of Deep learning-based architectures has introduced a wide variety of solutions offering remarkable performance in several classification tasks. In this work, we have exploited the concept of Densely Connected Convolutional Neural Networks (DenseNets) for fruit quality assessment. The feature propagation towards the deeper layers has enabled the network to tackle the vanishing gradient problems and ensured the reuse of features to learn meaningful insights. Evaluating on a dataset of 19,526 images containing six fruits having three quality grades for each, the proposed pipeline achieved a remarkable accuracy of 99.67%. The robustness of the model was further tested for fruit classification and quality assessment tasks where the model produced a similar performance, which makes it suitable for real-life applications.
△ Less
Submitted 24 December, 2022; v1 submitted 8 December, 2022;
originally announced December 2022.
-
ALS: Augmented Lagrangian Sketching Methods for Linear Systems
Authors:
Md Sarowar Morshed
Abstract:
We develop two fundamental stochastic sketching techniques; Penalty Sketching (PS) and Augmented Lagrangian Sketching (ALS) for solving consistent linear systems. The proposed PS and ALS techniques extend and generalize the scope of Sketch & Project (SP) method by introducing Lagrangian penalty sketches. In doing so, we recover SP methods as special cases and furthermore develop a family of new st…
▽ More
We develop two fundamental stochastic sketching techniques; Penalty Sketching (PS) and Augmented Lagrangian Sketching (ALS) for solving consistent linear systems. The proposed PS and ALS techniques extend and generalize the scope of Sketch & Project (SP) method by introducing Lagrangian penalty sketches. In doing so, we recover SP methods as special cases and furthermore develop a family of new stochastic iterative methods. By varying sketch parameters in the proposed PS method, we recover novel stochastic methods such as Penalty Newton Descent, Penalty Kaczmarz, Penalty Stochastic Descent, Penalty Coordinate Descent, Penalty Gaussian Pursuit, and Penalty Block Kaczmarz. Furthermore, the proposed ALS method synthesizes a wide variety of new stochastic methods such as Augmented Newton Descent, Augmented Kaczmarz, Augmented Stochastic Descent, Augmented Coordinate Descent, Augmented Gaussian Pursuit, and Augmented Block Kaczmarz into one framework. Moreover, we show that the developed PS and ALS frameworks can be used to reformulate the original linear system into equivalent stochastic optimization problems namely the Penalty Stochastic Reformulation and Augmented Stochastic Reformulation. We prove global convergence rates for the PS and ALS methods as well as sub-linear $\mathcal{O}(\frac{1}{k})$ rates for the Cesaro average of iterates. The proposed convergence results hold for a wide family of distributions of random matrices, which provides the opportunity of fine-tuning the randomness of the method suitable for specific applications. Finally, we perform computational experiments that demonstrate the efficiency of our methods compared to the existing SP methods.
△ Less
Submitted 12 August, 2022;
originally announced August 2022.
-
Augmented Newton Method for Optimization: Global Linear Rate and Momentum Interpretation
Authors:
Md Sarowar Morshed
Abstract:
We propose two variants of Newton method for solving unconstrained minimization problem. Our method leverages optimization techniques such as penalty and augmented Lagrangian method to generate novel variants of the Newton method namely the Penalty Newton method and the Augmented Newton method. In doing so, we recover several well-known existing Newton method variants such as Damped Newton, Levenb…
▽ More
We propose two variants of Newton method for solving unconstrained minimization problem. Our method leverages optimization techniques such as penalty and augmented Lagrangian method to generate novel variants of the Newton method namely the Penalty Newton method and the Augmented Newton method. In doing so, we recover several well-known existing Newton method variants such as Damped Newton, Levenberg, and Levenberg-Marquardt methods as special cases. Moreover, the proposed Augmented Newton method can be interpreted as Newton method with adaptive heavy ball momentum. We provide global convergence results for the proposed methods under mild assumptions that hold for a wide variety of problems. The proposed methods can be sought as the penalty and augmented extensions of the results obtained by Karimireddy et. al [24].
△ Less
Submitted 23 May, 2022;
originally announced May 2022.
-
Penalty & Augmented Kaczmarz Methods For Linear Systems & Linear Feasibility Problems
Authors:
Md Sarowar Morshed
Abstract:
In this work, we shed light on the so-called Kaczmarz method for solving Linear System (LS) and Linear Feasibility (LF) problems from a optimization point of view. We introduce well-known optimization approaches such as Lagrangian penalty and Augmented Lagrangian in the Randomized Kaczmarz (RK) method. In doing so, we propose two variants of the RK method namely the Randomized Penalty Kacmarz (RPK…
▽ More
In this work, we shed light on the so-called Kaczmarz method for solving Linear System (LS) and Linear Feasibility (LF) problems from a optimization point of view. We introduce well-known optimization approaches such as Lagrangian penalty and Augmented Lagrangian in the Randomized Kaczmarz (RK) method. In doing so, we propose two variants of the RK method namely the Randomized Penalty Kacmarz (RPK) method and Randomized Augmented Kacmarz (RAK) method. We carry out convergence analysis of the proposed methods and obtain linear convergence results.
△ Less
Submitted 12 August, 2022; v1 submitted 17 May, 2022;
originally announced May 2022.
-
Learning Audio Representations with MLPs
Authors:
Mashrur M. Morshed,
Ahmad Omar Ahsan,
Hasan Mahmud,
Md. Kamrul Hasan
Abstract:
In this paper, we propose an efficient MLP-based approach for learning audio representations, namely timestamp and scene-level audio embeddings. We use an encoder consisting of sequentially stacked gated MLP blocks, which accept 2D MFCCs as inputs. In addition, we also provide a simple temporal interpolation-based algorithm for computing scene-level embeddings from timestamp embeddings. The audio…
▽ More
In this paper, we propose an efficient MLP-based approach for learning audio representations, namely timestamp and scene-level audio embeddings. We use an encoder consisting of sequentially stacked gated MLP blocks, which accept 2D MFCCs as inputs. In addition, we also provide a simple temporal interpolation-based algorithm for computing scene-level embeddings from timestamp embeddings. The audio representations generated by our method are evaluated across a diverse set of benchmarks at the Holistic Evaluation of Audio Representations (HEAR) challenge, hosted at the NeurIPS 2021 competition track. We achieved first place on the Speech Commands (full), Speech Commands (5 hours), and the Mridingham Tonic benchmarks. Furthermore, our approach is also the most resource-efficient among all the submitted methods, in terms of both the number of model parameters and the time required to compute embeddings.
△ Less
Submitted 16 March, 2022;
originally announced March 2022.
-
Positional stability of skyrmions in a racetrack memory with notched geometry
Authors:
Md Golam Morshed,
Hamed Vakili,
Avik W. Ghosh
Abstract:
Magnetic skyrmions are chiral spin textures with attractive features, such as ultra-small size, solitonic nature, and easy mobility with small electrical currents that make them promising as information-carrying bits in low-power high-density memory, and logic applications. However, it is essential to guarantee the positional stability of skyrmions for reliable information extraction. Using microm…
▽ More
Magnetic skyrmions are chiral spin textures with attractive features, such as ultra-small size, solitonic nature, and easy mobility with small electrical currents that make them promising as information-carrying bits in low-power high-density memory, and logic applications. However, it is essential to guarantee the positional stability of skyrmions for reliable information extraction. Using micromagnetic simulations for the minimum energy path (MEP), we compute the energy barriers associated with stabilizing notches along a racetrack. We vary material parameters, specifically, the strength of the chiral Dzyaloshinskii-Moriya interactions (DMI), the notch geometry, and the thickness of the racetrack to get the optimal barrier height. We find that the reduction of skyrmion size as it squeezes past the notch gives rise to the energy barrier. We find a range of energy barriers up to ~ 45 kBT for a racetrack of 5 nm thickness that can provide years long positional lifetime of skyrmions for long-term memory applications while requiring a moderate amount of current (~ 10^10 A/m2) to move the skyrmions. Furthermore, we derive quasi-analytical equations to estimate the energy barrier. We also explore other pinning mechanisms, such as a local variation of material parameters in a region, and find that notched geometry provides the highest energy barrier. Our results open up possibilities to design practical skyrmion-based racetrack geometries for spintronics applications.
△ Less
Submitted 27 December, 2021; v1 submitted 26 October, 2021;
originally announced October 2021.
-
Attention-Free Keyword Spotting
Authors:
Mashrur M. Morshed,
Ahmad Omar Ahsan
Abstract:
Till now, attention-based models have been used with great success in the keyword spotting problem domain. However, in light of recent advances in deep learning, the question arises whether self-attention is truly irreplaceable for recognizing speech keywords. We thus explore the usage of gated MLPs --previously shown to be alternatives to transformers in vision tasks-- for the keyword spotting ta…
▽ More
Till now, attention-based models have been used with great success in the keyword spotting problem domain. However, in light of recent advances in deep learning, the question arises whether self-attention is truly irreplaceable for recognizing speech keywords. We thus explore the usage of gated MLPs --previously shown to be alternatives to transformers in vision tasks-- for the keyword spotting task. We provide a family of highly efficient MLP-based models for keyword spotting, with less than 0.5 million parameters. We show that our approach achieves competitive performance on Google Speech Commands V2-12 and V2-35 benchmarks with much fewer parameters than self-attention-based methods.
△ Less
Submitted 10 April, 2022; v1 submitted 14 October, 2021;
originally announced October 2021.
-
A Deep Learning-based Multimodal Depth-Aware Dynamic Hand Gesture Recognition System
Authors:
Hasan Mahmud,
Mashrur M. Morshed,
Md. Kamrul Hasan
Abstract:
The dynamic hand gesture recognition task has seen studies on various unimodal and multimodal methods. Previously, researchers have explored depth and 2D-skeleton-based multimodal fusion CRNNs (Convolutional Recurrent Neural Networks) but have had limitations in getting expected recognition results. In this paper, we revisit this approach to hand gesture recognition and suggest several improvement…
▽ More
The dynamic hand gesture recognition task has seen studies on various unimodal and multimodal methods. Previously, researchers have explored depth and 2D-skeleton-based multimodal fusion CRNNs (Convolutional Recurrent Neural Networks) but have had limitations in getting expected recognition results. In this paper, we revisit this approach to hand gesture recognition and suggest several improvements. We observe that raw depth images possess low contrast in the hand regions of interest (ROI). They do not highlight important fine details, such as finger orientation, overlap between the finger and palm, or overlap between multiple fingers. We thus propose quantizing the depth values into several discrete regions, to create a higher contrast between several key parts of the hand. In addition, we suggest several ways to tackle the high variance problem in existing multimodal fusion CRNN architectures. We evaluate our method on two benchmarks: the DHG-14/28 dataset and the SHREC'17 track dataset. Our approach shows a significant improvement in accuracy and parameter efficiency over previous similar multimodal methods, with a comparable result to the state-of-the-art.
△ Less
Submitted 5 November, 2021; v1 submitted 6 July, 2021;
originally announced July 2021.
-
Computing and Memory Technologies based on Magnetic Skyrmions
Authors:
Hamed Vakili,
Wei Zhou,
Chung T Ma,
Md Golam Morshed,
Mohammad Nazmus Sakib,
Tim Hartnett,
Jun-Wen Xu,
Samiran Ganguly,
Kai Litzius,
Yassine Quessab,
Prasanna Balachandran,
Mircea Stan,
S J Poon,
Andrew D. Kent,
Geoffrey Beach,
Avik W. Ghosh
Abstract:
Solitonic magnetic excitations such as domain walls and, specifically, skyrmionics enable the possibility of compact, high density, ultrafast,all-electronic, low-energy devices, which is the basis for the emerging area of skyrmionics. The topological winding of skyrmion spins affects their overall lifetime, energetics and dynamical behavior. In this review, we discuss skyrmionics in the context of…
▽ More
Solitonic magnetic excitations such as domain walls and, specifically, skyrmionics enable the possibility of compact, high density, ultrafast,all-electronic, low-energy devices, which is the basis for the emerging area of skyrmionics. The topological winding of skyrmion spins affects their overall lifetime, energetics and dynamical behavior. In this review, we discuss skyrmionics in the context of the present day solid state memory landscape, and show how their size, stability and mobility can be controlled by material engineering, as well as how they can be nucleated and detected. Ferrimagnetsnear their compensation points are important candidates for this application, leading to detailed exploration of amorphous CoGd as well as the study of emergent materials such as Mn$_4$N and Inverse Heusler alloys. Along with material properties, geometrical parameters such as film thickness, defect density and notches can be used to tune skyrmion properties, such as their size and stability. Topology, however, can be a double-edged sword, especially for isolated metastable skyrmions, as it brings stability at the cost of additional dam** and deflective Magnus forces compared to domain walls. Skyrmion deformation in response to forces also makes them intrinsically slower than domain walls. We explore potential analog applications of skyrmions, including temporal memory at low density, and decorrelator for stochastic computing at a higher density that capitalizes on their interactions. We summarize the main challenges to achieve a skyrmionics technology, including maintaining positional stability with very high accuracy, electrical readout, especially for small ferrimagnetic skyrmions, deterministic nucleation and annihilation, and overall integration with digital circuits with the associated circuit overhead.
△ Less
Submitted 3 June, 2021; v1 submitted 25 January, 2021;
originally announced January 2021.
-
Tuning Dzyaloshinskii-Moriya Interaction in Ferrimagnetic GdCo: A First Principles Approach
Authors:
Md Golam Morshed,
Khoong Hong Khoo,
Yassine Quessab,
Jun-Wen Xu,
Robert Laskowski,
Prasanna V. Balachandran,
Andrew D. Kent,
Avik W. Ghosh
Abstract:
We present a systematic analysis of our ability to tune chiral Dzyaloshinskii-Moriya Interactions (DMI) in compensated ferrimagnetic Pt/GdCo/Pt1-xWx trilayers by cap layer composition. Using first principles calculations, we show that the DMI increases rapidly for only ~ 10% W and saturates thereafter, in agreement with experiments. The calculated DMI shows a spread in values around the experiment…
▽ More
We present a systematic analysis of our ability to tune chiral Dzyaloshinskii-Moriya Interactions (DMI) in compensated ferrimagnetic Pt/GdCo/Pt1-xWx trilayers by cap layer composition. Using first principles calculations, we show that the DMI increases rapidly for only ~ 10% W and saturates thereafter, in agreement with experiments. The calculated DMI shows a spread in values around the experimental mean, depending on the atomic configuration of the cap layer interface. The saturation is attributed to the vanishing of spin orbit coupling energy at the cap layer and the simultaneous constancy at the bottom interface. Additionally, we predict the DMI in Pt/GdCo/X (X=Ta, W, Ir) and find that W in the cap layer favors a higher DMI than Ta and Ir that can be attributed to the difference in d-band alignment around the Fermi level. Our results open up exciting combinatorial possibilities for controlling the DMI in ferrimagnets towards nucleating and manipulating ultrasmall high-speed skyrmions.
△ Less
Submitted 9 January, 2021;
originally announced January 2021.
-
Stochastic Steepest Descent Methods for Linear Systems: Greedy Sampling & Momentum
Authors:
Md Sarowar Morshed,
Sabbir Ahmad,
Md Noor-E-Alam
Abstract:
Recently proposed adaptive Sketch & Project (SP) methods connect several well-known projection methods such as Randomized Kaczmarz (RK), Randomized Block Kaczmarz (RBK), Motzkin Relaxation (MR), Randomized Coordinate Descent (RCD), Capped Coordinate Descent (CCD), etc. into one framework for solving linear systems. In this work, we first propose a Stochastic Steepest Descent (SSD) framework that c…
▽ More
Recently proposed adaptive Sketch & Project (SP) methods connect several well-known projection methods such as Randomized Kaczmarz (RK), Randomized Block Kaczmarz (RBK), Motzkin Relaxation (MR), Randomized Coordinate Descent (RCD), Capped Coordinate Descent (CCD), etc. into one framework for solving linear systems. In this work, we first propose a Stochastic Steepest Descent (SSD) framework that connects SP methods with the well-known Steepest Descent (SD) method for solving positive-definite linear system of equations. We then introduce two greedy sampling strategies in the SSD framework that allow us to obtain algorithms such as Sampling Kaczmarz Motzkin (SKM), Sampling Block Kaczmarz (SBK), Sampling Coordinate Descent (SCD), etc. In doing so, we generalize the existing sampling rules into one framework and develop an efficient version of SP methods. Furthermore, we incorporated the Polyak momentum technique into the SSD method to accelerate the resulting algorithms. We provide global convergence results for both the SSD method and the momentum induced SSD method. Moreover, we prove $\mathcal{O}(\frac{1}{k})$ convergence rate for the Cesaro average of iterates generated by both methods. By varying parameters in the SSD method, we obtain classical convergence results of the SD method as well as the SP methods as special cases. We design computational experiments to demonstrate the performance of the proposed greedy sampling methods as well as the momentum methods. The proposed greedy methods significantly outperform the existing methods for a wide variety of datasets such as random test instances as well as real-world datasets (LIBSVM, sparse datasets from matrix market collection). Finally, the momentum algorithms designed in this work accelerate the algorithmic performance of the SSD methods.
△ Less
Submitted 23 December, 2020;
originally announced December 2020.
-
A Computational Framework for Solving Nonlinear Binary OptimizationProblems in Robust Causal Inference
Authors:
Md Saiful Islam,
Md Sarowar Morshed,
Md. Noor-E-Alam
Abstract:
Identifying cause-effect relations among variables is a key step in the decision-making process. While causal inference requires randomized experiments, researchers and policymakers are increasingly using observational studies to test causal hypotheses due to the wide availability of observational data and the infeasibility of experiments. The matching method is the most used technique to make cau…
▽ More
Identifying cause-effect relations among variables is a key step in the decision-making process. While causal inference requires randomized experiments, researchers and policymakers are increasingly using observational studies to test causal hypotheses due to the wide availability of observational data and the infeasibility of experiments. The matching method is the most used technique to make causal inference from observational data. However, the pair assignment process in one-to-one matching creates uncertainty in the inference because of different choices made by the experimenter. Recently, discrete optimization models are proposed to tackle such uncertainty. Although a robust inference is possible with discrete optimization models, they produce nonlinear problems and lack scalability. In this work, we propose greedy algorithms to solve the robust causal inference test instances from observational data with continuous outcomes. We propose a unique framework to reformulate the nonlinear binary optimization problems as feasibility problems. By leveraging the structure of the feasibility formulation, we develop greedy schemes that are efficient in solving robust test problems. In many cases, the proposed algorithms achieve global optimal solutions. We perform experiments on three real-world datasets to demonstrate the effectiveness of the proposed algorithms and compare our result with the state-of-the-art solver. Our experiments show that the proposed algorithms significantly outperform the exact method in terms of computation time while achieving the same conclusion for causal tests. Both numerical experiments and complexity analysis demonstrate that the proposed algorithms ensure the scalability required for harnessing the power of big data in the decision-making process.
△ Less
Submitted 19 November, 2021; v1 submitted 22 December, 2020;
originally announced December 2020.
-
Sketch & Project Methods for Linear Feasibility Problems: Greedy Sampling & Momentum
Authors:
Md Sarowar Morshed,
Md. Noor-E-Alam
Abstract:
We develop two greedy sampling rules for the Sketch & Project method for solving linear feasibility problems. The proposed greedy sampling rules generalize the existing max-distance sampling rule and uniform sampling rule and generate faster variants of Sketch & Project methods. We also introduce greedy capped sampling rules that improve the existing capped sampling rules. Moreover, we incorporate…
▽ More
We develop two greedy sampling rules for the Sketch & Project method for solving linear feasibility problems. The proposed greedy sampling rules generalize the existing max-distance sampling rule and uniform sampling rule and generate faster variants of Sketch & Project methods. We also introduce greedy capped sampling rules that improve the existing capped sampling rules. Moreover, we incorporate the so-called heavy ball momentum technique to the proposed greedy Sketch & Project method. By varying the parameters such as sampling rules, sketching vectors; we recover several well-known algorithms as special cases, including Randomized Kaczmarz (RK), Motzkin Relaxation (MR), Sampling Kaczmarz Motzkin (SKM). We also obtain several new methods such as Randomized Coordinate Descent, Sampling Coordinate Descent, Capped Coordinate Descent, etc. for solving linear feasibility problems. We provide global linear convergence results for both the basic greedy method and the greedy method with momentum. Under weaker conditions, we prove $\mathcal{O}(\frac{1}{k})$ convergence rate for the Cesaro average of sequences generated by both methods. We extend the so-called certificate of feasibility result for the proposed momentum method that generalizes several existing results. To back up the proposed theoretical results, we carry out comprehensive numerical experiments on randomly generated test instances as well as sparse real-world test instances. The proposed greedy sampling methods significantly outperform the existing sampling methods. And finally, the momentum variants designed in this work extend the computational performance of the Sketch & Project methods for all of the sampling rules.
△ Less
Submitted 4 December, 2020;
originally announced December 2020.
-
Heavy Ball Momentum Induced Sampling Kaczmarz Motzkin Methods for Linear Feasibility Problems
Authors:
Md Sarowar Morshed,
Md. Noor-E-Alam
Abstract:
The recently proposed Sampling Kaczmarz Motzkin (SKM) algorithm performs well in comparison with the state-of-the-art methods in solving large-scale Linear Feasibility (LF) problems. To explore the concept of momentum in the context of solving LF problems, in this work, we propose a momentum induced algorithm called Momentum Sampling Kaczmarz Motzkin (MSKM). The MSKM algorithm is developed by inte…
▽ More
The recently proposed Sampling Kaczmarz Motzkin (SKM) algorithm performs well in comparison with the state-of-the-art methods in solving large-scale Linear Feasibility (LF) problems. To explore the concept of momentum in the context of solving LF problems, in this work, we propose a momentum induced algorithm called Momentum Sampling Kaczmarz Motzkin (MSKM). The MSKM algorithm is developed by integrating the heavy ball momentum to the SKM algorithm. We provide a rigorous convergence analysis of the proposed MSKM algorithm from which we obtain convergence results of several Kaczmarz type methods for solving LF problems. Moreover, under somewhat weaker conditions, we establish a sub-linear convergence rate for the so-called Cesaro average of the sequence generated by the MSKM algorithm. We then back up the theoretical results via thorough numerical experiments on artificial and real datasets. For a fair comparison, we test our proposed method in comparison with the SKM method on a wide variety of test instances: 1) randomly generated instances, 2) Netlib LPs and 3) linear classification test instances. We also compare the proposed method with the traditional Interior Point Method (IPM) and Active Set Method (ASM) on Netlib LPs. The proposed momentum induced algorithm significantly outperforms the basic SKM method (with no momentum) on all of the considered test instances. Furthermore, the proposed algorithm also performs well in comparison with IPM and ASM algorithms. Finally, we propose a stochastic version of the MSKM algorithm called Stochastic-Momentum Sampling Kaczmarz Motzkin (SSKM) to better handle large-scale real-world data. We conclude our work with a rigorous theoretical convergence analysis of the proposed SSKM algorithm.
△ Less
Submitted 4 December, 2020; v1 submitted 15 September, 2020;
originally announced September 2020.
-
mHealth Strategy to Fight Tuberculosis in Bangladesh
Authors:
Md Monzur Morshed
Abstract:
Bangladesh is one of the high TB burden countries in the world and TB is still a major public health problem in the country. To eradicate TB in Bangladesh and to ensure proper monitoring and better health care service, digital interventions may play a pivotal role. Over the years Bangladesh Government has been actively working to hold a control over TB with the help of donors, local and internatio…
▽ More
Bangladesh is one of the high TB burden countries in the world and TB is still a major public health problem in the country. To eradicate TB in Bangladesh and to ensure proper monitoring and better health care service, digital interventions may play a pivotal role. Over the years Bangladesh Government has been actively working to hold a control over TB with the help of donors, local and international NGOs. For sustainability there has been a need to develop mHealth strategy for Bangladesh to align with the Digital Bangladesh Vision 2021.
△ Less
Submitted 15 July, 2020;
originally announced August 2020.
-
Leveraging WiFi Network Logs to Infer Student Collocation and its Relationship with Academic Performance
Authors:
V. Das Swain,
H. Kwon,
S. Sargolzaei,
B. Saket,
M. Bin Morshed,
K. Tran,
D. Patel,
Y. Tian,
J. Philipose,
Y. Cui,
T. Plötz,
M. De Choudhury,
G. D. Abowd
Abstract:
A comprehensive understanding of collocation can help understand performance outcomes. For university cohorts, this needs data that describes large groups over a long period. Harnessing user devices to infer this, while tempting, is challenged by privacy concerns, power consumption, and maintenance issues. Alternatively, embedding new sensors in the environment is limited by the expense of coverin…
▽ More
A comprehensive understanding of collocation can help understand performance outcomes. For university cohorts, this needs data that describes large groups over a long period. Harnessing user devices to infer this, while tempting, is challenged by privacy concerns, power consumption, and maintenance issues. Alternatively, embedding new sensors in the environment is limited by the expense of covering the entire campus. We investigate the feasibility of leveraging WiFi association logs for this purpose. While these provide coarse approximations of location, these are easily obtainable and depict multiple users on campus over a semester. We explore how these coarse collocations are related to individual performance. Specifically, we inspect the association between individual performance and the collocation behaviors of project group members. We study 163 students (in 54 project groups) over 14 weeks. After describing how we determine collocation with the WiFi logs, we present a study to analyze how collocation within groups relates to a student's final score. We find collocation behaviors show a significant correlation (Pearson's r = 0.24) with performance -- better than both peer feedback or individual behaviors like attendance. Finally, we discuss how repurposing WiFi logs can facilitate applications for domains like mental wellbeing and physical health.
△ Less
Submitted 5 May, 2021; v1 submitted 22 May, 2020;
originally announced May 2020.
-
Sampling Kaczmarz Motzkin Method for Linear Feasibility Problems: Generalization & Acceleration
Authors:
Md Sarowar Morshed,
Md Saiful Islam,
Md. Noor-E-Alam
Abstract:
Randomized Kaczmarz (RK), Motzkin Method (MM) and Sampling Kaczmarz Motzkin (SKM) algorithms are commonly used iterative techniques for solving a system of linear inequalities (i.e., $Ax \leq b$). As linear systems of equations represent a modeling paradigm for solving many optimization problems, these randomized and iterative techniques are gaining popularity among researchers in different domain…
▽ More
Randomized Kaczmarz (RK), Motzkin Method (MM) and Sampling Kaczmarz Motzkin (SKM) algorithms are commonly used iterative techniques for solving a system of linear inequalities (i.e., $Ax \leq b$). As linear systems of equations represent a modeling paradigm for solving many optimization problems, these randomized and iterative techniques are gaining popularity among researchers in different domains. In this work, we propose a Generalized Sampling Kaczmarz Motzkin (GSKM) method that unifies the iterative methods into a single framework. In addition to the general framework, we propose a Nesterov type acceleration scheme in the SKM method called as Probably Accelerated Sampling Kaczmarz Motzkin (PASKM). We prove the convergence theorems for both GSKM and PASKM algorithms in the $L_2$ norm perspective with respect to the proposed sampling distribution. Furthermore, we prove sub-linear convergence for the Cesaro average of iterates for the proposed GSKM and PASKM algorithms.From the convergence theorem of the GSKM algorithm, we find the convergence results of several well-known algorithms like the Kaczmarz method, Motzkin method and SKM algorithm. We perform thorough numerical experiments using both randomly generated and real-world (classification with support vector machine and Netlib LP) test instances to demonstrate the efficiency of the proposed methods. We compare the proposed algorithms with SKM, Interior Point Method (IPM) and Active Set Method (ASM) in terms of computation time and solution quality. In the majority of the problem instances, the proposed generalized and accelerated algorithms significantly outperform the state-of-the-art methods.
△ Less
Submitted 4 December, 2020; v1 submitted 17 February, 2020;
originally announced February 2020.
-
Logarithmic Integrals: A Review from Gradshteyn and Ryzhik to Recent Times
Authors:
Md Sarowar Morshed
Abstract:
The need to evaluate Logarithmic integrals is ubiquitous in essentially all quantitative areas including mathematical sciences, physical sciences. Some recent developments in Physics namely Feynman diagrams deals with the evaluation of complicated integrals involving logarithmic functions. This work deals with a systematic review of logarithmic integrals starting from Malmsten integrals to classic…
▽ More
The need to evaluate Logarithmic integrals is ubiquitous in essentially all quantitative areas including mathematical sciences, physical sciences. Some recent developments in Physics namely Feynman diagrams deals with the evaluation of complicated integrals involving logarithmic functions. This work deals with a systematic review of logarithmic integrals starting from Malmsten integrals to classical collection of Integrals, Series and Products by I. S. Gradshteyn and I. M. Ryzhik [1] to recent times. The evaluation of these types of integrals involves higher transcendental functions (i.e., Hurwitz Zeta function, Polylogarithms, Lerch Transcendental, Orthogonal Polynomials, PolyGamma functions). In a more general sense the following types of integrals are considered for this work: \begin{align*}
\int_{0}^{a} f(x) \ln{\{g(x)\}} \ dx \end{align*} with $a \in R^{+}$ , $f(x)$ and $g(x)$ both either rational/trigonometric or both type of functions.
△ Less
Submitted 8 February, 2020;
originally announced February 2020.
-
Community Detection in Social Network using Temporal Data
Authors:
Victor Stany Rozario,
A. Z. M. Ehtesham Chowdhury,
Muhammad Sarwar Jahan Morshed
Abstract:
Social networks facilitate the social space where actors or the users have ties among them. The ties and their patterns are based on their life styles and communication. Similarly, in online social media networks like Facebook, Twitter, Myspace etc., multiple users belong to multiple specific communities. The social network represents large real-world directed social graphs. Detection of communiti…
▽ More
Social networks facilitate the social space where actors or the users have ties among them. The ties and their patterns are based on their life styles and communication. Similarly, in online social media networks like Facebook, Twitter, Myspace etc., multiple users belong to multiple specific communities. The social network represents large real-world directed social graphs. Detection of communities or clusters from these graphs is a problem of considerable research interest. The communities are formed using the neighboring nodes that have common edges and common attributes. Most of the existing community detection algorithms usually consider node contents to analyze the attributes of community. Some algorithms use the links between the nodes to determine the dense regions in the graph. But utilizing both the edge content and the vertex content to detect community are yet to be considered and verified, since the traditional extraction methods of vertex and edge data do not consider the connectivity among the nodes. This paper presents an Interlinked Spatial Clustering Model (ILSCM) which provides relevant content selection and extraction of the temporal topics for identifying the betweenness among the nodes based on the context keys to detect community.
△ Less
Submitted 10 April, 2019;
originally announced April 2019.
-
Robust policy evaluation from large-scale observational studies
Authors:
Md Saiful Islam,
Md Sarowar Morshed,
Gary J. Young,
Md. Noor-E-Alam
Abstract:
Under current policy decision making paradigm, we make or evaluate a policy decision by intervening different socio-economic parameters and analyzing the impact of those interventions. This process involves identifying the causal relation between interventions and outcomes. Matching method is one of the popular techniques to identify such causal relations. However, in one-to-one matching, when a t…
▽ More
Under current policy decision making paradigm, we make or evaluate a policy decision by intervening different socio-economic parameters and analyzing the impact of those interventions. This process involves identifying the causal relation between interventions and outcomes. Matching method is one of the popular techniques to identify such causal relations. However, in one-to-one matching, when a treatment or control unit has multiple pair assignment options with similar match quality, different matching algorithms often assign different pairs. Since, all the matching algorithms assign pair without considering the outcomes, it is possible that with same data and same hypothesis, different experimenters can make different conclusions. This problem becomes more prominent in case of large-scale observational studies. Recently, a robust approach is proposed to tackle the uncertainty which uses discrete optimization techniques to explore all possible assignments. Though optimization techniques are very efficient in its own way, they are not scalable to big data. In this work, we consider causal inference testing with binary outcomes and propose computationally efficient algorithms that are scalable to large-scale observational studies. By leveraging the structure of the optimization model, we propose a robustness condition which further reduces the computational burden. We validate the efficiency of the proposed algorithms by testing the causal relation between Hospital Readmission Reduction Program (HRRP) and readmission to different hospital (non-index readmission) on the State of California Patient Discharge Database from 2010 to 2014. Our result shows that HRRP has a causal relation with the increase in non-index readmission and the proposed algorithms proved to be highly scalable in testing causal relations from large-scale observational studies.
△ Less
Submitted 3 April, 2019;
originally announced April 2019.
-
Accelerated Sampling Kaczmarz Motzkin Algorithm for The Linear Feasibility Problem
Authors:
Md Sarowar Morshed,
Md Saiful Islam,
Md. Noor-E-Alam
Abstract:
The Sampling Kaczmarz Motzkin (SKM) algorithm is a generalized method for solving large scale linear systems of inequalities. Having its root in the relaxation method of Agmon, Schoenberg, and Motzkin and the randomized Kaczmarz method, SKM outperforms the state of the art methods in solving large-scale Linear Feasibility (LF) problems. Motivated by SKM's success, in this work, we propose an Accel…
▽ More
The Sampling Kaczmarz Motzkin (SKM) algorithm is a generalized method for solving large scale linear systems of inequalities. Having its root in the relaxation method of Agmon, Schoenberg, and Motzkin and the randomized Kaczmarz method, SKM outperforms the state of the art methods in solving large-scale Linear Feasibility (LF) problems. Motivated by SKM's success, in this work, we propose an Accelerated Sampling Kaczmarz Motzkin (ASKM) algorithm which achieves better convergence compared to the standard SKM algorithm on ill conditioned problems. We provide a thorough convergence analysis for the proposed accelerated algorithm and validate the results with various numerical experiments. We compare the performance and effectiveness of ASKM algorithm with SKM, Interior Point Method (IPM) and Active Set Method (ASM) on randomly generated instances as well as Netlib LPs. In most of the test instances, the proposed ASKM algorithm outperforms the other state of the art methods.
△ Less
Submitted 5 November, 2019; v1 submitted 9 February, 2019;
originally announced February 2019.
-
A Distance Measuring Algorithm for Location Analysis
Authors:
Ruilin Ouyang,
Dinghao Ma,
M. S. Morshed,
Md. Noor-E-Alam
Abstract:
Approximating distance is one of the key challenge in a facility location problem. Several algorithms have been proposed, however, none of them focused on estimating distance between two concave regions. In this work, we present an algorithm to estimate the distance between two irregular regions of a facility location problem. The proposed algorithm can identify the distance between concave shape…
▽ More
Approximating distance is one of the key challenge in a facility location problem. Several algorithms have been proposed, however, none of them focused on estimating distance between two concave regions. In this work, we present an algorithm to estimate the distance between two irregular regions of a facility location problem. The proposed algorithm can identify the distance between concave shape regions. We also discuss some relevant properties of the proposed algorithm. A distance-sensitive capacity location model is introduced to test the algorithm. Moreover, sSeveral special geometric cases are discussed to show the advantages and insights of the algorithm.
△ Less
Submitted 11 June, 2018;
originally announced June 2018.
-
A Primal-Dual Interior Point Method for a Novel Type-2 Second Order Cone Optimization Problem
Authors:
Md Sarowar Morshed,
Chrysafis Vogiatzis,
Md. Noor-E-Alam
Abstract:
In this paper, we define a new, special second order cone as a type-$k$ second order cone. We focus on the case of $k=2$, which can be viewed as SOCO with an additional {\em complicating variable}. For this new problem, we develop the necessary prerequisites, based on previous work for traditional SOCO. We then develop a primal-dual interior point algorithm for solving a type-2 second order conic…
▽ More
In this paper, we define a new, special second order cone as a type-$k$ second order cone. We focus on the case of $k=2$, which can be viewed as SOCO with an additional {\em complicating variable}. For this new problem, we develop the necessary prerequisites, based on previous work for traditional SOCO. We then develop a primal-dual interior point algorithm for solving a type-2 second order conic optimization (SOCO) problem, based on a family of kernel functions suitable for this type-2 SOCO. We finally derive the following iteration bound for our framework: \[\frac{L^γ}{θκγ} \left[2N ψ\left( \frac{\varrho \left(τ/4N\right)}{\sqrt{1-θ}}\right)\right]^γ\log \frac{3N}ε.\]
△ Less
Submitted 17 December, 2019; v1 submitted 1 May, 2018;
originally announced May 2018.
-
Generalized Affine Scaling Algorithms for Linear Programming Problems
Authors:
Md Sarowar Morshed,
Md. Noor-E-Alam
Abstract:
Interior Point Methods are widely used to solve Linear Programming problems. In this work, we present two primal affine scaling algorithms to achieve faster convergence in solving Linear Programming problems. In the first algorithm, we integrate Nesterov's restarting strategy in the primal affine scaling method with an extra parameter, which in turn generalizes the original primal affine scaling m…
▽ More
Interior Point Methods are widely used to solve Linear Programming problems. In this work, we present two primal affine scaling algorithms to achieve faster convergence in solving Linear Programming problems. In the first algorithm, we integrate Nesterov's restarting strategy in the primal affine scaling method with an extra parameter, which in turn generalizes the original primal affine scaling method. We provide the proof of convergence for the proposed generalized algorithm considering long step size. We also provide the proof of convergence for the primal and dual sequence without the degeneracy assumption. This convergence result generalizes the original convergence result for the affine scaling methods and it gives us hints about the existence of a new family of methods. Then, we introduce a second algorithm to accelerate the convergence rate of the generalized algorithm by integrating a non-linear series transformation technique. Our numerical results show that the proposed algorithms outperform the original primal affine scaling method.
△ Less
Submitted 12 October, 2019; v1 submitted 19 April, 2018;
originally announced April 2018.
-
A Literature Review of Code Clone Analysis to Improve Software Maintenance Process
Authors:
Md. Monzur Morshed,
Md. Arifur Rahman,
Salah Uddin Ahmed
Abstract:
Software systems are getting more complex as the system grows where maintaining such system is a primary concern for the industry. Code clone is one of the factors making software maintenance more difficult. It is a process of replicating code blocks by copy-and-paste that is common in software development. In the beginning stage of the project, developers find it easy and time consuming though it…
▽ More
Software systems are getting more complex as the system grows where maintaining such system is a primary concern for the industry. Code clone is one of the factors making software maintenance more difficult. It is a process of replicating code blocks by copy-and-paste that is common in software development. In the beginning stage of the project, developers find it easy and time consuming though it has crucial drawbacks in the long run. There are two types of researchers where some researchers think clones lead to additional changes during maintenance phase, in later stage increase the overall maintenance effort. On the other hand, some researchers think that cloned codes are more stable than non cloned codes. In this study, we discussed Code Clones and different ideas, methods, clone detection tools, related research on code clone, case study.
△ Less
Submitted 25 May, 2012;
originally announced May 2012.
-
An Empirical Study of UDP (CBR) Packet Performance over AODV Single & Multi-Channel Parallel Transmission in MANET
Authors:
Md. Monzur Morshed,
Meftah Ur Rahman,
Md. Rafiqul Islam
Abstract:
Mobile Ad-hoc Network is a temporary network which is the cooperative engagement of a collection of standalone mobile nodes that are not connected to any external network. It is a decentralized network where mobile nodes can be easily deployed in almost any environment without sophisticated infrastructure support. An empirical study has been done for AODV routing protocol under single channel and…
▽ More
Mobile Ad-hoc Network is a temporary network which is the cooperative engagement of a collection of standalone mobile nodes that are not connected to any external network. It is a decentralized network where mobile nodes can be easily deployed in almost any environment without sophisticated infrastructure support. An empirical study has been done for AODV routing protocol under single channel and multi channel environment using the tool NS2. To compare the performance of AODV in the two environments, the simulation results have been analyzed by graphical manner and trace file based on QoS metrics such as throughput, packet drop, delay and jitter. The simulation result analysis verifies the AODV routing protocol performances for single channel and multi channel. After the analysis of the simulation scenario we suggest that use of Parallel MAC (P-MAC) may enhance the performance for multi channel.
△ Less
Submitted 29 September, 2011;
originally announced September 2011.
-
An Empirical Study on variants of TCP over AODV routing protocol in MANET
Authors:
Md. Monzur Morshed,
Meftah Ur Rahman,
Md. Rafiqul Islam
Abstract:
The cardinal concept of TCP development was to carry data within the network where network congestion plays a vital role to cause packet loss. On the other hand, there are several other reasons to lose packets in Mobile Ad Hoc Networks due to fading, interfaces, multi-path routing, malicious node, and black hole. Along with throughput, fairness of TCP protocols is important to establish a good com…
▽ More
The cardinal concept of TCP development was to carry data within the network where network congestion plays a vital role to cause packet loss. On the other hand, there are several other reasons to lose packets in Mobile Ad Hoc Networks due to fading, interfaces, multi-path routing, malicious node, and black hole. Along with throughput, fairness of TCP protocols is important to establish a good communication. In this paper, an empirical study has been done by simulation and analysis of TCP variations under AODV routing protocol. In our simulation, we studied multiple variations of TCP, such as Reno, New-Reno, Vegas, and Tahoe. The simulation work has been done in NS2 environment. Based on the analysis simulation result of we carried out our observations with respect to the behavior of AODV routing protocol for different TCP packets under several QoS metrics such as drop, throughput, delay, and jitter.
△ Less
Submitted 29 September, 2011; v1 submitted 5 September, 2011;
originally announced September 2011.
-
Towards Public Key Infrastructure less authentication in Session Initiation Protocol
Authors:
Abdullah Al Hasib,
Abdullah Azfar,
Md. Sarwar Morshed
Abstract:
The Session Initiation Protocol (SIP) has become the most predominant protocol for Voice over Internet Protocol (VoIP) signaling. Security of SIP is an important consideration for VoIP communication as the traffic is transmitted over the insecure IP network. And the authentication process in SIP ranges from pre-shared secret based solutions to Public Key Infrastructure (PKI) based solution. Howe…
▽ More
The Session Initiation Protocol (SIP) has become the most predominant protocol for Voice over Internet Protocol (VoIP) signaling. Security of SIP is an important consideration for VoIP communication as the traffic is transmitted over the insecure IP network. And the authentication process in SIP ranges from pre-shared secret based solutions to Public Key Infrastructure (PKI) based solution. However, due to the limitations in PKI based solutions, some PKI less authentications mechanisms are proposed. This paper aims to present an overview of different authentication methods used in or together with SIP. We start by highlighting the security issues in SIP in the context of VoIP communication. Then we illustrate the current activities regarding the SIP authentication mechanisms including the recent developments in the research community and standardization efforts within the Internet Engineering Task Force (IETF). Finally we analyze the security aspects of these approaches.
△ Less
Submitted 5 February, 2010;
originally announced February 2010.