-
Bayesian experimental design for head imaging by electrical impedance tomography
Authors:
N. Hyvönen,
A. Jääskeläinen,
R. Maity,
A. Vavilov
Abstract:
This work considers the optimization of electrode positions in head imaging by electrical impedance tomography. The study is motivated by maximizing the sensitivity of electrode measurements to conductivity changes when monitoring the condition of a stroke patient, which justifies adopting a linearized version of the complete electrode model as the forward model. The algorithm is based on finding…
▽ More
This work considers the optimization of electrode positions in head imaging by electrical impedance tomography. The study is motivated by maximizing the sensitivity of electrode measurements to conductivity changes when monitoring the condition of a stroke patient, which justifies adopting a linearized version of the complete electrode model as the forward model. The algorithm is based on finding a (locally) A-optimal measurement configuration via gradient descent with respect to the electrode positions. The efficient computation of the needed derivatives of the complete electrode model is one of the focal points. Two algorithms are introduced and numerically tested on a three-layer head model. The first one assumes a region of interest and a Gaussian prior for the conductivity in the brain, and it can be run offline, i.e., prior to taking any measurements. The second algorithm first computes a reconstruction of the conductivity anomaly caused by the stroke with an initial electrode configuration by combining lagged diffusivity iteration with sequential linearizations, which can be interpreted to produce an approximate Gaussian probability density for the conductivity perturbation. It then resorts to the first algorithm to find new, more informative positions for the available electrodes with the constructed density as the prior.
△ Less
Submitted 16 December, 2023;
originally announced December 2023.
-
A Comparative Study between Silicon Carbide and Silicon Nitride based Single Cell CMUT
Authors:
Rakesh Kanjilal,
Reshmi Maity
Abstract:
This research explores the design and conducts a comparative analysis of a noninsulated Capacitive Micromachined Ultrasonic Transducer (CMUT) featuring an innovative asymmetric electrode configuration to improve the performance of the device. Specifically, this configuration involves the utilization of a top electrode with a smaller radius in comparison to the bottom electrode. The study encompass…
▽ More
This research explores the design and conducts a comparative analysis of a noninsulated Capacitive Micromachined Ultrasonic Transducer (CMUT) featuring an innovative asymmetric electrode configuration to improve the performance of the device. Specifically, this configuration involves the utilization of a top electrode with a smaller radius in comparison to the bottom electrode. The study encompasses an investigation into the effects of varying biasing voltage within the range of 40 V to 100 V. The materials employed in this study are carefully selected to optimize the CMUT's performance. The substrate material is silicon, and the bottom and top electrodes are made from aluminium. Additionally, silicon dioxide is utilized as the foundation material within the device's structure.
△ Less
Submitted 26 October, 2023; v1 submitted 23 October, 2023;
originally announced October 2023.
-
External chemical gradient leads to efficient swimming of chiral swimmers
Authors:
Ruma Maity,
P. S. Burada
Abstract:
External gradients can strongly influence the collective behavior of microswimmers. In this paper, we study the behavior of two hydrodynamically interacting self-propelled chiral swimmers, in the low-Reynolds number regime, under the influence of an external linear chemical gradient. We use the generalized squirmer model called the chiral squirmer, a spherically shaped body with an asymmetric surf…
▽ More
External gradients can strongly influence the collective behavior of microswimmers. In this paper, we study the behavior of two hydrodynamically interacting self-propelled chiral swimmers, in the low-Reynolds number regime, under the influence of an external linear chemical gradient. We use the generalized squirmer model called the chiral squirmer, a spherically shaped body with an asymmetric surface slip velocity, to represent the swimmer. We find that the external gradient favors the attraction between the swimmers and, in some situations, leads to a bounded state in which the swimmers move in a highly synchronous manner. Further, due to this cooperative motion, swimmers efficiently reach the chemical target compared to the individual swimmers. This study may help to understand the collective behavior of chiral swimmers and to design synthetic microswimmers for targeted drug delivery.
△ Less
Submitted 3 January, 2023;
originally announced January 2023.
-
Near and far-field hydrodynamic interaction of two chiral squirmers
Authors:
Ruma Maity,
P. S. Burada
Abstract:
Hydrodynamic interaction strongly influences the collective behavior of the microswimmers. With this work, we study the behavior of two hydrodynamically interacting self-propelled chiral swimmers in the low Reynolds number regime, considering both the near and far-field interactions. We use the chiral squirmer model, a spherically shaped body with non-axisymmetric surface slip velocity, which gene…
▽ More
Hydrodynamic interaction strongly influences the collective behavior of the microswimmers. With this work, we study the behavior of two hydrodynamically interacting self-propelled chiral swimmers in the low Reynolds number regime, considering both the near and far-field interactions. We use the chiral squirmer model, a spherically shaped body with non-axisymmetric surface slip velocity, which generalizes the well-known squirmer model. We calculate the lubrication force between the swimmers when they are very close to each other. By varying the slip coefficients and the initial configuration of the swimmers, we investigate their hydrodynamic behavior. In the presence of lubrication force, the swimmers either repel each other or exhibit bounded motion where the distance between the swimmers alters periodically. The lubrication force favors the bounded motion in some parameter regime. This study is helpful to understand the collective behavior of dense suspension of ciliated microorganisms and artificial swimmers.
△ Less
Submitted 15 April, 2022;
originally announced April 2022.
-
Parameter dependent finite element analysis for ferronematics solutions
Authors:
Ruma Rani Maity,
Apala Majumdar,
Neela Nataraj
Abstract:
This paper focuses on the analysis of a free energy functional, that models a dilute suspension of magnetic nanoparticles in a two-dimensional nematic well. The {\it first part} of the article is devoted to the asymptotic analysis of global energy minimizers in the limit of vanishing elastic constant, $\ell \rightarrow 0$ where the re-scaled elastic constant $\ell$ is inversely proportional to the…
▽ More
This paper focuses on the analysis of a free energy functional, that models a dilute suspension of magnetic nanoparticles in a two-dimensional nematic well. The {\it first part} of the article is devoted to the asymptotic analysis of global energy minimizers in the limit of vanishing elastic constant, $\ell \rightarrow 0$ where the re-scaled elastic constant $\ell$ is inversely proportional to the domain area. The first results concern the strong $H^1$-convergence and a $\ell$-independent $H^2$-bound for the global minimizers on smooth bounded 2D domains, with smooth boundary and topologically trivial Dirichlet conditions. The {\it second part} focuses on the discrete approximation of regular solutions of the corresponding non-linear system of partial differential equations with cubic non-linearity and non-homogeneous Dirichlet boundary conditions. We establish (i) the existence and local uniqueness of the discrete solutions using fixed point argument, (ii) a best approximation result in energy norm, (iii) error estimates in the energy and $L^2$ norms with $\ell $- discretization parameter dependency for the conforming finite element method. Finally, the theoretical results are complemented by numerical experiments on the discrete solution profiles, the numerical convergence rates that corroborates the theoretical estimates, followed by plots that illustrate the dependence of the discretization parameter on $\ell$.
△ Less
Submitted 23 June, 2021;
originally announced June 2021.
-
Hydrodynamics of chiral squirmers
Authors:
P. S. Burada,
R. Maity,
F. Jülicher
Abstract:
Many microorganisms take a chiral path while swimming in an ambient uid. In this paper, we study the combined behavior of two chiral swimmers using the well-known squirmer model taking into account chiral asymmetries. In contrast to the simple squirmer model, which has an axisymmetric distribution of slip velocity, the chiral squirmer has additional asymmetries in the surface slip, which contribut…
▽ More
Many microorganisms take a chiral path while swimming in an ambient uid. In this paper, we study the combined behavior of two chiral swimmers using the well-known squirmer model taking into account chiral asymmetries. In contrast to the simple squirmer model, which has an axisymmetric distribution of slip velocity, the chiral squirmer has additional asymmetries in the surface slip, which contribute to both translations and rotations of the motion. As a result, swimming trajectories can become helical and chiral asymmetries arise in the ow patterns. We study the swimming trajectories of a pair of chiral squirmers that interact hydrodynamically. This interaction can lead to attraction and repulsion, and in some cases even to bounded states where the swimmers continue to periodically orbit around a common average trajectory. Such bound states are a signature of the chiral nature of the swimmers. Our study could be relevant to the collective movements of ciliated microorganisms.
△ Less
Submitted 3 June, 2021;
originally announced June 2021.
-
Unsteady chiral swimmer in presence of an external chemical gradient
Authors:
Ruma Maity,
P. S. Burada
Abstract:
Unsteadiness occurs in the low Reynolds number swimmers' motion while they start from rest or escape from a predator or attack prey. In this paper, we study an unsteady chiral swimmer's behavior, with a prescribed surface slip velocity, in the low Reynold number regime and its response to an external chemical gradient. Using the general solution of unsteady Stokes equation and appropriate boundary…
▽ More
Unsteadiness occurs in the low Reynolds number swimmers' motion while they start from rest or escape from a predator or attack prey. In this paper, we study an unsteady chiral swimmer's behavior, with a prescribed surface slip velocity, in the low Reynold number regime and its response to an external chemical gradient. Using the general solution of unsteady Stokes equation and appropriate boundary conditions, i.e., slip velocity at the body surface and the ambient velocity field at the far-field, we calculate the migration velocity, rotation rate, and the ow field of the swimmer in a closed-form. We compare the velocity with some previously known results in appropriate limits. The continuous unsteady motion of the swimmer affects its tactic movement. A relevant example of this situation is chemotaxis, where the presence of chemical stimulus alters the swimmer's surface slip velocity. As a result, the swimmer either steers towards the chemical target or moves away from it, depending on the system parameters. Here, the rotation rate controls the success of the chemotaxis. In addition to the successful and unsuccessful cases, we observe a unique orbiting state where the swimmer keeps revolving around the chemical target in diffusive orbits.
△ Less
Submitted 7 September, 2021; v1 submitted 31 May, 2021;
originally announced May 2021.
-
Esca** Saddle Points in Distributed Newton's Method with Communication Efficiency and Byzantine Resilience
Authors:
Avishek Ghosh,
Raj Kumar Maity,
Arya Mazumdar,
Kannan Ramchandran
Abstract:
The problem of saddle-point avoidance for non-convex optimization is quite challenging in large scale distributed learning frameworks, such as Federated Learning, especially in the presence of Byzantine workers. The celebrated cubic-regularized Newton method of \cite{nest} is one of the most elegant ways to avoid saddle-points in the standard centralized (non-distributed) setup. In this paper, we…
▽ More
The problem of saddle-point avoidance for non-convex optimization is quite challenging in large scale distributed learning frameworks, such as Federated Learning, especially in the presence of Byzantine workers. The celebrated cubic-regularized Newton method of \cite{nest} is one of the most elegant ways to avoid saddle-points in the standard centralized (non-distributed) setup. In this paper, we extend the cubic-regularized Newton method to a distributed framework and simultaneously address several practical challenges like communication bottleneck and Byzantine attacks. Note that the issue of saddle-point avoidance becomes more crucial in the presence of Byzantine machines since rogue machines may create \emph{fake local minima} near the saddle-points of the loss function, also known as the saddle-point attack. Being a second order algorithm, our iteration complexity is much lower than the first order counterparts. Furthermore we use compression (or sparsification) techniques like $δ$-approximate compression for communication efficiency. We obtain theoretical guarantees for our proposed scheme under several settings including approximate (sub-sampled) gradients and Hessians. Moreover, we validate our theoretical findings with experiments using standard datasets and several types of Byzantine attacks, and obtain an improvement of $25\%$ with respect to first order methods in iteration complexity.
△ Less
Submitted 25 December, 2021; v1 submitted 16 March, 2021;
originally announced March 2021.
-
Structural disorder and magnetic correlations driven by oxygen do** in Nd2NiO4+d (d ~ 0.11)
Authors:
Sumit Ranjan Maity,
Monica Ceretti,
Lukas Keller,
Jürg Schefer,
Tian Shang,
Ekaterina Pomjakushina,
Martin Meven,
Denis Sheptyakov,
Antonio Cervellino,
Werner Paulus
Abstract:
We investigated the influence of oxygen over-stoichiometry on apical oxygen disorder and magnetic correlations in Nd2NiO4+d (d~0.11) in the temperature range of 2-300 K by means of synchrotron x-ray powder diffraction, neutron single crystal and powder diffraction studies, combined with macroscopic magnetic measurements. In the investigated temperature range, the compound crystalizes in a tetragon…
▽ More
We investigated the influence of oxygen over-stoichiometry on apical oxygen disorder and magnetic correlations in Nd2NiO4+d (d~0.11) in the temperature range of 2-300 K by means of synchrotron x-ray powder diffraction, neutron single crystal and powder diffraction studies, combined with macroscopic magnetic measurements. In the investigated temperature range, the compound crystalizes in a tetragonal commensurate structure with the P42/ncm space group with excess oxygen atoms occupy the 4b (3/4 1/4 1/4) interstitial sites, coordinated by four apical oxygen atoms. Large and anisotropic thermal displacement parameters are found for equatorial and apical oxygen atoms, which are strongly reduced on an absolute scale compared to the Nd2NiO4.23 phase. Maximum Entropy analysis of the neutron single crystal diffraction data uncovered anharmonic contributions to the displacement parameters of the apical oxygen atoms, toward the nearest vacant 4b interstitial site, related to the phonon assisted oxygen diffusion mechanism. Macroscopic magnetization measurements and neutron powder diffraction studies reveal long-range antiferromagnetic ordering of the Ni-sublattice at TN ~ 53 K with a weak ferromagnetic component along the c-axis, while the long-range magnetic ordering of the Nd-sublattice occurs below 10 K. Temperature dependent neutron diffraction patterns show the appearance of a commensurate magnetic order at TN with the propagation vector k = (100) and the emergence of an additional incommensurate phase below 30 K, while both phases coexist at 2 K. The commensurate magnetic structure is best described by the P42/nc`m` Shubnikov space group. Refined magnetic moments of the Ni and Nd-sites at 2 K are 1.144(76) muB and 1.632(52) muB respectively. A possible origin of the incommensurate phase is discussed and a tentative magnetic phase diagram is proposed.
△ Less
Submitted 13 January, 2021;
originally announced January 2021.
-
Interdependent scaling of long-range oxygen and magnetic ordering in non-stoichiometric Nd${}_2$NiO${}_{4.10}$
Authors:
Sumit Ranjan Maity,
Monica Ceretti,
Lukas Keller,
Jürg Schefer,
Martin Meven,
Ekaterina Pomjakushina,
Werner Paulus
Abstract:
Hole do** in Nd${}_{2}$NiO${}_{4.00}$ can be either achieved by substituting the trivalent Nd atoms by bivalent alkaline earth metals or by oxygen do**, yielding Nd${}_{2}$NiO${}_{4+δ}$. In this study, we investigated the interplay between oxygen and spin ordering for a low oxygen do** concentration i.e. Nd${}_{2}$NiO${}_{4.10}$. Although the extra oxygen do** level remains rather modest w…
▽ More
Hole do** in Nd${}_{2}$NiO${}_{4.00}$ can be either achieved by substituting the trivalent Nd atoms by bivalent alkaline earth metals or by oxygen do**, yielding Nd${}_{2}$NiO${}_{4+δ}$. In this study, we investigated the interplay between oxygen and spin ordering for a low oxygen do** concentration i.e. Nd${}_{2}$NiO${}_{4.10}$. Although the extra oxygen do** level remains rather modest with only one out of 20 possible interstitial tetrahedral lattice sites occupied, we observed by single crystal neutron diffraction the presence of a complex 3D modulated structure related to oxygen ordering already at ambient, the modulation vectors being $\pm$2/13\textit{\textbf{a*}}$\pm$3/13\textit{\textbf{b*}}, $\pm$3/13\textit{\textbf{b*}}$\pm$2/13\textit{\textbf{b*}} and $\pm$1/5\textit{\textbf{a*}}$\pm$1/2\textit{\textbf{c*}} and satellite reflections up to fourth order. Temperature dependent neutron diffraction studies indicate the coexistence of oxygen and magnetic ordering below T${}_{N}$ $\simeq$ 48 K, the wave vector of the Ni sublattice being \textbf{\textit{k}}=(100). In addition, magnetic satellite reflections adapt exactly the same modulation vectors as found for the oxygen ordering, evidencing a unique coexistence of 3D modulated ordering for spin and oxygen ordering in Nd${}_{2}$NiO${}_{4.10}$. Temperature dependent measurements of magnetic intensities suggest two magnetic phase transitions below 48 K and 20 K, indicating two distinct onsets of magnetic ordering for the Ni and Nd sublattice, respectively.
△ Less
Submitted 12 January, 2021;
originally announced January 2021.
-
Estimation of Shortest Path Covariance Matrices
Authors:
Raj Kumar Maity,
Cameron Musco
Abstract:
We study the sample complexity of estimating the covariance matrix $\mathbfΣ \in \mathbb{R}^{d\times d}$ of a distribution $\mathcal D$ over $\mathbb{R}^d$ given independent samples, under the assumption that $\mathbfΣ$ is graph-structured. In particular, we focus on shortest path covariance matrices, where the covariance between any two measurements is determined by the shortest path distance in…
▽ More
We study the sample complexity of estimating the covariance matrix $\mathbfΣ \in \mathbb{R}^{d\times d}$ of a distribution $\mathcal D$ over $\mathbb{R}^d$ given independent samples, under the assumption that $\mathbfΣ$ is graph-structured. In particular, we focus on shortest path covariance matrices, where the covariance between any two measurements is determined by the shortest path distance in an underlying graph with $d$ nodes. Such matrices generalize Toeplitz and circulant covariance matrices and are widely applied in signal processing applications, where the covariance between two measurements depends on the (shortest path) distance between them in time or space.
We focus on minimizing both the vector sample complexity: the number of samples drawn from $\mathcal{D}$ and the entry sample complexity: the number of entries read in each sample. The entry sample complexity corresponds to measurement equipment costs in signal processing applications. We give a very simple algorithm for estimating $\mathbfΣ$ up to spectral norm error $ε\left\|\mathbfΣ\right\|_2$ using just $O(\sqrt{D})$ entry sample complexity and $\tilde O(r^2/ε^2)$ vector sample complexity, where $D$ is the diameter of the underlying graph and $r \le d$ is the rank of $\mathbfΣ$. Our method is based on extending the widely applied idea of sparse rulers for Toeplitz covariance estimation to the graph setting.
In the special case when $\mathbfΣ$ is a low-rank Toeplitz matrix, our result matches the state-of-the-art, with a far simpler proof. We also give an information theoretic lower bound matching our upper bound up to a factor $D$ and discuss some directions towards closing this gap.
△ Less
Submitted 19 November, 2020;
originally announced November 2020.
-
Distributed Newton Can Communicate Less and Resist Byzantine Workers
Authors:
Avishek Ghosh,
Raj Kumar Maity,
Arya Mazumdar
Abstract:
We develop a distributed second order optimization algorithm that is communication-efficient as well as robust against Byzantine failures of the worker machines. We propose COMRADE (COMunication-efficient and Robust Approximate Distributed nEwton), an iterative second order algorithm, where the worker machines communicate only once per iteration with the center machine. This is in sharp contrast w…
▽ More
We develop a distributed second order optimization algorithm that is communication-efficient as well as robust against Byzantine failures of the worker machines. We propose COMRADE (COMunication-efficient and Robust Approximate Distributed nEwton), an iterative second order algorithm, where the worker machines communicate only once per iteration with the center machine. This is in sharp contrast with the state-of-the-art distributed second order algorithms like GIANT [34] and DINGO[7], where the worker machines send (functions of) local gradient and Hessian sequentially; thus ending up communicating twice with the center machine per iteration. Moreover, we show that the worker machines can further compress the local information before sending it to the center. In addition, we employ a simple norm based thresholding rule to filter-out the Byzantine worker machines. We establish the linear-quadratic rate of convergence of COMRADE and establish that the communication savings and Byzantine resilience result in only a small statistical error rate for arbitrary convex loss functions. To the best of our knowledge, this is the first work that addresses the issue of Byzantine resilience in second order distributed optimization. Furthermore, we validate our theoretical results with extensive experiments on synthetic and benchmark LIBSVM [5] data-sets and demonstrate convergence guarantees.
△ Less
Submitted 15 June, 2020;
originally announced June 2020.
-
Error analysis of Nitsche's and discontinuous Galerkin methods of a reduced Landau-de Gennes problem
Authors:
Ruma Rani Maity,
Apala Majumdar,
Neela Nataraj
Abstract:
We study a system of semi-linear elliptic partial differential equations with a lower order cubic nonlinear term, and inhomogeneous Dirichlet boundary conditions, relevant for two-dimensional bistable liquid crystal devices, within a reduced Landau-de Gennes framework. The main results are (i) a priori error estimates for the energy norm, within the Nitsche's and discontinuous Galerkin frameworks…
▽ More
We study a system of semi-linear elliptic partial differential equations with a lower order cubic nonlinear term, and inhomogeneous Dirichlet boundary conditions, relevant for two-dimensional bistable liquid crystal devices, within a reduced Landau-de Gennes framework. The main results are (i) a priori error estimates for the energy norm, within the Nitsche's and discontinuous Galerkin frameworks under milder regularity assumptions on the exact solution and (ii) a reliable and efficient {\it a posteriori} analysis for a sufficiently large penalization parameter and a sufficiently fine triangulation in both cases. Numerical examples that validate the theoretical results, are presented separately.
△ Less
Submitted 15 December, 2020; v1 submitted 28 May, 2020;
originally announced May 2020.
-
Quantum Boosting
Authors:
Srinivasan Arunachalam,
Reevu Maity
Abstract:
Suppose we have a weak learning algorithm $\mathcal{A}$ for a Boolean-valued problem: $\mathcal{A}$ produces hypotheses whose bias $γ$ is small, only slightly better than random guessing (this could, for instance, be due to implementing $\mathcal{A}$ on a noisy device), can we boost the performance of $\mathcal{A}$ so that $\mathcal{A}$'s output is correct on $2/3$ of the inputs?
Boosting is a t…
▽ More
Suppose we have a weak learning algorithm $\mathcal{A}$ for a Boolean-valued problem: $\mathcal{A}$ produces hypotheses whose bias $γ$ is small, only slightly better than random guessing (this could, for instance, be due to implementing $\mathcal{A}$ on a noisy device), can we boost the performance of $\mathcal{A}$ so that $\mathcal{A}$'s output is correct on $2/3$ of the inputs?
Boosting is a technique that converts a weak and inaccurate machine learning algorithm into a strong accurate learning algorithm. The AdaBoost algorithm by Freund and Schapire (for which they were awarded the Gödel prize in 2003) is one of the widely used boosting algorithms, with many applications in theory and practice. Suppose we have a $γ$-weak learner for a Boolean concept class $C$ that takes time $R(C)$, then the time complexity of AdaBoost scales as $VC(C)\cdot poly(R(C), 1/γ)$, where $VC(C)$ is the $VC$-dimension of $C$. In this paper, we show how quantum techniques can improve the time complexity of classical AdaBoost. To this end, suppose we have a $γ$-weak quantum learner for a Boolean concept class $C$ that takes time $Q(C)$, we introduce a quantum boosting algorithm whose complexity scales as $\sqrt{VC(C)}\cdot poly(Q(C),1/γ);$ thereby achieving a quadratic quantum improvement over classical AdaBoost in terms of $VC(C)$.
△ Less
Submitted 14 August, 2020; v1 submitted 12 February, 2020;
originally announced February 2020.
-
A workload-adaptive mechanism for linear queries under local differential privacy
Authors:
Ryan McKenna,
Raj Kumar Maity,
Arya Mazumdar,
Gerome Miklau
Abstract:
We propose a new mechanism to accurately answer a user-provided set of linear counting queries under local differential privacy (LDP). Given a set of linear counting queries (the workload) our mechanism automatically adapts to provide accuracy on the workload queries. We define a parametric class of mechanisms that produce unbiased estimates of the workload, and formulate a constrained optimizatio…
▽ More
We propose a new mechanism to accurately answer a user-provided set of linear counting queries under local differential privacy (LDP). Given a set of linear counting queries (the workload) our mechanism automatically adapts to provide accuracy on the workload queries. We define a parametric class of mechanisms that produce unbiased estimates of the workload, and formulate a constrained optimization problem to select a mechanism from this class that minimizes expected total squared error. We solve this optimization problem numerically using projected gradient descent and provide an efficient implementation that scales to large workloads. We demonstrate the effectiveness of our optimization-based approach in a wide variety of settings, showing that it outperforms many competitors, even outperforming existing mechanisms on the workloads for which they were intended.
△ Less
Submitted 18 May, 2020; v1 submitted 4 February, 2020;
originally announced February 2020.
-
Learning Unitaries by Gradient Descent
Authors:
Bobak Toussi Kiani,
Seth Lloyd,
Reevu Maity
Abstract:
We study the hardness of learning unitary transformations in $U(d)$ via gradient descent on time parameters of alternating operator sequences. We provide numerical evidence that, despite the non-convex nature of the loss landscape, gradient descent always converges to the target unitary when the sequence contains $d^2$ or more parameters. Rates of convergence indicate a "computational phase transi…
▽ More
We study the hardness of learning unitary transformations in $U(d)$ via gradient descent on time parameters of alternating operator sequences. We provide numerical evidence that, despite the non-convex nature of the loss landscape, gradient descent always converges to the target unitary when the sequence contains $d^2$ or more parameters. Rates of convergence indicate a "computational phase transition." With less than $d^2$ parameters, gradient descent converges to a sub-optimal solution, whereas with more than $d^2$ parameters, gradient descent converges exponentially to an optimal solution.
△ Less
Submitted 18 February, 2020; v1 submitted 31 January, 2020;
originally announced January 2020.
-
Communication-Efficient and Byzantine-Robust Distributed Learning with Error Feedback
Authors:
Avishek Ghosh,
Raj Kumar Maity,
Swanand Kadhe,
Arya Mazumdar,
Kannan Ramchandran
Abstract:
We develop a communication-efficient distributed learning algorithm that is robust against Byzantine worker machines. We propose and analyze a distributed gradient-descent algorithm that performs a simple thresholding based on gradient norms to mitigate Byzantine failures. We show the (statistical) error-rate of our algorithm matches that of Yin et al.~\cite{dong}, which uses more complicated sche…
▽ More
We develop a communication-efficient distributed learning algorithm that is robust against Byzantine worker machines. We propose and analyze a distributed gradient-descent algorithm that performs a simple thresholding based on gradient norms to mitigate Byzantine failures. We show the (statistical) error-rate of our algorithm matches that of Yin et al.~\cite{dong}, which uses more complicated schemes (coordinate-wise median, trimmed mean). Furthermore, for communication efficiency, we consider a generic class of $δ$-approximate compressors from Karimireddi et al.~\cite{errorfeed} that encompasses sign-based compressors and top-$k$ sparsification. Our algorithm uses compressed gradients and gradient norms for aggregation and Byzantine removal respectively. We establish the statistical error rate for non-convex smooth loss functions. We show that, in certain range of the compression factor $δ$, the (order-wise) rate of convergence is not affected by the compression operation. Moreover, we analyze the compressed gradient descent algorithm with error feedback (proposed in \cite{errorfeed}) in a distributed setting and in the presence of Byzantine worker machines. We show that exploiting error feedback improves the statistical error rate. Finally, we experimentally validate our results and show good performance in convergence for convex (least-square regression) and non-convex (neural network training) problems.
△ Less
Submitted 14 August, 2021; v1 submitted 21 November, 2019;
originally announced November 2019.
-
vqSGD: Vector Quantized Stochastic Gradient Descent
Authors:
Venkata Gandikota,
Daniel Kane,
Raj Kumar Maity,
Arya Mazumdar
Abstract:
In this work, we present a family of vector quantization schemes \emph{vqSGD} (Vector-Quantized Stochastic Gradient Descent) that provide an asymptotic reduction in the communication cost with convergence guarantees in first-order distributed optimization. In the process we derive the following fundamental information theoretic fact: $Θ(\frac{d}{R^2})$ bits are necessary and sufficient to describe…
▽ More
In this work, we present a family of vector quantization schemes \emph{vqSGD} (Vector-Quantized Stochastic Gradient Descent) that provide an asymptotic reduction in the communication cost with convergence guarantees in first-order distributed optimization. In the process we derive the following fundamental information theoretic fact: $Θ(\frac{d}{R^2})$ bits are necessary and sufficient to describe an unbiased estimator ${\hat{g}}({g})$ for any ${g}$ in the $d$-dimensional unit sphere, under the constraint that $\|{\hat{g}}({g})\|_2\le R$ almost surely. In particular, we consider a randomized scheme based on the convex hull of a point set, that returns an unbiased estimator of a $d$-dimensional gradient vector with almost surely bounded norm. We provide multiple efficient instances of our scheme, that are near optimal, and require only $o(d)$ bits of communication at the expense of tolerable increase in error. The instances of our quantization scheme are obtained using the properties of binary error-correcting codes and provide a smooth tradeoff between the communication and the estimation error of quantization. Furthermore, we show that \emph{vqSGD} also offers strong privacy guarantees.
△ Less
Submitted 24 December, 2020; v1 submitted 18 November, 2019;
originally announced November 2019.
-
Discontinuous Galerkin Finite Element Methods for the Landau-de Gennes Minimization Problem of Liquid Crystals
Authors:
Ruma Rani Maity,
Apala Majumdar,
Neela Nataraj
Abstract:
We consider a system of second order non-linear elliptic partial differential equations that models the equilibrium configurations of a two dimensional planar bistable nematic liquid crystal device. Discontinuous Galerkin finite element methods are used to approximate the solutions of this nonlinear problem with non-homogeneous Dirichlet boundary conditions. A discrete inf-sup condition demonstrat…
▽ More
We consider a system of second order non-linear elliptic partial differential equations that models the equilibrium configurations of a two dimensional planar bistable nematic liquid crystal device. Discontinuous Galerkin finite element methods are used to approximate the solutions of this nonlinear problem with non-homogeneous Dirichlet boundary conditions. A discrete inf-sup condition demonstrates the stability of the discontinuous Galerkin discretization of a well-posed linear problem. We then establish the existence and local uniqueness of the discrete solution of the non-linear problem. An a priori error estimate in the energy norm is derived and a best approximation property is demonstrated. Further, we prove the quadratic convergence of Newton's iterates along with complementary numerical experiments.
△ Less
Submitted 28 May, 2020; v1 submitted 16 July, 2019;
originally announced July 2019.
-
Efficient implementation of unitary transformations
Authors:
Seth Lloyd,
Reevu Maity
Abstract:
Quantum computation and quantum control operate by building unitary transformations out of sequences of elementary quantum logic operations or applications of control fields. This paper puts upper bounds on the minimum time required to implement a desired unitary transformation on a d-dimensional Hilbert space when applying sequences of Hamiltonian transformations. We show that strategies of build…
▽ More
Quantum computation and quantum control operate by building unitary transformations out of sequences of elementary quantum logic operations or applications of control fields. This paper puts upper bounds on the minimum time required to implement a desired unitary transformation on a d-dimensional Hilbert space when applying sequences of Hamiltonian transformations. We show that strategies of building up a desired unitary out of non-infinitesimal and infinitesimal unitaries, or equivalently, using power and band limited controls, can yield the best possible scaling in time $O(d^2)$.
△ Less
Submitted 10 January, 2019;
originally announced January 2019.
-
High Dimensional Discrete Integration over the Hypergrid
Authors:
Raj Kumar Maity,
Arya Mazumdar,
Soumyabrata Pal
Abstract:
Recently Ermon et al. (2013) pioneered a way to practically compute approximations to large scale counting or discrete integration problems by using random hashes. The hashes are used to reduce the counting problem into many separate discrete optimization problems. The optimization problems then can be solved by an NP-oracle such as commercial SAT solvers or integer linear programming (ILP) solver…
▽ More
Recently Ermon et al. (2013) pioneered a way to practically compute approximations to large scale counting or discrete integration problems by using random hashes. The hashes are used to reduce the counting problem into many separate discrete optimization problems. The optimization problems then can be solved by an NP-oracle such as commercial SAT solvers or integer linear programming (ILP) solvers. In particular, Ermon et al. showed that if the domain of integration is $\{0,1\}^n$ then it is possible to obtain a solution within a factor of $16$ of the optimal (a 16-approximation) by this technique.
In many crucial counting tasks, such as computation of partition function of ferromagnetic Potts model, the domain of integration is naturally $\{0,1,\dots, q-1\}^n, q>2$, the hypergrid. The straightforward extension of Ermon et al.'s method allows a $q^2$-approximation for this problem. For large values of $q$, this is undesirable. In this paper, we show an improved technique to obtain an approximation factor of $4+O(1/q^2)$ to this problem. We are able to achieve this by using an idea of optimization over multiple bins of the hash functions, that can be easily implemented by inequality constraints, or even in unconstrained way. Also the burden on the NP-oracle is not increased by our method (an ILP solver can still be used). We provide experimental simulation results to support the theoretical guarantees of our algorithms.
△ Less
Submitted 25 June, 2019; v1 submitted 29 June, 2018;
originally announced June 2018.
-
Robust Gradient Descent via Moment Encoding with LDPC Codes
Authors:
Raj Kumar Maity,
Ankit Singh Rawat,
Arya Mazumdar
Abstract:
This paper considers the problem of implementing large-scale gradient descent algorithms in a distributed computing setting in the presence of {\em straggling} processors. To mitigate the effect of the stragglers, it has been previously proposed to encode the data with an erasure-correcting code and decode at the master server at the end of the computation. We, instead, propose to encode the secon…
▽ More
This paper considers the problem of implementing large-scale gradient descent algorithms in a distributed computing setting in the presence of {\em straggling} processors. To mitigate the effect of the stragglers, it has been previously proposed to encode the data with an erasure-correcting code and decode at the master server at the end of the computation. We, instead, propose to encode the second-moment of the data with a low density parity-check (LDPC) code. The iterative decoding algorithms for LDPC codes have very low computational overhead and the number of decoding iterations can be made to automatically adjust with the number of stragglers in the system. We show that for a random model for stragglers, the proposed moment encoding based gradient descent method can be viewed as the stochastic gradient descent method. This allows us to obtain convergence guarantees for the proposed solution. Furthermore, the proposed moment encoding based method is shown to outperform the existing schemes in a real distributed computing setup.
△ Less
Submitted 2 January, 2019; v1 submitted 21 May, 2018;
originally announced May 2018.
-
Chemotaxis of ciliated microorganisms: with and without noise
Authors:
Ruma Maity,
P. S. Burada
Abstract:
Biological systems like ciliated microorganisms are capable to respond to the external chemical gradients, a process known as chemotaxis which has been studied here using the chiral squirmer model. This theoretical model considers the microorganism as a spherical body with an active surface slip velocity. In presence of a chemical gradient, the internal signaling network of the microorganism is tr…
▽ More
Biological systems like ciliated microorganisms are capable to respond to the external chemical gradients, a process known as chemotaxis which has been studied here using the chiral squirmer model. This theoretical model considers the microorganism as a spherical body with an active surface slip velocity. In presence of a chemical gradient, the internal signaling network of the microorganism is triggered due to binding of the ligand with the receptors on the surface of the body. Consequently, the coefficients of the slip velocity get modified resulting in a change in the path followed by the body. We observe that the strength of the gradient is not the only parameter which controls the dynamics of the body but also the adaptation time play a very significant role in the success of chemotaxis of the body. Path of the body is smooth if we ignore the discreteness in the ligand-receptor binding which is stochastic in nature. In presence of the later, the path is not only irregular but the dynamics of the body changes. We calculate the mean first passage time, by varying strength of the chemical gradient and adaptation time, to investigate the success rate of chemotaxis.
△ Less
Submitted 17 April, 2018;
originally announced April 2018.
-
Structural and dielectric characterization of Sm2MgMnO6
Authors:
Moumin Rudra,
Ritwik Maity,
T. P. Sinha
Abstract:
The polycrystalline Sm2MgMnO6 (SMMO) was synthesized at 1173K by means of sol-gel technique. Rietveld refine-ment of X-ray diffraction (XRD) pattern confirmed the formation of a single phase monoclinic structure with space group P21/n. The band gap achieved from UV-vis spectra shows the semiconducting nature of the material. To observe the effect of grains and grain-boundaries in the conduction pr…
▽ More
The polycrystalline Sm2MgMnO6 (SMMO) was synthesized at 1173K by means of sol-gel technique. Rietveld refine-ment of X-ray diffraction (XRD) pattern confirmed the formation of a single phase monoclinic structure with space group P21/n. The band gap achieved from UV-vis spectra shows the semiconducting nature of the material. To observe the effect of grains and grain-boundaries in the conduction process and dielectric relaxation measurements are carried out on SMMO sample at different frequencies between 313 K and 673 K. An electrical equivalent circuit consisting of the resistance and constant phase element is used to clarify the impedance data.
△ Less
Submitted 30 June, 2017;
originally announced June 2017.
-
Detecting metrologically useful asymmetry and entanglement by a few local measurements
Authors:
Chao Zhang,
Benjamin Yadin,
Zhi-Bo Hou,
Huan Cao,
Bi-Heng Liu,
Yun-Feng Huang,
Reevu Maity,
Vlatko Vedral,
Chuan-Feng Li,
Guang-Can Guo,
Davide Girolami
Abstract:
Important properties of a quantum system are not directly measurable, but they can be disclosed by how fast the system changes under controlled perturbations. In particular, asymmetry and entanglement can be verified by reconstructing the state of a quantum system. Yet, this usually requires experimental and computational resources which increase exponentially with the system size. Here we show ho…
▽ More
Important properties of a quantum system are not directly measurable, but they can be disclosed by how fast the system changes under controlled perturbations. In particular, asymmetry and entanglement can be verified by reconstructing the state of a quantum system. Yet, this usually requires experimental and computational resources which increase exponentially with the system size. Here we show how to detect metrologically useful asymmetry and entanglement by a limited number of measurements. This is achieved by studying how they affect the speed of evolution of a system under a unitary transformation. We show that the speed of multiqubit systems can be evaluated by measuring a set of local observables, providing exponential advantage with respect to state tomography. Indeed, the presented method requires neither the knowledge of the state and the parameter-encoding Hamiltonian nor global measurements performed on all the constituent subsystems. We implement the detection scheme in an all-optical experiment.
△ Less
Submitted 20 October, 2017; v1 submitted 7 November, 2016;
originally announced November 2016.
-
On a convergent off -policy temporal difference learning algorithm in on-line learning environment
Authors:
Prasenjit Karmakar,
Rajkumar Maity,
Shalabh Bhatnagar
Abstract:
In this paper we provide a rigorous convergence analysis of a "off"-policy temporal difference learning algorithm with linear function approximation and per time-step linear computational complexity in "online" learning environment. The algorithm considered here is TDC with importance weighting introduced by Maei et al. We support our theoretical results by providing suitable empirical results for…
▽ More
In this paper we provide a rigorous convergence analysis of a "off"-policy temporal difference learning algorithm with linear function approximation and per time-step linear computational complexity in "online" learning environment. The algorithm considered here is TDC with importance weighting introduced by Maei et al. We support our theoretical results by providing suitable empirical results for standard off-policy counterexamples.
△ Less
Submitted 19 May, 2016;
originally announced May 2016.
-
Black Hole Phase Transitions and the Chemical Potential
Authors:
Reevu Maity,
Pratim Roy,
Tapobrata Sarkar
Abstract:
In the context of extended phase space thermodynamics and the AdS-CFT correspondence, we consider the chemical potential ($μ$) dual to the number of colours ($N$) of the boundary gauge theory, in the grand canonical ensemble. By appropriately defining $μ$ via densities of thermodynamic quantities, we show that it changes sign precisely at the Hawking-Page transition for AdS-Schwarzschild and RN-Ad…
▽ More
In the context of extended phase space thermodynamics and the AdS-CFT correspondence, we consider the chemical potential ($μ$) dual to the number of colours ($N$) of the boundary gauge theory, in the grand canonical ensemble. By appropriately defining $μ$ via densities of thermodynamic quantities, we show that it changes sign precisely at the Hawking-Page transition for AdS-Schwarzschild and RN-AdS black holes in five dimensions, signalling the onset of quantum effects at the transition point. Such behaviour is absent for non-rotating black holes in four dimensions. For Kerr-AdS black holes in four and five dimensions, our analysis points to the fact that $μ$ can change sign in the stable black hole region, i.e above the Hawking-Page transition temperature, for a range of angular frequencies. We also analyse AdS black holes in five dimensional Gauss-Bonnet gravity, and find similar features for $μ$ as in the Kerr-AdS case.
△ Less
Submitted 17 December, 2015;
originally announced December 2015.
-
Sha** Proto-Value Functions via Rewards
Authors:
Chandrashekar Lakshmi Narayanan,
Raj Kumar Maity,
Shalabh Bhatnagar
Abstract:
In this paper, we combine task-dependent reward sha** and task-independent proto-value functions to obtain reward dependent proto-value functions (RPVFs). In constructing the RPVFs we are making use of the immediate rewards which are available during the sampling phase but are not used in the PVF construction. We show via experiments that learning with an RPVF based representation is better than…
▽ More
In this paper, we combine task-dependent reward sha** and task-independent proto-value functions to obtain reward dependent proto-value functions (RPVFs). In constructing the RPVFs we are making use of the immediate rewards which are available during the sampling phase but are not used in the PVF construction. We show via experiments that learning with an RPVF based representation is better than learning with just reward sha** or PVFs. In particular, when the state space is symmetrical and the rewards are asymmetrical, the RPVF capture the asymmetry better than the PVFs.
△ Less
Submitted 27 November, 2015;
originally announced November 2015.
-
Tidal Forces in Naked Singularity Backgrounds
Authors:
Akash Goel,
Reevu Maity,
Pratim Roy,
Tapobrata Sarkar
Abstract:
The end stage of a gravitational collapse process can generically result in a black hole or a naked singularity. Here we undertake a comparative analysis of the nature of tidal forces in these backgrounds. The effect of such forces is generically exemplified by the Roche limit, which predicts the distance within which a celestial object disintegrates due to the tidal effects of a second more massi…
▽ More
The end stage of a gravitational collapse process can generically result in a black hole or a naked singularity. Here we undertake a comparative analysis of the nature of tidal forces in these backgrounds. The effect of such forces is generically exemplified by the Roche limit, which predicts the distance within which a celestial object disintegrates due to the tidal effects of a second more massive object. In this paper, using Fermi normal coordinates, we numerically compute the Roche limit for a class of non-rotating naked singularity backgrounds, and compare them with known results for Schwarzschild black holes. Our analysis indicates that there might be substantially large deviations in the magnitudes of tidal forces in naked singularity backgrounds, compared to the black hole cases. If observationally established, these can prove to be an effective indicator of the nature of the singularity at a galactic centre.
△ Less
Submitted 6 April, 2015;
originally announced April 2015.
-
Information Geometry and the Renormalization Group
Authors:
Reevu Maity,
Subhash Mahapatra,
Tapobrata Sarkar
Abstract:
Information theoretic geometry near critical points in classical and quantum systems is well understood for exactly solvable systems. Here we show that renormalization group flow equations can be used to construct the information metric and its associated quantities near criticality, for both classical and quantum systems, in an universal manner. We study this metric in various cases and establish…
▽ More
Information theoretic geometry near critical points in classical and quantum systems is well understood for exactly solvable systems. Here we show that renormalization group flow equations can be used to construct the information metric and its associated quantities near criticality, for both classical and quantum systems, in an universal manner. We study this metric in various cases and establish its scaling properties in several generic examples. Scaling relations on the parameter manifold involving scalar quantities are studied, and scaling exponents are identified. The meaning of the scalar curvature and the invariant geodesic distance in information geometry is established and substantiated from a renormalization group perspective.
△ Less
Submitted 19 October, 2015; v1 submitted 13 March, 2015;
originally announced March 2015.
