Showing 1–50 of 54 results for author: Muthukumar, V

Precise asymptotics of reweighted least-squares algorithms for linear diagonal networks

Authors: Chiraag Kaushik, Justin Romberg, Vidya Muthukumar

Abstract: The classical iteratively reweighted least-squares (IRLS) algorithm aims to recover an unknown signal from linear measurements by performing a sequence of weighted least squares problems, where the weights are recursively updated at each step. Varieties of this algorithm have been shown to achieve favorable empirical performance and theoretical guarantees for sparse recovery and $\ell_p$-norm mini… ▽ More The classical iteratively reweighted least-squares (IRLS) algorithm aims to recover an unknown signal from linear measurements by performing a sequence of weighted least squares problems, where the weights are recursively updated at each step. Varieties of this algorithm have been shown to achieve favorable empirical performance and theoretical guarantees for sparse recovery and $\ell_p$-norm minimization. Recently, some preliminary connections have also been made between IRLS and certain types of non-convex linear neural network architectures that are observed to exploit low-dimensional structure in high-dimensional linear models. In this work, we provide a unified asymptotic analysis for a family of algorithms that encompasses IRLS, the recently proposed lin-RFM algorithm (which was motivated by feature learning in neural networks), and the alternating minimization algorithm on linear diagonal neural networks. Our analysis operates in a "batched" setting with i.i.d. Gaussian covariates and shows that, with appropriately chosen reweighting policy, the algorithm can achieve favorable performance in only a handful of iterations. We also extend our results to the case of group-sparse recovery and show that leveraging this structure in the reweighting scheme provably improves test error compared to coordinate-wise reweighting. △ Less

Submitted 4 June, 2024; originally announced June 2024.

Comments: 25 pages, 3 figures

Sharp analysis of out-of-distribution error for "importance-weighted" estimators in the overparameterized regime

Authors: Kuo-Wei Lai, Vidya Muthukumar

Abstract: Overparameterized models that achieve zero training error are observed to generalize well on average, but degrade in performance when faced with data that is under-represented in the training sample. In this work, we study an overparameterized Gaussian mixture model imbued with a spurious feature, and sharply analyze the in-distribution and out-of-distribution test error of a cost-sensitive interp… ▽ More Overparameterized models that achieve zero training error are observed to generalize well on average, but degrade in performance when faced with data that is under-represented in the training sample. In this work, we study an overparameterized Gaussian mixture model imbued with a spurious feature, and sharply analyze the in-distribution and out-of-distribution test error of a cost-sensitive interpolating solution that incorporates "importance weights". Compared to recent work Wang et al. (2021), Behnia et al. (2022), our analysis is sharp with matching upper and lower bounds, and significantly weakens required assumptions on data dimensionality. Our error characterizations also apply to any choice of importance weights and unveil a novel tradeoff between worst-case robustness to distribution shift and average accuracy as a function of the importance weight magnitude. △ Less

Submitted 10 May, 2024; originally announced May 2024.

Comments: A short version of this work will be presented at IEEE ISIT 2024

Just Wing It: Optimal Estimation of Missing Mass in a Markovian Sequence

Authors: Ashwin Pananjady, Vidya Muthukumar, Andrew Thangaraj

Abstract: We study the problem of estimating the stationary mass -- also called the unigram mass -- that is missing from a single trajectory of a discrete-time, ergodic Markov chain. This problem has several applications -- for example, estimating the stationary missing mass is critical for accurately smoothing probability estimates in sequence models. While the classical Good--Turing estimator from the 195… ▽ More We study the problem of estimating the stationary mass -- also called the unigram mass -- that is missing from a single trajectory of a discrete-time, ergodic Markov chain. This problem has several applications -- for example, estimating the stationary missing mass is critical for accurately smoothing probability estimates in sequence models. While the classical Good--Turing estimator from the 1950s has appealing properties for i.i.d. data, it is known to be biased in the Markov setting, and other heuristic estimators do not come equipped with guarantees. Operating in the general setting in which the size of the state space may be much larger than the length $n$ of the trajectory, we develop a linear-runtime estimator called \emph{Windowed Good--Turing} (\textsc{WingIt}) and show that its risk decays as $\widetilde{\mathcal{O}}(\mathsf{T_{mix}}/n)$, where $\mathsf{T_{mix}}$ denotes the mixing time of the chain in total variation distance. Notably, this rate is independent of the size of the state space and minimax-optimal up to a logarithmic factor in $n / \mathsf{T_{mix}}$. We also present a bound on the variance of the missing mass random variable, which may be of independent interest. We extend our estimator to approximate the stationary mass placed on elements occurring with small frequency in $X^n$. Finally, we demonstrate the efficacy of our estimators both in simulations on canonical chains and on sequences constructed from a popular natural language corpus. △ Less

Submitted 8 April, 2024; originally announced April 2024.

Comments: 40 pages, 5 figures

Balanced Data, Imbalanced Spectra: Unveiling Class Disparities with Spectral Imbalance

Authors: Chiraag Kaushik, Ran Liu, Chi-Heng Lin, Amrit Khera, Matthew Y **, Wenrui Ma, Vidya Muthukumar, Eva L Dyer

Abstract: Classification models are expected to perform equally well for different classes, yet in practice, there are often large gaps in their performance. This issue of class bias is widely studied in cases of datasets with sample imbalance, but is relatively overlooked in balanced datasets. In this work, we introduce the concept of spectral imbalance in features as a potential source for class dispariti… ▽ More Classification models are expected to perform equally well for different classes, yet in practice, there are often large gaps in their performance. This issue of class bias is widely studied in cases of datasets with sample imbalance, but is relatively overlooked in balanced datasets. In this work, we introduce the concept of spectral imbalance in features as a potential source for class disparities and study the connections between spectral imbalance and class bias in both theory and practice. To build the connection between spectral imbalance and class gap, we develop a theoretical framework for studying class disparities and derive exact expressions for the per-class error in a high-dimensional mixture model setting. We then study this phenomenon in 11 different state-of-the-art pretrained encoders and show how our proposed framework can be used to compare the quality of encoders, as well as evaluate and combine data augmentation strategies to mitigate the issue. Our work sheds light on the class-dependent effects of learning, and provides new insights into how state-of-the-art pretrained features may have unknown biases that can be diagnosed through their spectra. △ Less

Submitted 3 June, 2024; v1 submitted 18 February, 2024; originally announced February 2024.

Comments: 25 pages, 9 figures

Towards Last-layer Retraining for Group Robustness with Fewer Annotations

Authors: Tyler LaBonte, Vidya Muthukumar, Abhishek Kumar

Abstract: Empirical risk minimization (ERM) of neural networks is prone to over-reliance on spurious correlations and poor generalization on minority groups. The recent deep feature reweighting (DFR) technique achieves state-of-the-art group robustness via simple last-layer retraining, but it requires held-out group and class annotations to construct a group-balanced reweighting dataset. In this work, we ex… ▽ More Empirical risk minimization (ERM) of neural networks is prone to over-reliance on spurious correlations and poor generalization on minority groups. The recent deep feature reweighting (DFR) technique achieves state-of-the-art group robustness via simple last-layer retraining, but it requires held-out group and class annotations to construct a group-balanced reweighting dataset. In this work, we examine this impractical requirement and find that last-layer retraining can be surprisingly effective with no group annotations (other than for model selection) and only a handful of class annotations. We first show that last-layer retraining can greatly improve worst-group accuracy even when the reweighting dataset has only a small proportion of worst-group data. This implies a "free lunch" where holding out a subset of training data to retrain the last layer can substantially outperform ERM on the entire dataset with no additional data or annotations. To further improve group robustness, we introduce a lightweight method called selective last-layer finetuning (SELF), which constructs the reweighting dataset using misclassifications or disagreements. Our empirical and theoretical results present the first evidence that model disagreement upsamples worst-group data, enabling SELF to nearly match DFR on four well-established benchmarks across vision and language tasks with no group annotations and less than 3% of the held-out class annotations. Our code is available at https://github.com/tmlabonte/last-layer-retraining. △ Less

Submitted 14 November, 2023; v1 submitted 15 September, 2023; originally announced September 2023.

Comments: NeurIPS 2023

Faster Margin Maximization Rates for Generic and Adversarially Robust Optimization Methods

Authors: Guanghui Wang, Zihao Hu, Claudio Gentile, Vidya Muthukumar, Jacob Abernethy

Abstract: First-order optimization methods tend to inherently favor certain solutions over others when minimizing an underdetermined training objective that has multiple global optima. This phenomenon, known as implicit bias, plays a critical role in understanding the generalization capabilities of optimization algorithms. Recent research has revealed that in separable binary classification tasks gradient-d… ▽ More First-order optimization methods tend to inherently favor certain solutions over others when minimizing an underdetermined training objective that has multiple global optima. This phenomenon, known as implicit bias, plays a critical role in understanding the generalization capabilities of optimization algorithms. Recent research has revealed that in separable binary classification tasks gradient-descent-based methods exhibit an implicit bias for the $\ell_2$-maximal margin classifier. Similarly, generic optimization methods, such as mirror descent and steepest descent, have been shown to converge to maximal margin classifiers defined by alternative geometries. While gradient-descent-based algorithms provably achieve fast implicit bias rates, corresponding rates in the literature for generic optimization methods are relatively slow. To address this limitation, we present a series of state-of-the-art implicit bias rates for mirror descent and steepest descent algorithms. Our primary technique involves transforming a generic optimization algorithm into an online optimization dynamic that solves a regularized bilinear game, providing a unified framework for analyzing the implicit bias of various optimization methods. Our accelerated rates are derived by leveraging the regret bounds of online learning algorithms within this game framework. We then show the flexibility of this framework by analyzing the implicit bias in adversarial training, and again obtain significantly improved convergence rates. △ Less

Submitted 7 April, 2024; v1 submitted 27 May, 2023; originally announced May 2023.

Comments: Undated version: New results for implicit bias in adversarial training

New Equivalences Between Interpolation and SVMs: Kernels and Structured Features

Authors: Chiraag Kaushik, Andrew D. McRae, Mark A. Davenport, Vidya Muthukumar

Abstract: The support vector machine (SVM) is a supervised learning algorithm that finds a maximum-margin linear classifier, often after map** the data to a high-dimensional feature space via the kernel trick. Recent work has demonstrated that in certain sufficiently overparameterized settings, the SVM decision function coincides exactly with the minimum-norm label interpolant. This phenomenon of support… ▽ More The support vector machine (SVM) is a supervised learning algorithm that finds a maximum-margin linear classifier, often after map** the data to a high-dimensional feature space via the kernel trick. Recent work has demonstrated that in certain sufficiently overparameterized settings, the SVM decision function coincides exactly with the minimum-norm label interpolant. This phenomenon of support vector proliferation (SVP) is especially interesting because it allows us to understand SVM performance by leveraging recent analyses of harmless interpolation in linear and kernel models. However, previous work on SVP has made restrictive assumptions on the data/feature distribution and spectrum. In this paper, we present a new and flexible analysis framework for proving SVP in an arbitrary reproducing kernel Hilbert space with a flexible class of generative models for the labels. We present conditions for SVP for features in the families of general bounded orthonormal systems (e.g. Fourier features) and independent sub-Gaussian features. In both cases, we show that SVP occurs in many interesting settings not covered by prior work, and we leverage these results to prove novel generalization results for kernel SVM classification. △ Less

Submitted 3 May, 2023; originally announced May 2023.

Comments: 23 pages, 2 figures

MSC Class: 62H30; 62J07; 68Q32; 46E22

General Loss Functions Lead to (Approximate) Interpolation in High Dimensions

Authors: Kuo-Wei Lai, Vidya Muthukumar

Abstract: We provide a unified framework, applicable to a general family of convex losses and across binary and multiclass settings in the overparameterized regime, to approximately characterize the implicit bias of gradient descent in closed form. Specifically, we show that the implicit bias is approximated (but not exactly equal to) the minimum-norm interpolation in high dimensions, which arises from trai… ▽ More We provide a unified framework, applicable to a general family of convex losses and across binary and multiclass settings in the overparameterized regime, to approximately characterize the implicit bias of gradient descent in closed form. Specifically, we show that the implicit bias is approximated (but not exactly equal to) the minimum-norm interpolation in high dimensions, which arises from training on the squared loss. In contrast to prior work which was tailored to exponentially-tailed losses and used the intermediate support-vector-machine formulation, our framework directly builds on the primal-dual analysis of Ji and Telgarsky (2021), allowing us to provide new approximate equivalences for general convex losses through a novel sensitivity analysis. Our framework also recovers existing exact equivalence results for exponentially-tailed losses across binary and multiclass settings. Finally, we provide evidence for the tightness of our techniques, which we use to demonstrate the effect of certain loss functions designed for out-of-distribution problems on the closed-form solution. △ Less

Submitted 13 March, 2023; originally announced March 2023.

Comments: 52 pages

Estimating Optimal Policy Value in General Linear Contextual Bandits

Authors: Jonathan N. Lee, Weihao Kong, Aldo Pacchiano, Vidya Muthukumar, Emma Brunskill

Abstract: In many bandit problems, the maximal reward achievable by a policy is often unknown in advance. We consider the problem of estimating the optimal policy value in the sublinear data regime before the optimal policy is even learnable. We refer to this as $V^*$ estimation. It was recently shown that fast $V^*$ estimation is possible but only in disjoint linear bandits with Gaussian covariates. Whethe… ▽ More In many bandit problems, the maximal reward achievable by a policy is often unknown in advance. We consider the problem of estimating the optimal policy value in the sublinear data regime before the optimal policy is even learnable. We refer to this as $V^*$ estimation. It was recently shown that fast $V^*$ estimation is possible but only in disjoint linear bandits with Gaussian covariates. Whether this is possible for more realistic context distributions has remained an open and important question for tasks such as model selection. In this paper, we first provide lower bounds showing that this general problem is hard. However, under stronger assumptions, we give an algorithm and analysis proving that $\widetilde{\mathcal{O}}(\sqrt{d})$ sublinear estimation of $V^*$ is indeed information-theoretically possible, where $d$ is the dimension. We then present a more practical, computationally efficient algorithm that estimates a problem-dependent upper bound on $V^*$ that holds for general distributions and is tight when the context distribution is Gaussian. We prove our algorithm requires only $\widetilde{\mathcal{O}}(\sqrt{d})$ samples to estimate the upper bound. We use this upper bound and the estimator to obtain novel and improved guarantees for several applications in bandit model selection and testing for treatment effects. △ Less

Submitted 18 February, 2023; originally announced February 2023.

Adaptive Oracle-Efficient Online Learning

Authors: Guanghui Wang, Zihao Hu, Vidya Muthukumar, Jacob Abernethy

Abstract: The classical algorithms for online learning and decision-making have the benefit of achieving the optimal performance guarantees, but suffer from computational complexity limitations when implemented at scale. More recent sophisticated techniques, which we refer to as oracle-efficient methods, address this problem by dispatching to an offline optimization oracle that can search through an exponen… ▽ More The classical algorithms for online learning and decision-making have the benefit of achieving the optimal performance guarantees, but suffer from computational complexity limitations when implemented at scale. More recent sophisticated techniques, which we refer to as oracle-efficient methods, address this problem by dispatching to an offline optimization oracle that can search through an exponentially-large (or even infinite) space of decisions and select that which performed the best on any dataset. But despite the benefits of computational feasibility, oracle-efficient algorithms exhibit one major limitation: while performing well in worst-case settings, they do not adapt well to friendly environments. In this paper we consider two such friendly scenarios, (a) "small-loss" problems and (b) IID data. We provide a new framework for designing follow-the-perturbed-leader algorithms that are oracle-efficient and adapt well to the small-loss environment, under a particular condition which we call approximability (which is spiritually related to sufficient conditions provided by Dudík et al., [2020]). We identify a series of real-world settings, including online auctions and transductive online classification, for which approximability holds. We also extend the algorithm to an IID data setting and establish a "best-of-both-worlds" bound in the oracle-efficient setting. △ Less

Submitted 17 October, 2022; originally announced October 2022.

The good, the bad and the ugly sides of data augmentation: An implicit spectral regularization perspective

Authors: Chi-Heng Lin, Chiraag Kaushik, Eva L. Dyer, Vidya Muthukumar

Abstract: Data augmentation (DA) is a powerful workhorse for bolstering performance in modern machine learning. Specific augmentations like translations and scaling in computer vision are traditionally believed to improve generalization by generating new (artificial) data from the same distribution. However, this traditional viewpoint does not explain the success of prevalent augmentations in modern machine… ▽ More Data augmentation (DA) is a powerful workhorse for bolstering performance in modern machine learning. Specific augmentations like translations and scaling in computer vision are traditionally believed to improve generalization by generating new (artificial) data from the same distribution. However, this traditional viewpoint does not explain the success of prevalent augmentations in modern machine learning (e.g. randomized masking, cutout, mixup), that greatly alter the training data distribution. In this work, we develop a new theoretical framework to characterize the impact of a general class of DA on underparameterized and overparameterized linear model generalization. Our framework reveals that DA induces implicit spectral regularization through a combination of two distinct effects: a) manipulating the relative proportion of eigenvalues of the data covariance matrix in a training-data-dependent manner, and b) uniformly boosting the entire spectrum of the data covariance matrix through ridge regression. These effects, when applied to popular augmentations, give rise to a wide variety of phenomena, including discrepancies in generalization between over-parameterized and under-parameterized regimes and differences between regression and classification tasks. Our framework highlights the nuanced and sometimes surprising impacts of DA on generalization, and serves as a testbed for novel augmentation design. △ Less

Submitted 27 February, 2024; v1 submitted 10 October, 2022; originally announced October 2022.

Comments: 72 pages, 8 figures

The Complexity of Infinite-Horizon General-Sum Stochastic Games

Authors: Yujia **, Vidya Muthukumar, Aaron Sidford

Abstract: We study the complexity of computing stationary Nash equilibrium (NE) in n-player infinite-horizon general-sum stochastic games. We focus on the problem of computing NE in such stochastic games when each player is restricted to choosing a stationary policy and rewards are discounted. First, we prove that computing such NE is in PPAD (in addition to clearly being PPAD-hard). Second, we consider tur… ▽ More We study the complexity of computing stationary Nash equilibrium (NE) in n-player infinite-horizon general-sum stochastic games. We focus on the problem of computing NE in such stochastic games when each player is restricted to choosing a stationary policy and rewards are discounted. First, we prove that computing such NE is in PPAD (in addition to clearly being PPAD-hard). Second, we consider turn-based specializations of such games where at each state there is at most a single player that can take actions and show that these (seemingly-simpler) games remain PPAD-hard. Third, we show that under further structural assumptions on the rewards computing NE in such turn-based games is possible in polynomial time. Towards achieving these results we establish structural facts about stochastic games of broader utility, including monotonicity of utilities under single-state single-action changes and reductions to settings where each player controls a single state. △ Less

Submitted 29 November, 2022; v1 submitted 8 April, 2022; originally announced April 2022.

Comments: accepted at ITCS 2023

Harmless interpolation in regression and classification with structured features

Authors: Andrew D. McRae, Santhosh Karnik, Mark A. Davenport, Vidya Muthukumar

Abstract: Overparametrized neural networks tend to perfectly fit noisy training data yet generalize well on test data. Inspired by this empirical observation, recent work has sought to understand this phenomenon of benign overfitting or harmless interpolation in the much simpler linear model. Previous theoretical work critically assumes that either the data features are statistically independent or the inpu… ▽ More Overparametrized neural networks tend to perfectly fit noisy training data yet generalize well on test data. Inspired by this empirical observation, recent work has sought to understand this phenomenon of benign overfitting or harmless interpolation in the much simpler linear model. Previous theoretical work critically assumes that either the data features are statistically independent or the input data is high-dimensional; this precludes general nonparametric settings with structured feature maps. In this paper, we present a general and flexible framework for upper bounding regression and classification risk in a reproducing kernel Hilbert space. A key contribution is that our framework describes precise sufficient conditions on the data Gram matrix under which harmless interpolation occurs. Our results recover prior independent-features results (with a much simpler analysis), but they furthermore show that harmless interpolation can occur in more general settings such as features that are a bounded orthonormal system. Furthermore, our results show an asymptotic separation between classification and regression performance in a manner that was previously only shown for Gaussian features. △ Less

Submitted 21 February, 2022; v1 submitted 9 November, 2021; originally announced November 2021.

Universal and data-adaptive algorithms for model selection in linear contextual bandits

Authors: Vidya Muthukumar, Akshay Krishnamurthy

Abstract: Model selection in contextual bandits is an important complementary problem to regret minimization with respect to a fixed model class. We consider the simplest non-trivial instance of model-selection: distinguishing a simple multi-armed bandit problem from a linear contextual bandit problem. Even in this instance, current state-of-the-art methods explore in a suboptimal manner and require strong… ▽ More Model selection in contextual bandits is an important complementary problem to regret minimization with respect to a fixed model class. We consider the simplest non-trivial instance of model-selection: distinguishing a simple multi-armed bandit problem from a linear contextual bandit problem. Even in this instance, current state-of-the-art methods explore in a suboptimal manner and require strong "feature-diversity" conditions. In this paper, we introduce new algorithms that a) explore in a data-adaptive manner, and b) provide model selection guarantees of the form $\mathcal{O}(d^α T^{1- α})$ with no feature diversity conditions whatsoever, where $d$ denotes the dimension of the linear model and $T$ denotes the total number of rounds. The first algorithm enjoys a "best-of-both-worlds" property, recovering two prior results that hold under distinct distributional assumptions, simultaneously. The second removes distributional assumptions altogether, expanding the scope for tractable model selection. Our approach extends to model selection among nested linear contextual bandits under some additional assumptions. △ Less

Submitted 30 June, 2022; v1 submitted 8 November, 2021; originally announced November 2021.

Comments: 30 pages, to appear in ICML 2022

Classification and Adversarial examples in an Overparameterized Linear Model: A Signal Processing Perspective

Authors: Adhyyan Narang, Vidya Muthukumar, Anant Sahai

Abstract: State-of-the-art deep learning classifiers are heavily overparameterized with respect to the amount of training examples and observed to generalize well on "clean" data, but be highly susceptible to infinitesmal adversarial perturbations. In this paper, we identify an overparameterized linear ensemble, that uses the "lifted" Fourier feature map, that demonstrates both of these behaviors. The input… ▽ More State-of-the-art deep learning classifiers are heavily overparameterized with respect to the amount of training examples and observed to generalize well on "clean" data, but be highly susceptible to infinitesmal adversarial perturbations. In this paper, we identify an overparameterized linear ensemble, that uses the "lifted" Fourier feature map, that demonstrates both of these behaviors. The input is one-dimensional, and the adversary is only allowed to perturb these inputs and not the non-linear features directly. We find that the learned model is susceptible to adversaries in an intermediate regime where classification generalizes but regression does not. Notably, the susceptibility arises despite the absence of model mis-specification or label noise, which are commonly cited reasons for adversarial-susceptibility. These results are extended theoretically to a random-Fourier-sum setup that exhibits double-descent behavior. In both feature-setups, the adversarial vulnerability arises because of a phenomenon we term spatial localization: the predictions of the learned model are markedly more sensitive in the vicinity of training points than elsewhere. This sensitivity is a consequence of feature lifting and is reminiscent of Gibb's and Runge's phenomena from signal processing and functional analysis. Despite the adversarial susceptibility, we find that classification with these features can be easier than the more commonly studied "independent feature" models. △ Less

Submitted 27 September, 2021; originally announced September 2021.

Comments: 32 pages, 10 figures

A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning

Authors: Yehuda Dar, Vidya Muthukumar, Richard G. Baraniuk

Abstract: The rapid recent progress in machine learning (ML) has raised a number of scientific questions that challenge the longstanding dogma of the field. One of the most important riddles is the good empirical generalization of overparameterized models. Overparameterized models are excessively complex with respect to the size of the training dataset, which results in them perfectly fitting (i.e., interpo… ▽ More The rapid recent progress in machine learning (ML) has raised a number of scientific questions that challenge the longstanding dogma of the field. One of the most important riddles is the good empirical generalization of overparameterized models. Overparameterized models are excessively complex with respect to the size of the training dataset, which results in them perfectly fitting (i.e., interpolating) the training data, which is usually noisy. Such interpolation of noisy data is traditionally associated with detrimental overfitting, and yet a wide range of interpolating models -- from simple linear models to deep neural networks -- have recently been observed to generalize extremely well on fresh test data. Indeed, the recently discovered double descent phenomenon has revealed that highly overparameterized models often improve over the best underparameterized model in test performance. Understanding learning in this overparameterized regime requires new theory and foundational empirical studies, even for the simplest case of the linear model. The underpinnings of this understanding have been laid in very recent analyses of overparameterized linear regression and related statistical learning tasks, which resulted in precise analytic characterizations of double descent. This paper provides a succinct overview of this emerging theory of overparameterized ML (henceforth abbreviated as TOPML) that explains these recent findings through a statistical signal processing perspective. We emphasize the unique aspects that define the TOPML research area as a subfield of modern ML theory and outline interesting open questions that remain. △ Less

Submitted 6 September, 2021; originally announced September 2021.

Improving the Performance of a NoC-based CNN Accelerator with Gather Support

Authors: Binayak Tiwari, Mei Yang, Xiaohang Wang, Yingtao Jiang, Venkatesan Muthukumar

Abstract: The increasing application of deep learning technology drives the need for an efficient parallel computing architecture for Convolutional Neural Networks (CNNs). A significant challenge faced when designing a many-core CNN accelerator is to handle the data movement between the processing elements. The CNN workload introduces many-to-one traffic in addition to one-to-one and one-to-many traffic. As… ▽ More The increasing application of deep learning technology drives the need for an efficient parallel computing architecture for Convolutional Neural Networks (CNNs). A significant challenge faced when designing a many-core CNN accelerator is to handle the data movement between the processing elements. The CNN workload introduces many-to-one traffic in addition to one-to-one and one-to-many traffic. As the de-facto standard for on-chip communication, Network-on-Chip (NoC) can support various unicast and multicast traffic. For many-to-one traffic, repetitive unicast is employed which is not an efficient way. In this paper, we propose to use the gather packet on mesh-based NoCs employing output stationary systolic array in support of many-to-one traffic. The gather packet will collect the data from the intermediate nodes eventually leading to the destination efficiently. This method is evaluated using the traffic traces generated from the convolution layer of AlexNet and VGG-16 with improvement in the latency and power than the repetitive unicast method. △ Less

Submitted 1 August, 2021; originally announced August 2021.

Comments: Presented at 33rd IEEE International System-on-Chip Conference (SOCC)

Learning from an Exploring Demonstrator: Optimal Reward Estimation for Bandits

Authors: Wenshuo Guo, Kumar Krishna Agrawal, Aditya Grover, Vidya Muthukumar, Ashwin Pananjady

Abstract: We introduce the "inverse bandit" problem of estimating the rewards of a multi-armed bandit instance from observing the learning process of a low-regret demonstrator. Existing approaches to the related problem of inverse reinforcement learning assume the execution of an optimal policy, and thereby suffer from an identifiability issue. In contrast, we propose to leverage the demonstrator's behavior… ▽ More We introduce the "inverse bandit" problem of estimating the rewards of a multi-armed bandit instance from observing the learning process of a low-regret demonstrator. Existing approaches to the related problem of inverse reinforcement learning assume the execution of an optimal policy, and thereby suffer from an identifiability issue. In contrast, we propose to leverage the demonstrator's behavior en route to optimality, and in particular, the exploration phase, for reward estimation. We begin by establishing a general information-theoretic lower bound under this paradigm that applies to any demonstrator algorithm, which characterizes a fundamental tradeoff between reward estimation and the amount of exploration of the demonstrator. Then, we develop simple and efficient reward estimators for upper-confidence-based demonstrator algorithms that attain the optimal tradeoff, showing in particular that consistent reward estimation -- free of identifiability issues -- is possible under our paradigm. Extensive simulations on both synthetic and semi-synthetic data corroborate our theoretical results. △ Less

Submitted 22 February, 2022; v1 submitted 28 June, 2021; originally announced June 2021.

Comments: Proceedings of the International Conference on Artificial Intelligence and Statistics (AISTATS), 2022

Benign Overfitting in Multiclass Classification: All Roads Lead to Interpolation

Authors: Ke Wang, Vidya Muthukumar, Christos Thrampoulidis

Abstract: The literature on "benign overfitting" in overparameterized models has been mostly restricted to regression or binary classification; however, modern machine learning operates in the multiclass setting. Motivated by this discrepancy, we study benign overfitting in multiclass linear classification. Specifically, we consider the following training algorithms on separable data: (i) empirical risk min… ▽ More The literature on "benign overfitting" in overparameterized models has been mostly restricted to regression or binary classification; however, modern machine learning operates in the multiclass setting. Motivated by this discrepancy, we study benign overfitting in multiclass linear classification. Specifically, we consider the following training algorithms on separable data: (i) empirical risk minimization (ERM) with cross-entropy loss, which converges to the multiclass support vector machine (SVM) solution; (ii) ERM with least-squares loss, which converges to the min-norm interpolating (MNI) solution; and, (iii) the one-vs-all SVM classifier. First, we provide a simple sufficient deterministic condition under which all three algorithms lead to classifiers that interpolate the training data and have equal accuracy. When the data is generated from Gaussian mixtures or a multinomial logistic model, this condition holds under high enough effective overparameterization. We also show that this sufficient condition is satisfied under "neural collapse", a phenomenon that is observed in training deep neural networks. Second, we derive novel bounds on the accuracy of the MNI classifier, thereby showing that all three training algorithms lead to benign overfitting under sufficient overparameterization. Ultimately, our analysis shows that good generalization is possible for SVM solutions beyond the realm in which typical margin-based bounds apply. △ Less

Submitted 11 July, 2023; v1 submitted 21 June, 2021; originally announced June 2021.

Comments: Corrected subtle issue in the proofs of Lemmas 4 an 5. Relaxed Assumptions 1 and 2 and added error bound for ETF geometry

On the Impossibility of Convergence of Mixed Strategies with No Regret Learning

Authors: Vidya Muthukumar, Soham Phade, Anant Sahai

Abstract: We study the limiting behavior of the mixed strategies that result from optimal no-regret learning strategies in a repeated game setting where the stage game is any 2 by 2 competitive game. We consider optimal no-regret algorithms that are mean-based and monotonic in their argument. We show that for any such algorithm, the limiting mixed strategies of the players cannot converge almost surely to a… ▽ More We study the limiting behavior of the mixed strategies that result from optimal no-regret learning strategies in a repeated game setting where the stage game is any 2 by 2 competitive game. We consider optimal no-regret algorithms that are mean-based and monotonic in their argument. We show that for any such algorithm, the limiting mixed strategies of the players cannot converge almost surely to any Nash equilibrium. This negative result is also shown to hold under a broad relaxation of these assumptions, including popular variants of Online-Mirror-Descent with optimism and/or adaptive step-sizes. Finally, we conjecture that the monotonicity assumption can be removed, and provide partial evidence for this conjecture. Our results identify the inherent stochasticity in players' realizations as a critical factor underlying this divergence in outcomes between using the opponent's mixtures and realizations to make updates. △ Less

Submitted 2 March, 2022; v1 submitted 3 December, 2020; originally announced December 2020.

Comments: 47 pages, 12 figures

Online Model Selection for Reinforcement Learning with Function Approximation

Authors: Jonathan N. Lee, Aldo Pacchiano, Vidya Muthukumar, Weihao Kong, Emma Brunskill

Abstract: Deep reinforcement learning has achieved impressive successes yet often requires a very large amount of interaction data. This result is perhaps unsurprising, as using complicated function approximation often requires more data to fit, and early theoretical results on linear Markov decision processes provide regret bounds that scale with the dimension of the linear approximation. Ideally, we would… ▽ More Deep reinforcement learning has achieved impressive successes yet often requires a very large amount of interaction data. This result is perhaps unsurprising, as using complicated function approximation often requires more data to fit, and early theoretical results on linear Markov decision processes provide regret bounds that scale with the dimension of the linear approximation. Ideally, we would like to automatically identify the minimal dimension of the approximation that is sufficient to encode an optimal policy. Towards this end, we consider the problem of model selection in RL with function approximation, given a set of candidate RL algorithms with known regret guarantees. The learner's goal is to adapt to the complexity of the optimal algorithm without knowing it \textit{a priori}. We present a meta-algorithm that successively rejects increasingly complex models using a simple statistical test. Given at least one candidate that satisfies realizability, we prove the meta-algorithm adapts to the optimal complexity with $\tilde{O}(L^{5/6} T^{2/3})$ regret compared to the optimal candidate's $\tilde{O}(\sqrt T)$ regret, where $T$ is the number of episodes and $L$ is the number of algorithms. The dimension and horizon dependencies remain optimal with respect to the best candidate, and our meta-algorithmic approach is flexible to incorporate multiple candidate algorithms and models. Finally, we show that the meta-algorithm automatically admits significantly improved instance-dependent regret bounds that depend on the gaps between the maximal values attainable by the candidates. △ Less

Submitted 19 November, 2020; originally announced November 2020.

On the proliferation of support vectors in high dimensions

Authors: Daniel Hsu, Vidya Muthukumar, Ji Xu

Abstract: The support vector machine (SVM) is a well-established classification method whose name refers to the particular training examples, called support vectors, that determine the maximum margin separating hyperplane. The SVM classifier is known to enjoy good generalization properties when the number of support vectors is small compared to the number of training examples. However, recent research has s… ▽ More The support vector machine (SVM) is a well-established classification method whose name refers to the particular training examples, called support vectors, that determine the maximum margin separating hyperplane. The SVM classifier is known to enjoy good generalization properties when the number of support vectors is small compared to the number of training examples. However, recent research has shown that in sufficiently high-dimensional linear classification problems, the SVM can generalize well despite a proliferation of support vectors where all training examples are support vectors. In this paper, we identify new deterministic equivalences for this phenomenon of support vector proliferation, and use them to (1) substantially broaden the conditions under which the phenomenon occurs in high-dimensional settings, and (2) prove a nearly matching converse result. △ Less

Submitted 13 June, 2022; v1 submitted 22 September, 2020; originally announced September 2020.

Classification vs regression in overparameterized regimes: Does the loss function matter?

Authors: Vidya Muthukumar, Adhyyan Narang, Vignesh Subramanian, Mikhail Belkin, Daniel Hsu, Anant Sahai

Abstract: We compare classification and regression tasks in an overparameterized linear model with Gaussian features. On the one hand, we show that with sufficient overparameterization all training points are support vectors: solutions obtained by least-squares minimum-norm interpolation, typically used for regression, are identical to those produced by the hard-margin support vector machine (SVM) that mini… ▽ More We compare classification and regression tasks in an overparameterized linear model with Gaussian features. On the one hand, we show that with sufficient overparameterization all training points are support vectors: solutions obtained by least-squares minimum-norm interpolation, typically used for regression, are identical to those produced by the hard-margin support vector machine (SVM) that minimizes the hinge loss, typically used for training classifiers. On the other hand, we show that there exist regimes where these interpolating solutions generalize well when evaluated by the 0-1 test loss function, but do not generalize if evaluated by the square loss function, i.e. they approach the null risk. Our results demonstrate the very different roles and properties of loss functions used at the training phase (optimization) and the testing phase (generalization). △ Less

Submitted 14 October, 2021; v1 submitted 16 May, 2020; originally announced May 2020.

Journal ref: Journal of Machine Learning Research, 22(222):1-69, 2021

Robust Commitments and Partial Reputation

Authors: Vidya Muthukumar, Anant Sahai

Abstract: Agents rarely act in isolation -- their behavioral history, in particular, is public to others. We seek a non-asymptotic understanding of how a leader agent should shape this history to its maximal advantage, knowing that follower agent(s) will be learning and responding to it. We study Stackelberg leader-follower games with finite observations of the leader commitment, which commonly models secur… ▽ More Agents rarely act in isolation -- their behavioral history, in particular, is public to others. We seek a non-asymptotic understanding of how a leader agent should shape this history to its maximal advantage, knowing that follower agent(s) will be learning and responding to it. We study Stackelberg leader-follower games with finite observations of the leader commitment, which commonly models security games and network routing in engineering, and persuasion mechanisms in economics. First, we formally show that when the game is not zero-sum and the vanilla Stackelberg commitment is mixed, it is not robust to observational uncertainty. We propose observation-robust, polynomial-time-computable commitment constructions for leader strategies that approximate the Stackelberg payoff, and also show that these commitment rules approximate the maximum obtainable payoff (which could in general be greater than the Stackelberg payoff). △ Less

Submitted 27 May, 2019; originally announced May 2019.

Comments: 29 pages, extended abstract at ACM Economics and Computation 2019

OSOM: A simultaneously optimal algorithm for multi-armed and linear contextual bandits

Authors: Niladri S. Chatterji, Vidya Muthukumar, Peter L. Bartlett

Abstract: We consider the stochastic linear (multi-armed) contextual bandit problem with the possibility of hidden simple multi-armed bandit structure in which the rewards are independent of the contextual information. Algorithms that are designed solely for one of the regimes are known to be sub-optimal for the alternate regime. We design a single computationally efficient algorithm that simultaneously obt… ▽ More We consider the stochastic linear (multi-armed) contextual bandit problem with the possibility of hidden simple multi-armed bandit structure in which the rewards are independent of the contextual information. Algorithms that are designed solely for one of the regimes are known to be sub-optimal for the alternate regime. We design a single computationally efficient algorithm that simultaneously obtains problem-dependent optimal regret rates in the simple multi-armed bandit regime and minimax optimal regret rates in the linear contextual bandit regime, without knowing a priori which of the two models generates the rewards. These results are proved under the condition of stochasticity of contextual information over multiple rounds. Our results should be viewed as a step towards principled data-dependent policy class selection for contextual bandits. △ Less

Submitted 5 October, 2020; v1 submitted 24 May, 2019; originally announced May 2019.

Harmless interpolation of noisy data in regression

Authors: Vidya Muthukumar, Kailas Vodrahalli, Vignesh Subramanian, Anant Sahai

Abstract: A continuing mystery in understanding the empirical success of deep neural networks is their ability to achieve zero training error and generalize well, even when the training data is noisy and there are more parameters than data points. We investigate this overparameterized regime in linear regression, where all solutions that minimize training error interpolate the data, including noise. We char… ▽ More A continuing mystery in understanding the empirical success of deep neural networks is their ability to achieve zero training error and generalize well, even when the training data is noisy and there are more parameters than data points. We investigate this overparameterized regime in linear regression, where all solutions that minimize training error interpolate the data, including noise. We characterize the fundamental generalization (mean-squared) error of any interpolating solution in the presence of noise, and show that this error decays to zero with the number of features. Thus, overparameterization can be explicitly beneficial in ensuring harmless interpolation of noise. We discuss two root causes for poor generalization that are complementary in nature -- signal "bleeding" into a large number of alias features, and overfitting of noise by parsimonious feature selectors. For the sparse linear model with noise, we provide a hybrid interpolating scheme that mitigates both these issues and achieves order-optimal MSE over all possible interpolating solutions. △ Less

Submitted 9 September, 2019; v1 submitted 21 March, 2019; originally announced March 2019.

Comments: 52 pages, expanded version of the paper presented at ITA in San Diego in Feb 2019, ISIT in Paris in July 2019, at Simons in July, and as a plenary at ITW in Visby in August 2019

Understanding Unequal Gender Classification Accuracy from Face Images

Authors: Vidya Muthukumar, Tejaswini Pedapati, Nalini Ratha, Prasanna Sattigeri, Chai-Wah Wu, Brian Kingsbury, Abhishek Kumar, Samuel Thomas, Aleksandra Mojsilovic, Kush R. Varshney

Abstract: Recent work shows unequal performance of commercial face classification services in the gender classification task across intersectional groups defined by skin type and gender. Accuracy on dark-skinned females is significantly worse than on any other group. In this paper, we conduct several analyses to try to uncover the reason for this gap. The main finding, perhaps surprisingly, is that skin typ… ▽ More Recent work shows unequal performance of commercial face classification services in the gender classification task across intersectional groups defined by skin type and gender. Accuracy on dark-skinned females is significantly worse than on any other group. In this paper, we conduct several analyses to try to uncover the reason for this gap. The main finding, perhaps surprisingly, is that skin type is not the driver. This conclusion is reached via stability experiments that vary an image's skin type via color-theoretic methods, namely luminance mode-shift and optimal transport. A second suspect, hair length, is also shown not to be the driver via experiments on face images cropped to exclude the hair. Finally, using contrastive post-hoc explanation techniques for neural networks, we bring forth evidence suggesting that differences in lip, eye and cheek structure across ethnicity lead to the differences. Further, lip and eye makeup are seen as strong predictors for a female face, which is a troubling propagation of a gender stereotype. △ Less

Submitted 30 November, 2018; originally announced December 2018.

Best of many worlds: Robust model selection for online supervised learning

Authors: Vidya Muthukumar, Mitas Ray, Anant Sahai, Peter L. Bartlett

Abstract: We introduce algorithms for online, full-information prediction that are competitive with contextual tree experts of unknown complexity, in both probabilistic and adversarial settings. We show that by incorporating a probabilistic framework of structural risk minimization into existing adaptive algorithms, we can robustly learn not only the presence of stochastic structure when it exists (leading… ▽ More We introduce algorithms for online, full-information prediction that are competitive with contextual tree experts of unknown complexity, in both probabilistic and adversarial settings. We show that by incorporating a probabilistic framework of structural risk minimization into existing adaptive algorithms, we can robustly learn not only the presence of stochastic structure when it exists (leading to constant as opposed to $\mathcal{O}(\sqrt{T})$ regret), but also the correct model order. We thus obtain regret bounds that are competitive with the regret of an optimal algorithm that possesses strong side information about both the complexity of the optimal contextual tree expert and whether the process generating the data is stochastic or adversarial. These are the first constructive guarantees on simultaneous adaptivity to the model and the presence of stochasticity. △ Less

Submitted 22 May, 2018; originally announced May 2018.

Comments: 33 pages, 5 figures

Worst-case vs Average-case Design for Estimation from Fixed Pairwise Comparisons

Authors: Ashwin Pananjady, Cheng Mao, Vidya Muthukumar, Martin J. Wainwright, Thomas A. Courtade

Abstract: Pairwise comparison data arises in many domains, including tournament rankings, web search, and preference elicitation. Given noisy comparisons of a fixed subset of pairs of items, we study the problem of estimating the underlying comparison probabilities under the assumption of strong stochastic transitivity (SST). We also consider the noisy sorting subclass of the SST model. We show that when th… ▽ More Pairwise comparison data arises in many domains, including tournament rankings, web search, and preference elicitation. Given noisy comparisons of a fixed subset of pairs of items, we study the problem of estimating the underlying comparison probabilities under the assumption of strong stochastic transitivity (SST). We also consider the noisy sorting subclass of the SST model. We show that when the assignment of items to the topology is arbitrary, these permutation-based models, unlike their parametric counterparts, do not admit consistent estimation for most comparison topologies used in practice. We then demonstrate that consistent estimation is possible when the assignment of items to the topology is randomized, thus establishing a dichotomy between worst-case and average-case designs. We propose two estimators in the average-case setting and analyze their risk, showing that it depends on the comparison topology only through the degree sequence of the topology. The rates achieved by these estimators are shown to be optimal for a large class of graphs. Our results are corroborated by simulations on multiple comparison topologies. △ Less

Submitted 19 July, 2017; originally announced July 2017.

Gutzwiller-RVB Theory of High Temperature Superconductivity: Results from Renormalised Mean Field Theory and Variational Monte Carlo Calculations

Authors: B. Edegger, V. N. Muthukumar, C. Gros

Abstract: We review the Resonating Valence Bond (RVB) theory of high temperatur e superconductivity using Gutzwiller projected wave functions that incorporate strong correlations. After a general overview of the phenomenon of high temperature superconductivity, we discuss Anderson's RVB picture and its implementation by renormalised mean field theory (RMFT) and variational Monte Carlo (VMC) techniques. We… ▽ More We review the Resonating Valence Bond (RVB) theory of high temperatur e superconductivity using Gutzwiller projected wave functions that incorporate strong correlations. After a general overview of the phenomenon of high temperature superconductivity, we discuss Anderson's RVB picture and its implementation by renormalised mean field theory (RMFT) and variational Monte Carlo (VMC) techniques. We review RMFT and VMC results with an emphasis on recent development s in extending VMC and RMFT techniques to excited states. We compare results obtained from these methods with angle resolved photoemission spectroscopy (ARPES) and scanning tunnelling microscopy (STM). We conclude by summarising recent successes of this approach and discuss open problems that need to be solved for a consistent and complete description of high temperature superconductivity using Gutzwiller projected wave functions. △ Less

Submitted 6 July, 2007; originally announced July 2007.

Comments: Review, Adv. Phys. (in press)

Journal ref: Advances in Physics, Volume 56, 927 (2007).

Spontaneous breaking of the Fermi surface symmetry in the t-J model: a numerical study

Authors: Bernhard Edegger, V. N. Muthukumar, Claudius Gros

Abstract: We present a variational Monte Carlo (VMC) study of spontaneous Fermi surface symmetry breaking in the t-J model. We find that the variational energy of a Gutzwiller projected Fermi sea is lowered by allowing for a finite asymmetry between the x- and the y-directions. However, the best variational state remains a pure superconducting state with d-wave symmetry, as long as the underlying lattice… ▽ More We present a variational Monte Carlo (VMC) study of spontaneous Fermi surface symmetry breaking in the t-J model. We find that the variational energy of a Gutzwiller projected Fermi sea is lowered by allowing for a finite asymmetry between the x- and the y-directions. However, the best variational state remains a pure superconducting state with d-wave symmetry, as long as the underlying lattice is isotropic. Our VMC results are in good overall agreement with slave boson mean field theory (SBMFT) and renormalized mean field theory (RMFT), although apparent discrepancies do show up in the half-filled limit, revealing some limitations of mean field theories. VMC and complementary RMFT calculations also confirm the SBMFT predictions that many-body interactions can enhance any anisotropy in the underlying crystal lattice. Thus, our results may be of consequence for the description of strongly correlated superconductors with an anisotropic lattice structure. △ Less

Submitted 20 October, 2006; v1 submitted 17 September, 2006; originally announced September 2006.

Comments: 6 pages, 7 figures; final version

Journal ref: Phys. Rev. B 74, 165109 (2006)

Determining the underlying Fermi surface of strongly correlated superconductors

Authors: Claudius Gros, Bernhard Edegger, V. N. Muthukumar, P. W. Anderson

Abstract: The notion of a Fermi surface (FS) is one of the most ingenious concepts developed by solid state physicists during the past century. It plays a central role in our understanding of interacting electron systems. Extraordinary efforts have been undertaken, both by experiment and by theory, to reveal the FS of the high temperature superconductors (HTSC), the most prominent strongly correlated supe… ▽ More The notion of a Fermi surface (FS) is one of the most ingenious concepts developed by solid state physicists during the past century. It plays a central role in our understanding of interacting electron systems. Extraordinary efforts have been undertaken, both by experiment and by theory, to reveal the FS of the high temperature superconductors (HTSC), the most prominent strongly correlated superconductors. Here, we discuss some of the prevalent methods used to determine the FS and show that they lead generally to erroneous results close to half filling and at low temperatures, due to the large superconducting gap (pseudogap) below (above) the superconducting transition temperature. Our findings provide a perspective on the interplay between strong correlations and superconductivity and highlight the importance of strong coupling theories for the characterization as well as the determination of the underlying FS in ARPES experiments. △ Less

Submitted 29 June, 2006; originally announced June 2006.

Journal ref: PNAS 103, 14298-14301 (2006)

Electronic structure of strongly correlated d-wave superconductors

Authors: Bernhard Edegger, V. N. Muthukumar, Claudius Gros, P. W. Anderson

Abstract: We study the electronic structure of a strongly correlated d-wave superconducting state. Combining a renormalized mean field theory with direct calculation of matrix elements, we obtain explicit analytical results for the nodal Fermi velocity, v_F, the Fermi wave vector, k_F, and the momentum distribution, n_k, as a function of hole do** in a Gutzwiller projected d-wave superconductor. We calc… ▽ More We study the electronic structure of a strongly correlated d-wave superconducting state. Combining a renormalized mean field theory with direct calculation of matrix elements, we obtain explicit analytical results for the nodal Fermi velocity, v_F, the Fermi wave vector, k_F, and the momentum distribution, n_k, as a function of hole do** in a Gutzwiller projected d-wave superconductor. We calculate the energy dispersion, E_k, and spectral weight of the Gutzwiller-Bogoliubov quasiparticles, and find that the spectral weight associated with the quasiparticle excitation at the antinodal point shows a non monotonic behavior as a function of do**. Results are compared to angle resolved photoemission spectroscopy (ARPES) of the high temperature superconductors. △ Less

Submitted 24 May, 2006; v1 submitted 25 December, 2005; originally announced December 2005.

Comments: final version, comparison to experiments added, 4+ pages, 4 figures

Journal ref: Phys. Rev. Lett. 96, 207002 (2006)

Particle number renormalization in almost half filled Mott Hubbard superconductors

Authors: Bernhard Edegger, Noboru Fukushima, Claudius Gros, V. N. Muthukumar

Abstract: The effects of the Gutzwiller projection on a BCS wave function with varying particle number are considered. We show that a fugacity factor has to be introduced in these wave functions when they are Gutzwiller projected, and derive an expression for this factor within the Gutzwiller approximation. We examine the effects of the projection operator on BCS wave functions by calculating the average… ▽ More The effects of the Gutzwiller projection on a BCS wave function with varying particle number are considered. We show that a fugacity factor has to be introduced in these wave functions when they are Gutzwiller projected, and derive an expression for this factor within the Gutzwiller approximation. We examine the effects of the projection operator on BCS wave functions by calculating the average number of particles before and after projection. We also calculate particle number fluctuations in a projected BCS state. Finally, we point out the differences between projecting BCS wave functions in the canonical and grand canonical schemes, and discuss the relevance of our results for variational Monte Carlo studies. △ Less

Submitted 12 December, 2005; v1 submitted 5 June, 2005; originally announced June 2005.

Comments: 10 pages, 5 figures

Journal ref: Phys. Rev. B 72, 134504 (2005)

On the evaluation of matrix elements in partially projected wave functions

Authors: N. Fukushima, B. Edegger, V. N. Muthukumar, C. Gros

Abstract: We generalize the Gutzwiller approximation scheme to the calculation of nontrivial matrix elements between the ground state and excited states. In our scheme, the normalization of the Gutzwiller wave function relative to a partially projected wave function with a single non projected site (the reservoir site) plays a key role. For the Gutzwiller projected Fermi sea, we evaluate the relative norm… ▽ More We generalize the Gutzwiller approximation scheme to the calculation of nontrivial matrix elements between the ground state and excited states. In our scheme, the normalization of the Gutzwiller wave function relative to a partially projected wave function with a single non projected site (the reservoir site) plays a key role. For the Gutzwiller projected Fermi sea, we evaluate the relative normalization both analytically and by variational Monte-Carlo (VMC). We also report VMC results for projected superconducting states that show novel oscillations in the hole density near the reservoir site. △ Less

Submitted 7 March, 2005; originally announced March 2005.

Journal ref: Phys. Rev. B, 72, 144505 (2005)

Bosonic resonating valence bond wave function for doped Mott insulators

Authors: Z. Y. Weng, Y. Zhou, V. N. Muthukumar

Abstract: We propose a new class of ground states for doped Mott insulators in the electron second-quantization representation. They are obtained from a bosonic resonating valence bond (RVB) theory of the t-J model. At half filling, the ground state describes spin correlations of the S=1/2 Heisenberg model very accurately. Its spin degrees of freedom are characterized by RVB pairing of spins, the size of… ▽ More We propose a new class of ground states for doped Mott insulators in the electron second-quantization representation. They are obtained from a bosonic resonating valence bond (RVB) theory of the t-J model. At half filling, the ground state describes spin correlations of the S=1/2 Heisenberg model very accurately. Its spin degrees of freedom are characterized by RVB pairing of spins, the size of which decreases continuously as holes are doped into the system. Charge degrees of freedom emerge upon do** and are described by twisted holes in the RVB background. We show that the twisted holes exhibit an off diagonal long range order (ODLRO) in the pseudogap ground state, which has a finite pairing amplitude, but is short of phase coherence. Unpaired spins in such a pseudogap ground state behave as free vortices, preventing superconducting phase coherence. The existence of nodal quasiparticles is also ensured by such a hidden ODLRO in the ground state, which is non-Fermi-liquid-like in the absence of superconducting phase coherence. Two distinct types of spin excitations can also be constructed. The superconducting instability of the pseudogap ground state is discussed and a d-wave superconducting ground state is obtained. This class of pseudogap and superconducting ground states unifies antiferromagnetism, pseudogap, superconductivity, and Mott physics into a new state of matter. △ Less

Submitted 7 June, 2005; v1 submitted 24 February, 2005; originally announced February 2005.

Comments: 28 pages, 5 figures, final version to appear in Phys. Rev. B

Journal ref: Physical Review B 72, 014503 (2005)

Antiferromagnetism and d-wave superconductivity in (doped) Mott insulators: A wave function approach

Authors: Z. Y. Weng, Y. Zhou, V. N. Muthukumar

Abstract: We propose a class of wave functions that provide a unified description of antiferromagnetism and d-wave superconductivity in (doped) Mott insulators. The wave function has a Jastrow form and prohibits double occupancies. In the absence of holes, the wave function describes antiferromagnetism accurately. Off diagonal long range order develops at finite do** and the superconducting order parame… ▽ More We propose a class of wave functions that provide a unified description of antiferromagnetism and d-wave superconductivity in (doped) Mott insulators. The wave function has a Jastrow form and prohibits double occupancies. In the absence of holes, the wave function describes antiferromagnetism accurately. Off diagonal long range order develops at finite do** and the superconducting order parameter has d-wave symmetry. We also show how nodal quasiparticles and neutral spin excitations can be constructed from this wave function. △ Less

Submitted 25 February, 2005; v1 submitted 17 April, 2003; originally announced April 2003.

Comments: This paper has been withdrawn by the authors. Its correct version has been included as a part of a more comprehensive paper in cond-mat/0502601

Entanglement of a qubit with a single oscillator mode

Authors: G. C. Levine, V. N. Muthukumar

Abstract: We solve a model of a qubit strongly coupled to a massive environmental oscillator mode where the qubit backaction is treated exactly. Using a Ginzburg-Landau formalism, we derive an effective action for this well known localization transition. An entangled state emerges as an instanton in the collective qubit-environment degree of freedom and the resulting model is shown to be formally equivale… ▽ More We solve a model of a qubit strongly coupled to a massive environmental oscillator mode where the qubit backaction is treated exactly. Using a Ginzburg-Landau formalism, we derive an effective action for this well known localization transition. An entangled state emerges as an instanton in the collective qubit-environment degree of freedom and the resulting model is shown to be formally equivalent to a Fluctuating Gap Model (FGM) of a disordered Peierls chain. Below the transition, spectral weight is transferred to an exponentially small energy scale leaving the qubit coherent but damped. Unlike the spin-boson model, coherent and effectively localized behaviors may coexist. △ Less

Submitted 15 September, 2003; v1 submitted 23 January, 2003; originally announced January 2003.

Comments: 4 pages, 1 figure; added calculation of entanglement entropy

Journal ref: Phys. Rev. B 69, 113203 (2004).

Quasiparticles as composite objects in the RVB superconductor

Authors: Yi Zhou, V. N. Muthukumar, Zheng-Yu Weng

Abstract: We study the nature of the superconducting state, the origin of d-wave pairing, and elementary excitations of a resonating valence bond (RVB) superconductor. We show that the phase string formulation of the t-J model leads to confinement of bare spinon and holon excitations in the superconducting state, though the vacuum is described by the RVB state. Nodal quasiparticles are obtained as composi… ▽ More We study the nature of the superconducting state, the origin of d-wave pairing, and elementary excitations of a resonating valence bond (RVB) superconductor. We show that the phase string formulation of the t-J model leads to confinement of bare spinon and holon excitations in the superconducting state, though the vacuum is described by the RVB state. Nodal quasiparticles are obtained as composite excitations of spinon and holon excitations. The d-wave pairing symmetry is shown to arise from short range antiferromagnetic correlations. △ Less

Submitted 1 August, 2002; originally announced August 2002.

Journal ref: Phys. Rev. B67, 064512 (2003).

Spontaneous Vortex Phase in the Bosonic RVB Theory

Authors: Z. Y. Weng, V. N. Muthukumar

Abstract: In the description of spin-charge separation based on the phase string theory of the t-J model, spinon excitations are vortices in the superconducting state. Thermally excited spinons destroy phase coherence, leading to a new phase characterized by the presence of free spinon vortices at temperatures, T_c<T<T_v. The temperature scale T_v at which holon condensation occurs marks the onset of pair… ▽ More In the description of spin-charge separation based on the phase string theory of the t-J model, spinon excitations are vortices in the superconducting state. Thermally excited spinons destroy phase coherence, leading to a new phase characterized by the presence of free spinon vortices at temperatures, T_c<T<T_v. The temperature scale T_v at which holon condensation occurs marks the onset of pairing amplitude, and is related to the spin pseudogap temperature T^*. The phase below T_v, called the spontaneous vortex phase, shows novel transport properties before phase coherence sets in at T_c. We discuss the Nernst effect as an intrinsic characterization of such a phase, in comparison with recent experimental measurements. △ Less

Submitted 5 February, 2002; originally announced February 2002.

Comments: 9 pages, 3 figures embedded

Ginzburg-Landau theory of an RVB superconductor

Authors: V. N. Muthukumar, Z. Y. Weng

Abstract: We present a Ginzburg-Landau formulation of the bosonic resonating valence bond (RVB) theory of superconductivity. The superconducting order parameter is characterized by phase vortices that describe spinon excitations and the transition to the superconducting state occurs when such phase vortices (un)bind. We show that the boson RVB theory always leads to hc/2e flux quanta and that the presence… ▽ More We present a Ginzburg-Landau formulation of the bosonic resonating valence bond (RVB) theory of superconductivity. The superconducting order parameter is characterized by phase vortices that describe spinon excitations and the transition to the superconducting state occurs when such phase vortices (un)bind. We show that the boson RVB theory always leads to hc/2e flux quanta and that the presence of a trapped spin-1/2 moment inside a vortex core gives rise to observable consequences for the low temperature field dependent specific heat. We also show that the cores of magnetic fluxoids exhibit enhanced antiferromagnetic correlations. △ Less

Submitted 18 December, 2001; originally announced December 2001.

Comments: 4 figures as ps files

Journal ref: Phys. Rev. B65, 174511 (2002)

Spectral function of the electron in a superconducting RVB state

Authors: V. N. Muthukumar, Z. Y. Weng, D. N. Sheng

Abstract: We present a model calculation of the spectral function of an electron in a superconducting resonating valence bond (RVB) state. The RVB state, described by the phase-string mean field theory is characterized by three important features: (i) spin-charge separation, (ii) short range antiferromagnetic correlations, and (iii) holon condensation. The results of our calculation are in good agreement… ▽ More We present a model calculation of the spectral function of an electron in a superconducting resonating valence bond (RVB) state. The RVB state, described by the phase-string mean field theory is characterized by three important features: (i) spin-charge separation, (ii) short range antiferromagnetic correlations, and (iii) holon condensation. The results of our calculation are in good agreement with data obtained from Angle Resolved Photoemission Spectroscopy (ARPES) in superconducting Bi 2212 at optimal do** concentration. △ Less

Submitted 12 June, 2001; originally announced June 2001.

Comments: 4 pages, 3 figures

Localization transition in the Mermin model

Authors: Gregory Levine, V. N. Muthukumar

Abstract: We study the dynamical properties of the Mermin model, a simple quantum dissipative model with a monochromatic environment, using analytical and numerical methods. Our numerical results show that the model exhibits a second order phase transition to a localized state before which the system is effectively decoupled from the environment. In contrast to the spin-boson model, the Mermin model exhib… ▽ More We study the dynamical properties of the Mermin model, a simple quantum dissipative model with a monochromatic environment, using analytical and numerical methods. Our numerical results show that the model exhibits a second order phase transition to a localized state before which the system is effectively decoupled from the environment. In contrast to the spin-boson model, the Mermin model exhibits an ``orthogonality catastrophe,'' defining the critical point, before dissipation has destroyed all coherent behavior. An analytic approach based on the Liouvillian technique, though successful in describing the phase diagram of spin-boson and related models, fails to capture this essential feature of the Mermin model. △ Less

Submitted 5 March, 2001; originally announced March 2001.

Comments: REVTeX, 6 pages, 3 eps figures

Nature of Spin Excitations in Two-dimensional Mott Insulators: Undoped Cuprates and Other Materials

Authors: Chang-Ming Ho, V. N. Muthukumar, Masao Ogata, P. W. Anderson

Abstract: We investigate the excitation spectrum of a two-dimensional resonating valence bond (RVB) state. Treating the $pi$-flux phase with antiferromagnetic correlations as a variational ground state, we recover the long wavelength magnon as an "RVB exciton". However, we find that this excitation does NOT exhaust the entire spectral weight and the high energy spectrum is dominated by fermionic excitatio… ▽ More We investigate the excitation spectrum of a two-dimensional resonating valence bond (RVB) state. Treating the $pi$-flux phase with antiferromagnetic correlations as a variational ground state, we recover the long wavelength magnon as an "RVB exciton". However, we find that this excitation does NOT exhaust the entire spectral weight and the high energy spectrum is dominated by fermionic excitations. The latter can be observed directly by inelastic neutron scattering and we predict their characteristic energy scales along different high symmetry directions in the magnetic Brillouin zone. We also interpret experimental results on two magnon Raman scattering and mid-infrared absorption within this scenario. △ Less

Submitted 19 February, 2001; v1 submitted 19 January, 2001; originally announced January 2001.

Comments: Minor corrections in the text and references to match the form as appeared in Phys. Rev. Lett. 86, 1626 (2001)

Spin-charge separation in the single hole doped Mott antiferromagnet

Authors: Z. Y. Weng, V. N. Muthukumar, D. N. Sheng, C. S. Ting

Abstract: The motion of a single hole in a Mott antiferromagnet is investigated based on the t-J model. An exact expression of the energy spectrum is obtained, in which the irreparable phase string effect [Phys. Rev. Lett. 77, 5102 (1996)] is explicitly present. By identifying the phase string effect with spin backflow, we point out that spin-charge separation must exist in such a system: the doped hole h… ▽ More The motion of a single hole in a Mott antiferromagnet is investigated based on the t-J model. An exact expression of the energy spectrum is obtained, in which the irreparable phase string effect [Phys. Rev. Lett. 77, 5102 (1996)] is explicitly present. By identifying the phase string effect with spin backflow, we point out that spin-charge separation must exist in such a system: the doped hole has to decay into a neutral spinon and a spinless holon, together with the phase string. We show that while the spinon remains coherent, the holon motion is deterred by the phase string, resulting in its localization in space. We calculate the electron spectral function which explains the line shape of the spectral function as well as the ``quasiparticle'' spectrum observed in angle-resolved photoemission experiments. Other analytic and numerical approaches are discussed based on the present framework. △ Less

Submitted 18 October, 2000; v1 submitted 23 August, 2000; originally announced August 2000.

Comments: 16 pages, 9 figures; references updated; to appear in Phys. Rev. B

Charge Transport in Synthetic Metals

Authors: V. J. Emery, S. A. Kivelson, V. N. Muthukumar

Abstract: The phenomenology of charge transport in synthetic metals is reviewed. It is argued that the conventional quasiparticle picture and Boltzmann transport theory do not apply to these materials. The central ideas of Fermi liquid theory are reviewed, and the significant corrections produced by quasiparticle scattering from ferromagnetic spin fluctuations in liquid $^3$He are described. It is shown t… ▽ More The phenomenology of charge transport in synthetic metals is reviewed. It is argued that the conventional quasiparticle picture and Boltzmann transport theory do not apply to these materials. The central ideas of Fermi liquid theory are reviewed, and the significant corrections produced by quasiparticle scattering from ferromagnetic spin fluctuations in liquid $^3$He are described. It is shown that Sr$_2$RuO$_4$ does not display the symptoms of a nearly-ferromagnetic Fermi liquid, so the source of its odd angular momentum pairing remains to be understood. The solution of an assisted-tunneling model of charge transport in quasi-one dimensional materials is described. This model has a quantum critical point and gives a resistivity that is linear in temperature or frequency, whichever is greater. △ Less

Submitted 25 January, 1999; originally announced January 1999.

Comments: 8 pages latex: for the Proceedings of "Physical Phenomena in High Magnetic Fields, III. Tallahassee, 1998"

Novel Nonreciprocal Acoustic Effects in Antiferromagnets

Authors: Roser Valenti, Claudius Gros, V. N. Muthukumar

Abstract: The possible occurrence of nonreciprocal acoustic effects in antiferromagnets in the absence of an external magnetic field is investigated using both (i) a microscopic formulation of the magnetoelastic interaction between spins and phonons and (ii) symmetry arguments. We predict for certain antiferromagnets the existence of two new nonreciprocal (non-time invariant) effects: A boundary-conditio… ▽ More The possible occurrence of nonreciprocal acoustic effects in antiferromagnets in the absence of an external magnetic field is investigated using both (i) a microscopic formulation of the magnetoelastic interaction between spins and phonons and (ii) symmetry arguments. We predict for certain antiferromagnets the existence of two new nonreciprocal (non-time invariant) effects: A boundary-condition induced nonreciprocal effect and the occurrence of transversal phonon modes propagating in opposite directions having different velocities. Estimates are given and possible materials for these effects to be observed are suggested. △ Less

Submitted 23 November, 1998; originally announced November 1998.

Comments: Euro. Phys. Lett. (in press)

Journal ref: Europhys. Lett., Vol. 45, 242 1999

The J_1-J_2 model revisited : Phenomenology of CuGeO_3

Authors: V. N. Muthukumar, Claudius Gros, Roser Valenti, M. Weiden, C. Geibel, F. Steglich, P. Lemmens, M. Fischer, G. Güntherodt

Abstract: We present a mean field solution of the antiferromagnetic Heisenberg chain with nearest (J_1) and next to nearest neighbor (J_2) interactions. This solution provides a way to estimate the effects of frustration. We calculate the temperature-dependent spin-wave velocity, v_s(T) and discuss the possibility to determine the magnitude of frustration J_2/J_1 present in quasi 1D compounds from measure… ▽ More We present a mean field solution of the antiferromagnetic Heisenberg chain with nearest (J_1) and next to nearest neighbor (J_2) interactions. This solution provides a way to estimate the effects of frustration. We calculate the temperature-dependent spin-wave velocity, v_s(T) and discuss the possibility to determine the magnitude of frustration J_2/J_1 present in quasi 1D compounds from measurements of v_s(T). We compute the thermodynamic susceptibility at finite temperatures and compare it with the observed susceptibility of the spin-Peierls compound CuGeO_3. We also use the method to study the two-magnon Raman continuum observed in CuGeO_3 above the spin-Peierls transition. △ Less

Submitted 4 November, 1996; originally announced November 1996.

Comments: Phys. Rev. B

Journal ref: Phys. Rev. B, Vol. 55, p5944 (1997)

Frustration induced Raman scattering in CuGeO_3

Authors: V. N. Muthukumar, Claudius Gros, Wolfgang Wenzel, Roser Valenti, P. Lemmens, B. Eisener, G. Güntherodt, M. Weiden, C. Geibel, F. Steglich

Abstract: We present experimental data for the Raman intensity in the spin-Peierls compound CuGeO_3 and theoretical calculations from a one-dimensional frustrated spin model. The theory is based on (a) exact diagonalization and (b) a recently developed solitonic mean field theory. We find good agreement between the 1D-theory in the homogeneous phase and evidence for a novel dimerization of the Raman opera… ▽ More We present experimental data for the Raman intensity in the spin-Peierls compound CuGeO_3 and theoretical calculations from a one-dimensional frustrated spin model. The theory is based on (a) exact diagonalization and (b) a recently developed solitonic mean field theory. We find good agreement between the 1D-theory in the homogeneous phase and evidence for a novel dimerization of the Raman operator in the spin-Peierls state. Finally we present evidence for a coupling between the interchain exchange, the spin-Peierls order parameter and the magnetic excitations along the chains. △ Less

Submitted 23 August, 1996; originally announced August 1996.

Comments: Phys. Rev. B, Rapid Comm, in Press

Journal ref: Phys. Rev. B, Vol.54, R9635 (1996)

Theory of Non-Reciprocal Optical Effects in Antiferromagnets: The Case Cr_2O_3

Authors: V. N. Muthukumar, Roser Valenti, Claudius Gros

Abstract: A microscopic model of non-reciprocal optical effects in antiferromagnets is developed by considering the case of Cr_2O_3 where such effects have been observed. These effects are due to a direct coupling between light and the antiferromagnetic order parameter. This coupling is mediated by the spin-orbit interaction and involves an interplay between the breaking of inversion symmetry due to the a… ▽ More A microscopic model of non-reciprocal optical effects in antiferromagnets is developed by considering the case of Cr_2O_3 where such effects have been observed. These effects are due to a direct coupling between light and the antiferromagnetic order parameter. This coupling is mediated by the spin-orbit interaction and involves an interplay between the breaking of inversion symmetry due to the antiferromagnetic order parameter and the trigonal field contribution to the ligand field at the magnetic ion. We evaluate the matrix elements relevant for the non-reciprocal second harmonic generation and gyrotropic birefringence. △ Less

Submitted 29 February, 1996; v1 submitted 29 February, 1996; originally announced February 1996.

Comments: accepted for publication in Phys. Rev. B

Journal ref: Phys. Rev. B, Vol.54, 433 (1996)