Showing 1–31 of 31 results for author: Syed, U

Lexicographic Optimization: Algorithms and Stability

Authors: Jacob Abernethy, Robert E. Schapire, Umar Syed

Abstract: A lexicographic maximum of a set $X \subseteq \mathbb{R}^n$ is a vector in $X$ whose smallest component is as large as possible, and subject to that requirement, whose second smallest component is as large as possible, and so on for the third smallest component, etc. Lexicographic maximization has numerous practical and theoretical applications, including fair resource allocation, analyzing the im… ▽ More A lexicographic maximum of a set $X \subseteq \mathbb{R}^n$ is a vector in $X$ whose smallest component is as large as possible, and subject to that requirement, whose second smallest component is as large as possible, and so on for the third smallest component, etc. Lexicographic maximization has numerous practical and theoretical applications, including fair resource allocation, analyzing the implicit regularization of learning algorithms, and characterizing refinements of game-theoretic equilibria. We prove that a minimizer in $X$ of the exponential loss function $L_c(\mathbf{x}) = \sum_i \exp(-c x_i)$ converges to a lexicographic maximum of $X$ as $c \rightarrow \infty$, provided that $X$ is stable in the sense that a well-known iterative method for finding a lexicographic maximum of $X$ cannot be made to fail simply by reducing the required quality of each iterate by an arbitrarily tiny degree. Our result holds for both near and exact minimizers of the exponential loss, while earlier convergence results made much stronger assumptions about the set $X$ and only held for the exact minimizer. We are aware of no previous results showing a connection between the iterative method for computing a lexicographic maximum and exponential loss minimization. We show that every convex polytope is stable, but that there exist compact, convex sets that are not stable. We also provide the first analysis of the convergence rate of an exponential loss minimizer (near or exact) and discover a curious dichotomy: While the two smallest components of the vector converge to the lexicographically maximum values very quickly (at roughly the rate $\frac{\log n}{c}$), all other components can converge arbitrarily slowly. △ Less

Submitted 2 May, 2024; originally announced May 2024.

Capabilities of Large Language Models in Control Engineering: A Benchmark Study on GPT-4, Claude 3 Opus, and Gemini 1.0 Ultra

Authors: Darioush Kevian, Usman Syed, Xingang Guo, Aaron Havens, Geir Dullerud, Peter Seiler, Lianhui Qin, Bin Hu

Abstract: In this paper, we explore the capabilities of state-of-the-art large language models (LLMs) such as GPT-4, Claude 3 Opus, and Gemini 1.0 Ultra in solving undergraduate-level control problems. Controls provides an interesting case study for LLM reasoning due to its combination of mathematical theory and engineering design. We introduce ControlBench, a benchmark dataset tailored to reflect the bread… ▽ More In this paper, we explore the capabilities of state-of-the-art large language models (LLMs) such as GPT-4, Claude 3 Opus, and Gemini 1.0 Ultra in solving undergraduate-level control problems. Controls provides an interesting case study for LLM reasoning due to its combination of mathematical theory and engineering design. We introduce ControlBench, a benchmark dataset tailored to reflect the breadth, depth, and complexity of classical control design. We use this dataset to study and evaluate the problem-solving abilities of these LLMs in the context of control engineering. We present evaluations conducted by a panel of human experts, providing insights into the accuracy, reasoning, and explanatory prowess of LLMs in control engineering. Our analysis reveals the strengths and limitations of each LLM in the context of classical control, and our results imply that Claude 3 Opus has become the state-of-the-art LLM for solving undergraduate control problems. Our study serves as an initial step towards the broader goal of employing artificial general intelligence in control engineering. △ Less

Submitted 4 April, 2024; originally announced April 2024.

Assessing Web Fingerprinting Risk

Authors: Enrico Bacis, Igor Bilogrevic, Robert Busa-Fekete, Asanka Herath, Antonio Sartori, Umar Syed

Abstract: Modern Web APIs allow developers to provide extensively customized experiences for website visitors, but the richness of the device information they provide also make them vulnerable to being abused to construct browser fingerprints, device-specific identifiers that enable covert tracking of users even when cookies are disabled. Previous research has established entropy, a measure of information… ▽ More Modern Web APIs allow developers to provide extensively customized experiences for website visitors, but the richness of the device information they provide also make them vulnerable to being abused to construct browser fingerprints, device-specific identifiers that enable covert tracking of users even when cookies are disabled. Previous research has established entropy, a measure of information, as the key metric for quantifying fingerprinting risk. However, earlier studies had two major limitations. First, their entropy estimates were based on either a single website or a very small sample of devices. Second, they did not adequately consider correlations among different Web APIs, potentially grossly overestimating their fingerprinting risk. We provide the first study of browser fingerprinting which addresses the limitations of prior work. Our study is based on actual visited pages and Web APIs reported by tens of millions of real Chrome browsers in-the-wild. We accounted for the dependencies and correlations among Web APIs, which is crucial for obtaining more realistic entropy estimates. We also developed a novel experimental design that accurately and efficiently estimates entropy while never observing too much information from any single user. Our results provide an understanding of the distribution of entropy for different website categories, confirm the utility of entropy as a fingerprinting proxy, and offer a method for evaluating browser enhancements which are intended to mitigate fingerprinting. △ Less

Submitted 22 March, 2024; originally announced March 2024.

Comments: A version of this report to appear in the proceedings of The Web Conference (WWW) 2024. This version contains additional material in the appendix

DP-Auditorium: a Large Scale Library for Auditing Differential Privacy

Authors: William Kong, Andrés Muñoz Medina, Mónica Ribero, Umar Syed

Abstract: New regulations and increased awareness of data privacy have led to the deployment of new and more efficient differentially private mechanisms across public institutions and industries. Ensuring the correctness of these mechanisms is therefore crucial to ensure the proper protection of data. However, since differential privacy is a property of the mechanism itself, and not of an individual output,… ▽ More New regulations and increased awareness of data privacy have led to the deployment of new and more efficient differentially private mechanisms across public institutions and industries. Ensuring the correctness of these mechanisms is therefore crucial to ensure the proper protection of data. However, since differential privacy is a property of the mechanism itself, and not of an individual output, testing whether a mechanism is differentially private is not a trivial task. While ad hoc testing techniques exist under specific assumptions, no concerted effort has been made by the research community to develop a flexible and extendable tool for testing differentially private mechanisms. This paper introduces DP-Auditorium as a step advancing research in this direction. DP-Auditorium abstracts the problem of testing differential privacy into two steps: (1) measuring the distance between distributions, and (2) finding neighboring datasets where a mechanism generates output distributions maximizing such distance. From a technical point of view, we propose three new algorithms for evaluating the distance between distributions. While these algorithms are well-established in the statistics community, we provide new estimation guarantees that exploit the fact that we are only interested in verifying whether a mechanism is differentially private, and not in obtaining an exact estimate of the distance between two distributions. DP-Auditorium is easily extensible, as demonstrated in this paper by implementing a well-known approximate differential privacy testing algorithm into our library. We provide an extensive comparison to date of multiple testers across varying sample sizes and differential privacy parameters, demonstrating that there is no single tester that dominates all others, and that a combination of different techniques is required to ensure proper testing of mechanisms. △ Less

Submitted 18 December, 2023; v1 submitted 10 July, 2023; originally announced July 2023.

Harnessing large-language models to generate private synthetic text

Authors: Alexey Kurakin, Natalia Ponomareva, Umar Syed, Liam MacDermed, Andreas Terzis

Abstract: Differentially private training algorithms like DP-SGD protect sensitive training data by ensuring that trained models do not reveal private information. An alternative approach, which this paper studies, is to use a sensitive dataset to generate synthetic data that is differentially private with respect to the original data, and then non-privately training a model on the synthetic data. Doing so… ▽ More Differentially private training algorithms like DP-SGD protect sensitive training data by ensuring that trained models do not reveal private information. An alternative approach, which this paper studies, is to use a sensitive dataset to generate synthetic data that is differentially private with respect to the original data, and then non-privately training a model on the synthetic data. Doing so has several advantages: synthetic data can be reused for other tasks (including for hyper parameter tuning), retained indefinitely, and shared with third parties without sacrificing privacy. However, generating private synthetic data is much harder than training a private model. To improve performance on text data, recent work has utilized public data by starting with a pre-trained generative language model and privately fine-tuning it on sensitive data. This model can be used to sample a DP synthetic dataset. While this strategy seems straightforward, executing it has proven problematic. Previous approaches either show significant performance loss, or have, as we show, critical design flaws. In this paper we demonstrate that a proper training objective along with tuning fewer parameters results in excellent DP synthetic data quality. Our approach is competitive with direct DP-training of downstream classifiers in terms of performance on downstream tasks. Further, we demonstrate that our DP synthetic data is not only useful for downstream classifier training, but also to tune those same models. △ Less

Submitted 10 January, 2024; v1 submitted 2 June, 2023; originally announced June 2023.

Comments: 31 pages; 7 figures; compared to previous version added result of LoRa-finetuning

Exploiting Explainability to Design Adversarial Attacks and Evaluate Attack Resilience in Hate-Speech Detection Models

Authors: Pranath Reddy Kumbam, Sohaib Uddin Syed, Prashanth Thamminedi, Suhas Harish, Ian Perera, Bonnie J. Dorr

Abstract: The advent of social media has given rise to numerous ethical challenges, with hate speech among the most significant concerns. Researchers are attempting to tackle this problem by leveraging hate-speech detection and employing language models to automatically moderate content and promote civil discourse. Unfortunately, recent studies have revealed that hate-speech detection systems can be misled… ▽ More The advent of social media has given rise to numerous ethical challenges, with hate speech among the most significant concerns. Researchers are attempting to tackle this problem by leveraging hate-speech detection and employing language models to automatically moderate content and promote civil discourse. Unfortunately, recent studies have revealed that hate-speech detection systems can be misled by adversarial attacks, raising concerns about their resilience. While previous research has separately addressed the robustness of these models under adversarial attacks and their interpretability, there has been no comprehensive study exploring their intersection. The novelty of our work lies in combining these two critical aspects, leveraging interpretability to identify potential vulnerabilities and enabling the design of targeted adversarial attacks. We present a comprehensive and comparative analysis of adversarial robustness exhibited by various hate-speech detection models. Our study evaluates the resilience of these models against adversarial attacks using explainability techniques. To gain insights into the models' decision-making processes, we employ the Local Interpretable Model-agnostic Explanations (LIME) framework. Based on the explainability results obtained by LIME, we devise and execute targeted attacks on the text by leveraging the TextAttack tool. Our findings enhance the understanding of the vulnerabilities and strengths exhibited by state-of-the-art hate-speech detection models. This work underscores the importance of incorporating explainability in the development and evaluation of such models to enhance their resilience against adversarial attacks. Ultimately, this work paves the way for creating more robust and reliable hate-speech detection systems, fostering safer online environments and promoting ethical discourse on social media platforms. △ Less

Submitted 29 May, 2023; originally announced May 2023.

Private and Communication-Efficient Algorithms for Entropy Estimation

Authors: Gecia Bravo-Hermsdorff, Róbert Busa-Fekete, Mohammad Ghavamzadeh, Andres Muñoz Medina, Umar Syed

Abstract: Modern statistical estimation is often performed in a distributed setting where each sample belongs to a single user who shares their data with a central server. Users are typically concerned with preserving the privacy of their samples, and also with minimizing the amount of data they must transmit to the server. We give improved private and communication-efficient algorithms for estimating sever… ▽ More Modern statistical estimation is often performed in a distributed setting where each sample belongs to a single user who shares their data with a central server. Users are typically concerned with preserving the privacy of their samples, and also with minimizing the amount of data they must transmit to the server. We give improved private and communication-efficient algorithms for estimating several popular measures of the entropy of a distribution. All of our algorithms have constant communication cost and satisfy local differential privacy. For a joint distribution over many variables whose conditional independence is given by a tree, we describe algorithms for estimating Shannon entropy that require a number of samples that is linear in the number of variables, compared to the quadratic sample complexity of prior work. We also describe an algorithm for estimating Gini entropy whose sample complexity has no dependence on the support size of the distribution and can be implemented using a single round of concurrent communication between the users and the server. In contrast, the previously best-known algorithm has high communication cost and requires the server to facilitate interaction between the users. Finally, we describe an algorithm for estimating collision entropy that generalizes the best known algorithm to the private and communication-efficient setting. △ Less

Submitted 12 May, 2023; originally announced May 2023.

Comments: Originally published at the 36th Conference on Neural Information Processing Systems (NeurIPS 2022). This version corrects some errors in the original version

Bounds for the Tracking Error and Dynamic Regret of Inexact Online Optimization Methods: A General Analysis via Sequential Semidefinite Programs

Authors: Usman Syed, Emiliano Dall'Anese, Bin Hu

Abstract: In this paper, we develop a unified framework for analyzing the tracking error and dynamic regret of inexact online optimization methods under a variety of settings. Specifically, we leverage the quadratic constraint approach from control theory to formulate sequential semidefinite programs (SDPs) whose feasible points naturally correspond to tracking error bounds of various inexact online optimiz… ▽ More In this paper, we develop a unified framework for analyzing the tracking error and dynamic regret of inexact online optimization methods under a variety of settings. Specifically, we leverage the quadratic constraint approach from control theory to formulate sequential semidefinite programs (SDPs) whose feasible points naturally correspond to tracking error bounds of various inexact online optimization methods including the inexact online gradient descent (OGD) method, the online gradient descent-ascent method, the online stochastic gradient method, and the inexact proximal online gradient method. We provide exact analytical solutions for our proposed sequential SDPs, and obtain fine-grained tracking error bounds for the online algorithms studied in this paper. We also provide a simple routine to convert the obtained tracking error bounds into dynamic regret bounds. The main novelty of our analysis is that we derive exact analytical solutions for our proposed sequential SDPs under various inexact oracle assumptions in a unified manner. △ Less

Submitted 1 March, 2023; originally announced March 2023.

Statistical anonymity: Quantifying reidentification risks without reidentifying users

Authors: Gecia Bravo-Hermsdorff, Robert Busa-Fekete, Lee M. Gunderson, Andrés Munõz Medina, Umar Syed

Abstract: Data anonymization is an approach to privacy-preserving data release aimed at preventing participants reidentification, and it is an important alternative to differential privacy in applications that cannot tolerate noisy data. Existing algorithms for enforcing $k$-anonymity in the released data assume that the curator performing the anonymization has complete access to the original data. Reasons… ▽ More Data anonymization is an approach to privacy-preserving data release aimed at preventing participants reidentification, and it is an important alternative to differential privacy in applications that cannot tolerate noisy data. Existing algorithms for enforcing $k$-anonymity in the released data assume that the curator performing the anonymization has complete access to the original data. Reasons for limiting this access range from undesirability to complete infeasibility. This paper explores ideas -- objectives, metrics, protocols, and extensions -- for reducing the trust that must be placed in the curator, while still maintaining a statistical notion of $k$-anonymity. We suggest trust (amount of information provided to the curator) and privacy (anonymity of the participants) as the primary objectives of such a framework. We describe a class of protocols aimed at achieving these goals, proposing new metrics of privacy in the process, and proving related bounds. We conclude by discussing a natural extension of this work that completely removes the need for a central curator. △ Less

Submitted 28 January, 2022; originally announced January 2022.

Label differential privacy via clustering

Authors: Hossein Esfandiari, Vahab Mirrokni, Umar Syed, Sergei Vassilvitskii

Abstract: We present new mechanisms for \emph{label differential privacy}, a relaxation of differentially private machine learning that only protects the privacy of the labels in the training set. Our mechanisms cluster the examples in the training set using their (non-private) feature vectors, randomly re-sample each label from examples in the same cluster, and output a training set with noisy labels as we… ▽ More We present new mechanisms for \emph{label differential privacy}, a relaxation of differentially private machine learning that only protects the privacy of the labels in the training set. Our mechanisms cluster the examples in the training set using their (non-private) feature vectors, randomly re-sample each label from examples in the same cluster, and output a training set with noisy labels as well as a modified version of the true loss function. We prove that when the clusters are both large and high-quality, the model that minimizes the modified loss on the noisy training set converges to small excess risk at a rate that is comparable to the rate for non-private learning. We describe both a centralized mechanism in which the entire training set is stored by a trusted curator, and a distributed mechanism where each user stores a single labeled example and replaces her label with the label of a randomly selected user from the same cluster. We also describe a learning problem in which large clusters are necessary to achieve both strong privacy and either good precision or good recall. Our experiments show that randomizing the labels within each cluster significantly improves the privacy vs. accuracy trade-off compared to applying uniform randomized response to the labels, and also compared to learning a model via DP-SGD. △ Less

Submitted 5 October, 2021; originally announced October 2021.

Private Optimization Without Constraint Violations

Authors: Andrés Muñoz Medina, Umar Syed, Sergei Vassilvitskii, Ellen Vitercik

Abstract: We study the problem of differentially private optimization with linear constraints when the right-hand-side of the constraints depends on private data. This type of problem appears in many applications, especially resource allocation. Previous research provided solutions that retained privacy but sometimes violated the constraints. In many settings, however, the constraints cannot be violated und… ▽ More We study the problem of differentially private optimization with linear constraints when the right-hand-side of the constraints depends on private data. This type of problem appears in many applications, especially resource allocation. Previous research provided solutions that retained privacy but sometimes violated the constraints. In many settings, however, the constraints cannot be violated under any circumstances. To address this hard requirement, we present an algorithm that releases a nearly-optimal solution satisfying the constraints with probability 1. We also prove a lower bound demonstrating that the difference between the objective value of our algorithm's solution and the optimal solution is tight up to logarithmic factors among all differentially private algorithms. We conclude with experiments demonstrating that our algorithm can achieve nearly optimal performance while preserving privacy. △ Less

Submitted 3 November, 2020; v1 submitted 2 July, 2020; originally announced July 2020.

Pulsed laser deposition of single phase n- and p-type Cu2O thin films with low resistivity

Authors: Syed Farid Uddin Farhad, David Cherns, James Smith, Neil Fox, David Fermín

Abstract: Low resistivity (~3-24 mOhm.cm) with tunable n- and p-type phase pure Cu2O thin films have been grown by pulsed laser deposition at 25-200 0C by varying the background oxygen partial pressure (O2pp). Capacitance data obtained by electrochemical impedance spectroscopy was used to determine the conductivity (n- or p-type), carrier density, and flat band potentials for samples grown on indium tin oxi… ▽ More Low resistivity (~3-24 mOhm.cm) with tunable n- and p-type phase pure Cu2O thin films have been grown by pulsed laser deposition at 25-200 0C by varying the background oxygen partial pressure (O2pp). Capacitance data obtained by electrochemical impedance spectroscopy was used to determine the conductivity (n- or p-type), carrier density, and flat band potentials for samples grown on indium tin oxide (ITO) at 25 0C. The Hall mobility of the n- and p-type Cu2O was estimated to be ~ 0.85 cm2.V-1s-1 and ~ 4.78 cm2.V-1s-1 respectively for samples grown on quartz substrate at 25 0C. An elevated substrate temperature ~ 200 0C with O2pp = 2 - 3 mTorr yielded p-type Cu2O films with six orders of magnitude higher resistivities in the range ~ 9 - 49 kOhm.cm and mobilities in the range ~ 13.5 - 22.2 cm2.V-1s-1. UV-Vis-NIR diffuse reflectance spectroscopy showed optical bandgaps of Cu2O films in the range of 1.76 to 2.15 eV depending on O2pp. Thin films grown at oxygen-rich conditions O2pp > 7 mTorr yielded mixed-phase copper oxide irrespective of the substrate temperatures and upon air annealing at 550 0C for 1 hour completely converted to CuO phase with n-type semiconducting properties (~12 Ohm.cm, ~1.50 cm2.V-1s-1). The as-grown p- and n-type Cu2O showed rectification and a photovoltaic (PV) response in solid junctions with n-ZnO and p-Si electrodes respectively. Our findings may create new opportunities for devising Cu2O based junctions requiring low process temperatures. △ Less

Submitted 29 May, 2020; v1 submitted 9 November, 2019; originally announced November 2019.

Comments: 41 pages(including suppl. material), 7 figures (14 suppl. figures)

Characterizing the Exact Behaviors of Temporal Difference Learning Algorithms Using Markov Jump Linear System Theory

Authors: Bin Hu, Usman Ahmed Syed

Abstract: In this paper, we provide a unified analysis of temporal difference learning algorithms with linear function approximators by exploiting their connections to Markov jump linear systems (MJLS). We tailor the MJLS theory developed in the control community to characterize the exact behaviors of the first and second order moments of a large family of temporal difference learning algorithms. For both t… ▽ More In this paper, we provide a unified analysis of temporal difference learning algorithms with linear function approximators by exploiting their connections to Markov jump linear systems (MJLS). We tailor the MJLS theory developed in the control community to characterize the exact behaviors of the first and second order moments of a large family of temporal difference learning algorithms. For both the IID and Markov noise cases, we show that the evolution of some augmented versions of the mean and covariance matrix of the TD estimation error exactly follows the trajectory of a deterministic linear time-invariant (LTI) dynamical system. Applying the well-known LTI system theory, we obtain closed-form expressions for the mean and covariance matrix of the TD estimation error at any time step. We provide a tight matrix spectral radius condition to guarantee the convergence of the covariance matrix of the TD estimation error, and perform a perturbation analysis to characterize the dependence of the TD behaviors on learning rate. For the IID case, we provide an exact formula characterizing how the mean and covariance matrix of the TD estimation error converge to the steady state values. For the Markov case, we use our formulas to explain how the behaviors of TD learning algorithms are affected by learning rate and the underlying Markov chain. For both cases, upper and lower bounds for the mean square TD error are provided. The mean square TD error is shown to converge linearly to an exact limit. △ Less

Submitted 4 November, 2019; v1 submitted 16 June, 2019; originally announced June 2019.

Comments: To appear in NeurIPS 2019

Quasicontinuum $γ$-decay of $^{91,92}$Zr: benchmarking indirect ($n,γ$) cross section measurements for the $s$-process

Authors: M. Guttormsen, S. Goriely, A. C. Larsen, A. Görgen, T. W. Hagen, T. Renstrøm, S. Siem, N. U. H. Syed, G. Tagliente, H. K. Toft, H. Utsunomiya, A. V. Voinov, K. Wikan

Abstract: Nuclear level densities (NLDs) and $γ$-ray strength functions ($γ$SFs) have been extracted from particle-$γ$ coincidences of the $^{92}$Zr($p,p' γ$)$^{92}$Zr and $^{92}$Zr($p,d γ$)$^{91}$Zr reactions using the Oslo method. The new $^{91,92}$Zr $γ$SF data, combined with photonuclear cross sections, cover the whole energy range from $E_γ \approx 1.5$~MeV up to the giant dipole resonance at… ▽ More Nuclear level densities (NLDs) and $γ$-ray strength functions ($γ$SFs) have been extracted from particle-$γ$ coincidences of the $^{92}$Zr($p,p' γ$)$^{92}$Zr and $^{92}$Zr($p,d γ$)$^{91}$Zr reactions using the Oslo method. The new $^{91,92}$Zr $γ$SF data, combined with photonuclear cross sections, cover the whole energy range from $E_γ \approx 1.5$~MeV up to the giant dipole resonance at $E_γ \approx 17$~MeV. The wide-range $γ$SF data display structures at $E_γ \approx 9.5$~MeV, compatible with a superposition of the spin-flip $M1$ resonance and a pygmy $E1$ resonance. Furthermore, the $γ$SF shows a minimum at $E_γ \approx 2-3$~MeV and an increase at lower $γ$-ray energies. The experimentally constrained NLDs and $γ$SFs are shown to reproduce known ($n, γ$) and Maxwellian-averaged cross sections for $^{91,92}$Zr using the {\sf TALYS} reaction code, thus serving as a benchmark for this indirect method of estimating ($n, γ$) cross sections for Zr isotopes. △ Less

Submitted 16 June, 2017; originally announced June 2017.

Comments: 10 pages and 9 figures

Journal ref: Phys. Rev. C 96, 024313 (2017)

Statistical Cost Sharing

Authors: Eric Balkanski, Umar Syed, Sergei Vassilvitskii

Abstract: We study the cost sharing problem for cooperative games in situations where the cost function $C$ is not available via oracle queries, but must instead be derived from data, represented as tuples $(S, C(S))$, for different subsets $S$ of players. We formalize this approach, which we call statistical cost sharing, and consider the computation of the core and the Shapley value, when the tuples are d… ▽ More We study the cost sharing problem for cooperative games in situations where the cost function $C$ is not available via oracle queries, but must instead be derived from data, represented as tuples $(S, C(S))$, for different subsets $S$ of players. We formalize this approach, which we call statistical cost sharing, and consider the computation of the core and the Shapley value, when the tuples are drawn from some distribution $\mathcal{D}$. Previous work by Balcan et al. in this setting showed how to compute cost shares that satisfy the core property with high probability for limited classes of functions. We expand on their work and give an algorithm that computes such cost shares for any function with a non-empty core. We complement these results by proving an inapproximability lower bound for a weaker relaxation. We then turn our attention to the Shapley value. We first show that when cost functions come from the family of submodular functions with bounded curvature, $κ$, the Shapley value can be approximated from samples up to a $\sqrt{1 - κ}$ factor, and that the bound is tight. We then define statistical analogues of the Shapley axioms, and derive a notion of statistical Shapley value. We show that these can always be approximated arbitrarily well for general functions over any distribution $\mathcal{D}$. △ Less

Submitted 8 March, 2017; originally announced March 2017.

An $\tilde{O}(\frac{1}{\sqrt{T}})$-error online algorithm for retrieving heavily perturbated statistical databases in the low-dimensional querying mode

Authors: Krzysztof Choromanski, Afshin Rostamizadeh, Umar Syed

Abstract: We give the first $\tilde{O}(\frac{1}{\sqrt{T}})$-error online algorithm for reconstructing noisy statistical databases, where $T$ is the number of (online) sample queries received. The algorithm, which requires only $O(\log T)$ memory, aims to learn a hidden database-vector $w^{*} \in \mathbb{R}^{D}$ in order to accurately answer a stream of queries regarding the hidden database, which arrive in… ▽ More We give the first $\tilde{O}(\frac{1}{\sqrt{T}})$-error online algorithm for reconstructing noisy statistical databases, where $T$ is the number of (online) sample queries received. The algorithm, which requires only $O(\log T)$ memory, aims to learn a hidden database-vector $w^{*} \in \mathbb{R}^{D}$ in order to accurately answer a stream of queries regarding the hidden database, which arrive in an online fashion from some unknown distribution $\mathcal{D}$. We assume the distribution $\mathcal{D}$ is defined on the neighborhood of a low-dimensional manifold. The presented algorithm runs in $O(dD)$-time per query, where $d$ is the dimensionality of the query-space. Contrary to the classical setting, there is no separate training set that is used by the algorithm to learn the database --- the stream on which the algorithm will be evaluated must also be used to learn the database-vector. The algorithm only has access to a binary oracle $\mathcal{O}$ that answers whether a particular linear function of the database-vector plus random noise is larger than a threshold, which is specified by the algorithm. We note that we allow for a significant $O(D)$ amount of noise to be added while other works focused on the low noise $o(\sqrt{D})$-setting. For a stream of $T$ queries our algorithm achieves an average error $\tilde{O}(\frac{1}{\sqrt{T}})$ by filtering out random noise, adapting threshold values given to the oracle based on its previous answers and, as a consequence, recovering with high precision a projection of a database-vector $w^{*}$ onto the manifold defining the query-space. △ Less

Submitted 5 April, 2015; originally announced April 2015.

An Implementation of Web Services for Inter-Connectivity of Information Systems

Authors: Aftab Ahmed Chandio, Dingju Zhu, Ali Hassan Sodhro, Muhammad Umer Syed

Abstract: As educational institutions and their departments rapidly increase, a communication between their end-users becomes more and more difficult in traditional online management systems (OMS). However, the end-users, i.e., employees, teaching staff, and students are associated to different sub-domains and using different subsystems that are executed on different platforms following different administra… ▽ More As educational institutions and their departments rapidly increase, a communication between their end-users becomes more and more difficult in traditional online management systems (OMS). However, the end-users, i.e., employees, teaching staff, and students are associated to different sub-domains and using different subsystems that are executed on different platforms following different administrative policies. Because of their intercommunication is not automated integrated, consequently, the overall efficiency of the system is degraded and the communication time is increased. Therefore, a technique for better interoperability and automated integration of departments is an urgent needed. Many of existing systems does not have a set of connections yet, such as the system of the University of Sindh (UoS). In this paper, we propose a system for the UoS, named integration of inter-connectivity of information system (i3) based on service oriented architecture (SOA) with web services. The system i3 monitors and exchanges the students information in support of verification along heterogeneous and decentralized nature. Moreover, the proposed system provides capability of interoperability between their subsystems that are deployed in different departments of UoS and using different programming languages and database management systems (DBMS) △ Less

Submitted 31 July, 2014; originally announced July 2014.

Comments: 7 pages, 5 figures, (Accepted for the Int. J. Com. Dig. Sys. Vol. 3, No. 3, ISSN. 2210-142X)

Journal ref: International Journal of Computing and Digital Systems (IJCDS), Vol. 3, No. 3, pp. (2014)

The Smart Shower

Authors: Umair Atique Syed, Uma Kandan Muniandy

Abstract: The smart shower is an intelligent device that saves the water during the shower. It uses the indicator lamps that inform the user of the amount of the water. Like the traffic signal it has three sets of lamps, green, yellow and red, each indicating the amount of time spent. This device brain is the Siemens Logo PLC. The smart shower is an intelligent device that saves the water during the shower. It uses the indicator lamps that inform the user of the amount of the water. Like the traffic signal it has three sets of lamps, green, yellow and red, each indicating the amount of time spent. This device brain is the Siemens Logo PLC. △ Less

Submitted 6 July, 2014; originally announced July 2014.

Comments: 2 Pages, 3 Figures

Learning Prices for Repeated Auctions with Strategic Buyers

Authors: Kareem Amin, Afshin Rostamizadeh, Umar Syed

Abstract: Inspired by real-time ad exchanges for online display advertising, we consider the problem of inferring a buyer's value distribution for a good when the buyer is repeatedly interacting with a seller through a posted-price mechanism. We model the buyer as a strategic agent, whose goal is to maximize her long-term surplus, and we are interested in mechanisms that maximize the seller's long-term reve… ▽ More Inspired by real-time ad exchanges for online display advertising, we consider the problem of inferring a buyer's value distribution for a good when the buyer is repeatedly interacting with a seller through a posted-price mechanism. We model the buyer as a strategic agent, whose goal is to maximize her long-term surplus, and we are interested in mechanisms that maximize the seller's long-term revenue. We define the natural notion of strategic regret --- the lost revenue as measured against a truthful (non-strategic) buyer. We present seller algorithms that are no-(strategic)-regret when the buyer discounts her future surplus --- i.e. the buyer prefers showing advertisements to users sooner rather than later. We also give a lower bound on strategic regret that increases as the buyer's discounting weakens and shows, in particular, that any seller algorithm will suffer linear strategic regret if there is no discounting. △ Less

Submitted 26 November, 2013; originally announced November 2013.

Comments: Neural Information Processing Systems (NIPS 2013)

Nuclear Level Density and Gamma-Ray Strength Function of 43Sc

Authors: A. Bürger, A. C. Larsen, S. Hilaire, M. Guttormsen, S. Harissopulos, M. Kmiecik, T. Konstantinopoulos, M. Krticka, A. Lagoyannis, T. Lönnroth, K. Mazurek, M. Norrby, H. T. Nyhus, G. Perdikakis, S. Siem, A. Spyrou, N. U. H. Syed

Abstract: The nuclear level density and the gamma-ray strength function have been determined for 43Sc in the energy range up to 2 MeV below the neutron separation energy using the Oslo method with the 46Ti(p,alpha)43Sc reaction. A comparison to 45Sc shows that the level density of 43Sc is smaller by an approximately constant factor of two. This behaviour is well reproduced in a microscopical/combinatorial m… ▽ More The nuclear level density and the gamma-ray strength function have been determined for 43Sc in the energy range up to 2 MeV below the neutron separation energy using the Oslo method with the 46Ti(p,alpha)43Sc reaction. A comparison to 45Sc shows that the level density of 43Sc is smaller by an approximately constant factor of two. This behaviour is well reproduced in a microscopical/combinatorial model calculation. The gamma-ray strength function is showing an increase at low gamma-ray energies, a feature which has been observed in several nuclei but which still awaits theoretical explanation. △ Less

Submitted 5 October, 2012; originally announced October 2012.

Comments: 5 pages, 4 figures

Journal ref: Physical Review C 85, 064328 (2012)

Primary gamma-ray spectra in 44Ti of astrophysical interest

Authors: A. C. Larsen, S. Goriely, A. Bürger, M. Guttormsen, A. Görgen, S. Harrisopulos, M. Kmiecik, T. Konstantinopoulos, A. Lagoyannis, T. Lönnroth, K. Mazurek, M. Norrby, H. T. Nyhus, G. Perdikakis, A. Schiller, S. Siem, A. Spyrou, N. U. H. Syed, H. K. Toft, G. M. Tveten, A. Voinov

Abstract: Primary gamma-ray spectra for a wide excitation-energy range have been extracted for 44Ti from particle-gamma coincidence data of the 46Ti(p,t gamma)44Ti reaction. These spectra reveal information on the gamma-decay pattern of the nucleus, and may be used to extract the level density and radiative strength function applying the Oslo method. Models of the level density and radiative strength func… ▽ More Primary gamma-ray spectra for a wide excitation-energy range have been extracted for 44Ti from particle-gamma coincidence data of the 46Ti(p,t gamma)44Ti reaction. These spectra reveal information on the gamma-decay pattern of the nucleus, and may be used to extract the level density and radiative strength function applying the Oslo method. Models of the level density and radiative strength function are used as input for cross-section calculations of the 40Ca(alpha,gamma)44Ti reaction. Acceptable models should reproduce data on the 40Ca(alpha,gamma)44Ti reaction cross section as well as the measured primary gamma-ray spectra. This is only achieved when a coherent normalization of the slope of the level density and radiative strength function is performed. Thus, the overall shape of the experimental primary gamma-ray spectra puts a constraint on the input models for the rate calculations. △ Less

Submitted 5 October, 2012; originally announced October 2012.

Comments: 14 pages, 13 figures

Journal ref: Physical Review C 85, 014320 (2012)

Imitation Learning with a Value-Based Prior

Authors: Umar Syed, Robert E. Schapire

Abstract: The goal of imitation learning is for an apprentice to learn how to behave in a stochastic environment by observing a mentor demonstrating the correct behavior. Accurate prior knowledge about the correct behavior can reduce the need for demonstrations from the mentor. We present a novel approach to encoding prior knowledge about the correct behavior, where we assume that this prior knowledge takes… ▽ More The goal of imitation learning is for an apprentice to learn how to behave in a stochastic environment by observing a mentor demonstrating the correct behavior. Accurate prior knowledge about the correct behavior can reduce the need for demonstrations from the mentor. We present a novel approach to encoding prior knowledge about the correct behavior, where we assume that this prior knowledge takes the form of a Markov Decision Process (MDP) that is used by the apprentice as a rough and imperfect model of the mentor's behavior. Specifically, taking a Bayesian approach, we treat the value of a policy in this modeling MDP as the log prior probability of the policy. In other words, we assume a priori that the mentor's behavior is likely to be a high value policy in the modeling MDP, though quite possibly different from the optimal policy. We describe an efficient algorithm that, given a modeling MDP and a set of demonstrations by a mentor, provably converges to a stationary point of the log posterior of the mentor's policy, where the posterior is computed with respect to the "value based" prior. We also present empirical evidence that this prior does in fact speed learning of the mentor's policy, and is an improvement in our experiments over similar previous methods. △ Less

Submitted 20 June, 2012; originally announced June 2012.

Comments: Appears in Proceedings of the Twenty-Third Conference on Uncertainty in Artificial Intelligence (UAI2007)

Report number: UAI-P-2007-PG-384-391

Graphical Models for Bandit Problems

Authors: Kareem Amin, Michael Kearns, Umar Syed

Abstract: We introduce a rich class of graphical models for multi-armed bandit problems that permit both the state or context space and the action space to be very large, yet succinctly specify the payoffs for any context-action pair. Our main result is an algorithm for such models whose regret is bounded by the number of parameters and whose running time depends only on the treewidth of the graph substruct… ▽ More We introduce a rich class of graphical models for multi-armed bandit problems that permit both the state or context space and the action space to be very large, yet succinctly specify the payoffs for any context-action pair. Our main result is an algorithm for such models whose regret is bounded by the number of parameters and whose running time depends only on the treewidth of the graph substructure induced by the action space. △ Less

Submitted 14 February, 2012; originally announced February 2012.

Report number: UAI-P-2011-PG-1-10

Fermi's golden rule applied to the gamma decay in the quasicontinuum of 46Ti

Authors: M. Guttormsen, A. C. Larsen, A. Buerger, A. Goergen, S. Harissopulos, M. Kmiecik, T. Konstantinopoulos, M. Krticka, A. Lagoyannis, T. Loennroth, K. Mazurek, M. Norrby, H. T. Nyhus, G. Perdikakis A. Schiller, S. Siem, A. Spyrou, N. U. H. Syed, H. K. Toft, G. M. Tveten, A. Voinov

Abstract: Particle-gamma coincidences from the 46Ti(p,p' gamma)46Ti inelastic scattering reaction with 15-MeV protons are utilized to obtain gamma-ray spectra as a function of excitation energy. The rich data set allows analyzing the coincidence data with various gates on excitation energy. This enables, for many independent data sets, a simultaneous extraction of level density and radiative strength functi… ▽ More Particle-gamma coincidences from the 46Ti(p,p' gamma)46Ti inelastic scattering reaction with 15-MeV protons are utilized to obtain gamma-ray spectra as a function of excitation energy. The rich data set allows analyzing the coincidence data with various gates on excitation energy. This enables, for many independent data sets, a simultaneous extraction of level density and radiative strength function (RSF). The results are consistent with one common level density. The data seem to exhibit a universal RSF as the deduced RSFs from different excitation energies show only small fluctuations provided that only excitation energies above 3 MeV are taken into account. If transitions to well-separated low-energy levels are included, the deduced RSF may change by a factor of 2-3, which might be expected due to the involved Porter-Thomas fluctuations. △ Less

Submitted 20 January, 2011; v1 submitted 17 September, 2010; originally announced September 2010.

Comments: 11 pages and 12 figures

Journal ref: Phys.Rev.C83:014312,2011

Adapting to the Shifting Intent of Search Queries

Authors: Umar Syed, Aleksandrs Slivkins, Nina Mishra

Abstract: Search engines today present results that are often oblivious to abrupt shifts in intent. For example, the query `independence day' usually refers to a US holiday, but the intent of this query abruptly changed during the release of a major film by that name. While no studies exactly quantify the magnitude of intent-shifting traffic, studies suggest that news events, seasonal topics, pop culture, e… ▽ More Search engines today present results that are often oblivious to abrupt shifts in intent. For example, the query `independence day' usually refers to a US holiday, but the intent of this query abruptly changed during the release of a major film by that name. While no studies exactly quantify the magnitude of intent-shifting traffic, studies suggest that news events, seasonal topics, pop culture, etc account for 50% of all search queries. This paper shows that the signals a search engine receives can be used to both determine that a shift in intent has happened, as well as find a result that is now more relevant. We present a meta-algorithm that marries a classifier with a bandit algorithm to achieve regret that depends logarithmically on the number of query impressions, under certain assumptions. We provide strong evidence that this regret is close to the best achievable. Finally, via a series of experiments, we demonstrate that our algorithm outperforms prior approaches, particularly as the amount of intent-shifting traffic increases. △ Less

Submitted 22 July, 2010; originally announced July 2010.

Comments: This is the full version of the paper in NIPS'09

Level densities and $γ$-ray strength functions in Sn isotopes

Authors: H. K. Toft, A. C. Larsen, U. Agvaanluvsan, A. Bürger, M. Guttormsen, G. E. Mitchell, H. T. Nyhus, A. Schiller, S. Siem, N. U. H. Syed, A. Voinov

Abstract: The nuclear level densities of $^{118,119}$Sn and the $γ$-ray strength functions of $^{116,118,119}$Sn below the neutron separation energy are extracted with the Oslo method using the ($^3$He, \,$αγ$) and ($^3$He,$^3$He$^\primeγ$) reactions. The level density function of $^{119}$Sn displays step-like structures. The microcanonical entropies are deduced from the level densities, and the single neut… ▽ More The nuclear level densities of $^{118,119}$Sn and the $γ$-ray strength functions of $^{116,118,119}$Sn below the neutron separation energy are extracted with the Oslo method using the ($^3$He, \,$αγ$) and ($^3$He,$^3$He$^\primeγ$) reactions. The level density function of $^{119}$Sn displays step-like structures. The microcanonical entropies are deduced from the level densities, and the single neutron entropy of $^{119}$Sn is determined to be $(1.7 \pm 0.2)\,k_B$. Results from a combinatorial model support the interpretation that some of the low-energy steps in the level density function are caused by neutron pair-breaking. An enhancement in all the $γ$-ray strength functions of $^{116-119}$Sn, compared to standard models for radiative strength, is observed for the $γ$-ray energy region of $\simeq (4 -11)$ MeV. These small resonances all have a centroid energy of 8.0(1) MeV and an integrated strength corresponding to $1.7(9)\%$ of the classical Thomas-Reiche-Kuhn sum rule. The Sn resonances may be due to electric dipole neutron skin oscillations or to an enhancement of the giant magnetic dipole resonance. △ Less

Submitted 24 June, 2010; originally announced June 2010.

Journal ref: Phys.Rev.C81:064311,2010

Radiative strength functions in 163,164Dy

Authors: H. T. Nyhus, S. Siem, M. Guttormsen, A. C. Larsen, A. Bürger, N. U. H. Syed, G. M. Tveten, A. Voinov

Abstract: The nuclei 163,164Dy have been investigated using the Oslo method on data from the pick-up reaction 164Dy(3He,alpha gamma)163Dy and the inelastic scattering 164Dy(3He,3He' gamma)164Dy, respectively. The radiative strength functions for both nuclei have been extracted, and a small resonance centered around Eg ?3 MeV is observed in both cases. The parameters of this so-called pygmy M1 resonance (the… ▽ More The nuclei 163,164Dy have been investigated using the Oslo method on data from the pick-up reaction 164Dy(3He,alpha gamma)163Dy and the inelastic scattering 164Dy(3He,3He' gamma)164Dy, respectively. The radiative strength functions for both nuclei have been extracted, and a small resonance centered around Eg ?3 MeV is observed in both cases. The parameters of this so-called pygmy M1 resonance (the scissors mode) are compared to previous results on 160,161,162Dy using the Oslo method, and to data on 163Dy measured by the Prague group using the two-step cascade method. In particular, the integrated reduced transition probability B(M1) of the pygmy resonance is compared with neighboring dysprosium isotopes. We also observe an enhanced strength in the region above gamma energy around 5 MeV in 164Dy. Possible origins of this feature are discussed. △ Less

Submitted 25 June, 2010; v1 submitted 24 June, 2010; originally announced June 2010.

Journal ref: Phys.Rev.C81:024325,2010; Erratum-ibid.C82:029909,2010

Extraction of thermal and electromagnetic properties in 45Ti

Authors: N. U. H. Syed, A. C. Larsen, A. B. Bürger, M. Guttormsen, S. Harissopulos, M. Kmiecik, T. Konstantinopoulos, M. Krtička, A. Lagovannis, T. Lönnroth, K. Mazurek, M. Norby, H. T. Nyhus, G. Perdikakis, S. Siem, A. Spyrou

Abstract: The level density and gamma-ray strength function of 45Ti have been determined by use of the Oslo method. The particle-gamma coincidences from the 46Ti(p,d gamma)45Ti pick-up reaction with 32 MeV protons are utilized to obtain gamma-ray spectra as function of excitation energy. The extracted level density and strength function are compared with models, which are found to describe these quantitie… ▽ More The level density and gamma-ray strength function of 45Ti have been determined by use of the Oslo method. The particle-gamma coincidences from the 46Ti(p,d gamma)45Ti pick-up reaction with 32 MeV protons are utilized to obtain gamma-ray spectra as function of excitation energy. The extracted level density and strength function are compared with models, which are found to describe these quantities satisfactorily. The data do not reveal any single-particle energy gaps of the underlying doubly magic 40Ca core, probably due to the strong quadruple deformation. △ Less

Submitted 8 September, 2009; originally announced September 2009.

Journal ref: Phys.Rev.C80:044309,2009

Statistical structure and $γ$-decay properties of closed shell Pb nuclei

Authors: N. U. H. Syed, M. Guttormsen, F. Ingebretsen, A. C. Larsen, T. Lönnroth, J. Rekstad, A. Schiller, S. Siem, A. Voinov

Abstract: The level densities and gamma-ray strength functions of 205-208Pb have been measured with the Oslo method, utilizing the (3He, 3He' gamma) and (3He,alpha gamma) reactions on the target nuclei 206Pb and 208Pb. The extracted level densities are consistent with known discrete levels at low excitation energies. The entropies and temperatures in the micro-canonical ensemble have been deduced from the… ▽ More The level densities and gamma-ray strength functions of 205-208Pb have been measured with the Oslo method, utilizing the (3He, 3He' gamma) and (3He,alpha gamma) reactions on the target nuclei 206Pb and 208Pb. The extracted level densities are consistent with known discrete levels at low excitation energies. The entropies and temperatures in the micro-canonical ensemble have been deduced from the experimental level density. An average entropy difference of Delta S ~ 1.8 k_B has been observed between 205Pb and 206Pb. The gamma-ray strength functions in 205-208Pb are extracted and compared with two models; however, none of them describe the data adequately. Intermediate structures have been observed at lower gamma-ray energies in all the analyzed Pb nuclei. These structures are less pronounced while moving from the doubly-magic nucleus 208Pb to 205Pb. △ Less

Submitted 6 September, 2009; v1 submitted 17 September, 2008; originally announced September 2008.

Journal ref: Phys. Rev. C 79, 024316 (2009)

Nuclear level densities and gamma-ray strength functions in 44,45Sc

Authors: A. C. Larsen, M. Guttormsen, R. Chankova, T. Loennroth, S. Messelt, F. Ingebretsen, J. Rekstad, A. Schiller, S. Siem, N. U. H. Syed, A. Voinov

Abstract: The scandium isotopes 44,45Sc have been studied with the 45Sc(3He,alpha gamma)44Sc and 45Sc(3He,3He' gamma)45Sc reactions, respectively. The nuclear level densities and gamma-ray strength functions have been extracted using the Oslo method. The experimental level densities are compared to calculated level densities obtained from a microscopic model based on BCS quasiparticles within the Nilsson… ▽ More The scandium isotopes 44,45Sc have been studied with the 45Sc(3He,alpha gamma)44Sc and 45Sc(3He,3He' gamma)45Sc reactions, respectively. The nuclear level densities and gamma-ray strength functions have been extracted using the Oslo method. The experimental level densities are compared to calculated level densities obtained from a microscopic model based on BCS quasiparticles within the Nilsson level scheme. This model also gives information about the parity distribution and the number of broken Cooper pairs as a function of excitation energy. The experimental gamma-ray strength functions are compared to theoretical models of the E1, M1, and E2 strength, and to data from (gamma,n) and (gamma,p) experiments. The strength functions show an enhancement at low gamma energies that cannot be explained by the present, standard models. △ Less

Submitted 22 January, 2008; v1 submitted 4 June, 2007; originally announced June 2007.

Comments: 21 pages, 13 figures. Published version

Journal ref: Phys.Rev.C76:044303,2007

Microcanonical entropies and radiative strength functions of $^{50,51}$V

Authors: A. C. Larsen, R. Chankova, M. Guttormsen, F. Ingebretsen, T. Lönnroth, S. Messelt, J. Rekstad, A. Schiller, S. Siem, N. U. H. Syed, A. Voinov, S. W. Ødegård

Abstract: The level densities and radiative strength functions (RSFs) of $^{50,51}$V have been extracted using the ($^3$He,$αγ$) and ($^3$He,$^3$He$^{\prime} γ$) reactions, respectively. From the level densities, microcanonical entropies are deduced. The high $γ$-energy part of the RSF is described by the giant electric dipole resonance. A significant enhancement over the predicted strength in the region… ▽ More The level densities and radiative strength functions (RSFs) of $^{50,51}$V have been extracted using the ($^3$He,$αγ$) and ($^3$He,$^3$He$^{\prime} γ$) reactions, respectively. From the level densities, microcanonical entropies are deduced. The high $γ$-energy part of the RSF is described by the giant electric dipole resonance. A significant enhancement over the predicted strength in the region of $E_γ \lesssim 3$ MeV is seen, which at present has no theoretical explanation. △ Less

Submitted 19 June, 2006; v1 submitted 30 November, 2005; originally announced November 2005.

Comments: 16 pages including 9 figures

Journal ref: Phys. Rev. C 73, 064301 (2006)