Skip to main content

Showing 1–29 of 29 results for author: Williams, J D

.
  1. arXiv:2310.18130  [pdf, other

    cs.CL cs.HC

    DELPHI: Data for Evaluating LLMs' Performance in Handling Controversial Issues

    Authors: David Q. Sun, Artem Abzaliev, Hadas Kotek, Zidi Xiu, Christopher Klein, Jason D. Williams

    Abstract: Controversy is a reflection of our zeitgeist, and an important aspect to any discourse. The rise of large language models (LLMs) as conversational systems has increased public reliance on these systems for answers to their various questions. Consequently, it is crucial to systematically examine how these models respond to questions that pertaining to ongoing debates. However, few such datasets exi… ▽ More

    Submitted 7 November, 2023; v1 submitted 27 October, 2023; originally announced October 2023.

    Comments: Accepted to EMNLP Industry Track 2023

  2. arXiv:2308.03905  [pdf, other

    cs.CL cs.AI cs.LG

    Intelligent Assistant Language Understanding On Device

    Authors: Cecilia Aas, Hisham Abdelsalam, Irina Belousova, Shruti Bhargava, Jianpeng Cheng, Robert Daland, Joris Driesen, Federico Flego, Tristan Guigue, Anders Johannsen, Partha Lal, Jiarui Lu, Joel Ruben Antony Moniz, Nathan Perkins, Dhivya Piraviperumal, Stephen Pulman, Diarmuid Ó Séaghdha, David Q. Sun, John Torr, Marco Del Vecchio, Jay Wacker, Jason D. Williams, Hong Yu

    Abstract: It has recently become feasible to run personal digital assistants on phones and other personal devices. In this paper we describe a design for a natural language understanding system that runs on device. In comparison to a server-based assistant, this system is more private, more reliable, faster, more expressive, and more accurate. We describe what led to key choices about architecture and techn… ▽ More

    Submitted 7 August, 2023; originally announced August 2023.

  3. arXiv:2303.10255  [pdf, other

    cs.HC cs.CL

    Feedback Effect in User Interaction with Intelligent Assistants: Delayed Engagement, Adaption and Drop-out

    Authors: Zidi Xiu, Kai-Chen Cheng, David Q. Sun, Jiannan Lu, Hadas Kotek, Yuhan Zhang, Paul McCarthy, Christopher Klein, Stephen Pulman, Jason D. Williams

    Abstract: With the growing popularity of intelligent assistants (IAs), evaluating IA quality becomes an increasingly active field of research. This paper identifies and quantifies the feedback effect, a novel component in IA-user interactions: how the capabilities and limitations of the IA influence user behavior over time. First, we demonstrate that unhelpful responses from the IA cause users to delay or r… ▽ More

    Submitted 18 April, 2023; v1 submitted 17 March, 2023; originally announced March 2023.

    Comments: PAKDD 2023

  4. arXiv:2012.04699  [pdf

    cs.CR

    Class Clown: Data Redaction in Machine Unlearning at Enterprise Scale

    Authors: Daniel L. Felps, Amelia D. Schwickerath, Joyce D. Williams, Trung N. Vuong, Alan Briggs, Matthew Hunt, Evan Sakmar, David D. Saranchak, Tyler Shumaker

    Abstract: Individuals are gaining more control of their personal data through recent data privacy laws such the General Data Protection Regulation and the California Consumer Privacy Act. One aspect of these laws is the ability to request a business to delete private information, the so called "right to be forgotten" or "right to erasure". These laws have serious financial implications for companies and org… ▽ More

    Submitted 8 December, 2020; originally announced December 2020.

    Comments: 8 pages, 7 figures

  5. arXiv:2012.04169  [pdf, other

    cs.CL

    Improving Human-Labeled Data through Dynamic Automatic Conflict Resolution

    Authors: David Q. Sun, Hadas Kotek, Christopher Klein, Mayank Gupta, William Li, Jason D. Williams

    Abstract: This paper develops and implements a scalable methodology for (a) estimating the noisiness of labels produced by a typical crowdsourcing semantic annotation task, and (b) reducing the resulting error of the labeling process by as much as 20-30% in comparison to other common labeling strategies. Importantly, this new approach to the labeling process, which we name Dynamic Automatic Conflict Resolut… ▽ More

    Submitted 7 December, 2020; originally announced December 2020.

    Comments: Conference Paper at COLING 2020: https://www.aclweb.org/anthology/2020.coling-main.316/

  6. arXiv:2011.08738  [pdf

    cs.CR

    Bootstrap Aggregation for Point-based Generalized Membership Inference Attacks

    Authors: Daniel L. Felps, Amelia D. Schwickerath, Joyce D. Williams, Trung N. Vuong, Alan Briggs, Matthew Hunt, Evan Sakmar, David D. Saranchak, Tyler Shumaker

    Abstract: An efficient scheme is introduced that extends the generalized membership inference attack to every point in a model's training data set. Our approach leverages data partitioning to create variable sized training sets for the reference models. We then train an attack model for every single training example for a reference model configuration based upon output for each individual point. This allows… ▽ More

    Submitted 17 November, 2020; originally announced November 2020.

    Comments: 8 pages, 6 figures, 8 tables

  7. arXiv:2010.12770  [pdf, other

    cs.CL

    Conversational Semantic Parsing for Dialog State Tracking

    Authors: Jianpeng Cheng, Devang Agrawal, Hector Martinez Alonso, Shruti Bhargava, Joris Driesen, Federico Flego, Shaona Ghosh, Dain Kaplan, Dimitri Kartsaklis, Lin Li, Dhivya Piraviperumal, Jason D Williams, Hong Yu, Diarmuid O Seaghdha, Anders Johannsen

    Abstract: We consider a new perspective on dialog state tracking (DST), the task of estimating a user's goal through the course of a dialog. By formulating DST as a semantic parsing task over hierarchical representations, we can incorporate semantic compositionality, cross-domain knowledge sharing and co-reference. We present TreeDST, a dataset of 27k conversations annotated with tree-structured dialog stat… ▽ More

    Submitted 13 May, 2021; v1 submitted 24 October, 2020; originally announced October 2020.

    Comments: Publish as a conference paper at EMNLP 2020

  8. Noise Robust Named Entity Understanding for Voice Assistants

    Authors: Deepak Muralidharan, Joel Ruben Antony Moniz, Sida Gao, Xiao Yang, Justine Kao, Stephen Pulman, Atish Kothari, Ray Shen, Yinying Pan, Vivek Kaul, Mubarak Seyed Ibrahim, Gang Xiang, Nan Dun, Yidan Zhou, Andy O, Yuan Zhang, Pooja Chitkara, Xuan Wang, Alkesh Patel, Kushal Tayal, Roger Zheng, Peter Grasch, Jason D. Williams, Lin Li

    Abstract: Named Entity Recognition (NER) and Entity Linking (EL) play an essential role in voice assistant interaction, but are challenging due to the special difficulties associated with spoken user queries. In this paper, we propose a novel architecture that jointly solves the NER and EL tasks by combining them in a joint reranking module. We show that our proposed framework improves NER accuracy by up to… ▽ More

    Submitted 10 August, 2021; v1 submitted 29 May, 2020; originally announced May 2020.

    Comments: NAACL 2021 Industry Track

    MSC Class: 68T50 ACM Class: I.2.7

  9. arXiv:1908.11404  [pdf

    cs.LG stat.ML

    Active Learning for Domain Classification in a Commercial Spoken Personal Assistant

    Authors: Xi C. Chen, Adithya Sagar, Justine T. Kao, Tony Y. Li, Christopher Klein, Stephen Pulman, Ashish Garg, Jason D. Williams

    Abstract: We describe a method for selecting relevant new training data for the LSTM-based domain selection component of our personal assistant system. Adding more annotated training data for any ML system typically improves accuracy, but only if it provides examples not already adequately covered in the existing data. However, obtaining, selecting, and labeling relevant data is expensive. This work present… ▽ More

    Submitted 29 August, 2019; originally announced August 2019.

  10. arXiv:1902.04259  [pdf, other

    cs.AI

    NAIL: A General Interactive Fiction Agent

    Authors: Matthew Hausknecht, Ricky Loynd, Greg Yang, Adith Swaminathan, Jason D. Williams

    Abstract: Interactive Fiction (IF) games are complex textual decision making problems. This paper introduces NAIL, an autonomous agent for general parser-based IF games. NAIL won the 2018 Text Adventure AI Competition, where it was evaluated on twenty unseen games. This paper describes the architecture, development, and insights underpinning NAIL's performance.

    Submitted 14 February, 2019; v1 submitted 12 February, 2019; originally announced February 2019.

  11. arXiv:1810.05786  [pdf, other

    cs.CV

    Learning to Globally Edit Images with Textual Description

    Authors: Hai Wang, Jason D. Williams, SingBing Kang

    Abstract: We show how we can globally edit images using textual instructions: given a source image and a textual instruction for the edit, generate a new image transformed under this instruction. To tackle this novel problem, we develop three different trainable models based on RNN and Generative Adversarial Network (GAN). The models (bucket, filter bank, and end-to-end) differ in how much expert knowledge… ▽ More

    Submitted 12 October, 2018; originally announced October 2018.

  12. arXiv:1702.03274  [pdf, other

    cs.AI cs.CL

    Hybrid Code Networks: practical and efficient end-to-end dialog control with supervised and reinforcement learning

    Authors: Jason D. Williams, Kavosh Asadi, Geoffrey Zweig

    Abstract: End-to-end learning of recurrent neural networks (RNNs) is an attractive solution for dialog systems; however, current techniques are data-intensive and require thousands of dialogs to learn simple behaviors. We introduce Hybrid Code Networks (HCNs), which combine an RNN with domain-specific knowledge encoded as software and system action templates. Compared to existing end-to-end approaches, HCNs… ▽ More

    Submitted 24 April, 2017; v1 submitted 10 February, 2017; originally announced February 2017.

    Comments: Accepted as a long paper for the 55th Annual Meeting of the Association for Computational Linguistics (ACL 2017)

  13. arXiv:1612.06000  [pdf, other

    cs.AI cs.LG stat.ML

    Sample-efficient Deep Reinforcement Learning for Dialog Control

    Authors: Kavosh Asadi, Jason D. Williams

    Abstract: Representing a dialog policy as a recurrent neural network (RNN) is attractive because it handles partial observability, infers a latent representation of state, and can be optimized with supervised learning (SL) or reinforcement learning (RL). For RL, a policy gradient approach is natural, but is sample inefficient. In this paper, we present 3 methods for reducing the number of dialogs required t… ▽ More

    Submitted 18 December, 2016; originally announced December 2016.

  14. arXiv:1606.01269  [pdf, other

    cs.CL cs.AI cs.LG

    End-to-end LSTM-based dialog control optimized with supervised and reinforcement learning

    Authors: Jason D. Williams, Geoffrey Zweig

    Abstract: This paper presents a model for end-to-end learning of task-oriented dialog systems. The main component of the model is a recurrent neural network (an LSTM), which maps from raw dialog history directly to a distribution over system actions. The LSTM automatically infers a representation of dialog history, which relieves the system developer of much of the manual feature engineering of dialog state… ▽ More

    Submitted 3 June, 2016; originally announced June 2016.

  15. arXiv:1510.00003  [pdf, ps, other

    math.OA math.CA math.PR

    On the Hausdorff Continuity of Free Lèvy Processes and Free Convolution Semigroups

    Authors: John D. Williams

    Abstract: Let $μ$ denote a Borel probability measure and let $\{ μ_{t} \}_{t\geq 1}$ denote the free additive convolution semigroup of Nica and Speicher. We show that the support of these measures varies continuously in the Hausdorff metric for $t >1$. We utilize complex analytic methods and, in particular, a characterization of the absolutely continuous portion of these supports due to Huang.

    Submitted 29 July, 2016; v1 submitted 30 September, 2015; originally announced October 2015.

    Comments: Small revisions at the referees behest. To be published in the Journal of Mathematical Analysis and its Applications

    MSC Class: 46L54; 30E20

  16. arXiv:1507.02580  [pdf, ps, other

    math.OA math.FA math.PR

    B-Valued Free Convolution for Unbounded Operators

    Authors: John D. Williams

    Abstract: Consider the $\mathcal{B}$-valued probability space $(\mathcal{A}, E, \mathcal{B})$, where $\mathcal{A}$ is a tracial von Neumann algebra. We extend the theory of operator valued free probability to the algebra of affiliated operators $\tilde{\mathcal{A}}$. For a random variable $X \in \tilde{\mathcal{A}}^{sa}$ we study the Cauchy transform $G_{X}$ and show that the operator algebra… ▽ More

    Submitted 17 December, 2015; v1 submitted 9 July, 2015; originally announced July 2015.

    Comments: Several small errors corrected. Streamlined proofs. To be published in Indiana University Journal or Mathematics

    MSC Class: 46L54; 46E40

  17. arXiv:1412.1413  [pdf, ps, other

    math.OA math.PR

    Operator-Valued Monotone Convolution Semigroups and an Extension of the Bercovici-Pata Bijection

    Authors: Michael Anshelevich, John D. Williams

    Abstract: In a 1999 paper, Bercovici and Pata showed that a natural bijection between the classically, free and Boolean infinitely divisible measures held at the level of limit theorems of triangular arrays. This result was extended to include monotone convolution by the authors. In recent years, operator-valued versions of free, Boolean and monotone probability have also been developed. Belinschi, Popa and… ▽ More

    Submitted 19 May, 2015; v1 submitted 3 December, 2014; originally announced December 2014.

    Comments: v2: numerous changes throughout

    MSC Class: Primary 46L53; Secondary 30D05; 47D06; 60E07

  18. arXiv:1412.1280  [pdf, other

    math.OA math.CO

    Operator-valued Jacobi parameters and examples of operator-valued distributions

    Authors: Michael Anshelevich, John D. Williams

    Abstract: In the setting of distributions taking values in a $C^\ast$-algebra $\mathcal{B}$, we define generalized Jacobi parameters and study distributions they generate. These include numerous known examples and one new family, of $\mathcal{B}$-valued free binomial distributions, for which we are able to compute free convolution powers. Moreover, we develop a convenient combinatorial method for calculatin… ▽ More

    Submitted 17 December, 2015; v1 submitted 3 December, 2014; originally announced December 2014.

    Comments: v3: A major revision, following comments by a referee

    MSC Class: 46L54; 05A19

  19. Existence of 2-parameter crossings, with applications

    Authors: Jonathan D. Williams

    Abstract: A Morse 2-function is a generic smooth map from a manifold M of arbitrary finite dimension to a surface B. Its critical set maps to an immersed collection of cusped arcs in B. The aim of this paper is to explain exactly when it is possible to move these arcs around in B by a homotopy and to give a library of examples when M is a closed 4-manifold. The last two sections give applications to the the… ▽ More

    Submitted 3 December, 2019; v1 submitted 6 November, 2014; originally announced November 2014.

    Comments: accepted version

  20. arXiv:1310.2969  [pdf, other

    math.SG

    Holomorphic polygons and smooth 4-manifold invariants

    Authors: Jonathan D. Williams

    Abstract: Any smooth, closed oriented 4-manifold has a surface diagram of arbitrarily high genus g>2 that specifies it up to diffeomorphism. The goal of this paper is to prove the following statement: For any smooth, closed oriented 4-manifold M, there is a sequence of weak A-infinity algebras indexed by g, and the homotopy equivalence class of each entry of this sequence is a diffeomorphism invariant of M.

    Submitted 10 October, 2013; originally announced October 2013.

    Comments: 31 pages. Preliminary: Comments welcome

    MSC Class: 57R17

  21. arXiv:1309.0877  [pdf, ps, other

    math.OA math.FA math.PR

    Analytic Function Theory for Operator-Valued Free Probability

    Authors: John D. Williams

    Abstract: It is a classical result in complex analysis that the class of functions that arise as the Cauchy transform of probability measures may be characterized entirely in terms of their analytic and asymptotic properties. Such transforms are a main object of study in non-commutative probability theory as the function theory encodes information on the probability measures and the various convolution oper… ▽ More

    Submitted 27 May, 2014; v1 submitted 3 September, 2013; originally announced September 2013.

    Comments: Final version. Streamlined with simpler arguments. To be published in Crelle's journal

    MSC Class: 46L54; 46L52; 47A56

  22. arXiv:1305.7293  [pdf, ps, other

    math.OA

    Quantum symmetric states on free product C*-algebras

    Authors: Kenneth J. Dykema, Claus Köstler, John D. Williams

    Abstract: We introduce symmetric states and quantum symmetric states on universal unital free product C*-algebras an arbitrary unital C*-algebra A with itself infinitely many times, as a generalization of the notions of exchangeable and quantum exchangeable random variables. We prove existence of conditional expectations onto tail algebras in various settings and we define a natural C*-subalgebra of the tai… ▽ More

    Submitted 22 September, 2014; v1 submitted 30 May, 2013; originally announced May 2013.

    Comments: 37 pages. Version 3 corrects a mistake in the earlier versions about existence of a normal conditional expectation onto the tail algebra; and the final results are slightly different than before. Version 2 contains some minor additions to Version 1

    MSC Class: 46L53 (46L54; 81S25; 46L10)

  23. arXiv:1209.4260  [pdf, ps, other

    math.OA math.PR

    Limit theorems for monotonic convolution and the Chernoff product formula

    Authors: Michael Anshelevich, John D. Williams

    Abstract: Bercovici and Pata showed that the correspondence between classically, freely, and Boolean infinitely divisible distributions holds on the level of limit theorems. We extend this correspondence also to distributions infinitely divisible with respect to the additive monotone convolution. Because of non-commutativity of this convolution, we use a new technique based on the Chernoff product formula.… ▽ More

    Submitted 19 February, 2013; v1 submitted 19 September, 2012; originally announced September 2012.

    Comments: v4: minor corrections. v3: Results extended from probability measures to finite measures. v2: Significant improvements following comments by J.C. Wang; Introduction also modified

    MSC Class: 46L53 (Primary) 30D05; 46L54; 47D06; 60B10 (Secondary)

  24. arXiv:1110.2691  [pdf, ps, other

    math.OA math.FA math.PR

    An Analogue of Hinucin's Characterization of Infinite Divisibility for Operator-Valued Free Probability

    Authors: John D. Williams

    Abstract: Let $B$ be a finite, separable von Neumann algebra. We prove that a $B$-valued distribution $μ$ that is the weak limit of an infinitesimal array is infinitely divisible. The proof of this theorem utilizes the Steinitz lemma and may be adapted to provide a nonstandard proof of this type of theorem for various other probabilistic categories. We also develop weak topologies for this theory and prove… ▽ More

    Submitted 7 November, 2011; v1 submitted 12 October, 2011; originally announced October 2011.

    Comments: Several revisions, excised theorems incompatible with the final form of the paper

  25. Uniform Convergence and the Central Limit Theorem

    Authors: John D. Williams

    Abstract: We prove results about uniform convergence of densities in the free central limit theorem without assumptions of boundedness on the support.

    Submitted 8 April, 2011; originally announced April 2011.

  26. arXiv:1103.6263  [pdf, other

    math.GT

    Uniqueness of surface diagrams of smooth 4-manifolds

    Authors: Jonathan D. Williams

    Abstract: In the author's earlier work there appeared a new way to specify any smooth closed 4-manifold by a surface diagram, which consists of an orientable surface decorated with simple closed curves. These curves are cyclically indexed, and each curve has a unique transverse intersection with the next. Each surface diagram comes from a certain type of map from the 4-manifold to the two-sphere. The aim of… ▽ More

    Submitted 24 April, 2018; v1 submitted 31 March, 2011; originally announced March 2011.

    Comments: Informal material added for readability in numerous places and many details and intermediate steps added to the later arguments in response to referee comments; references updated. 62 pages, many figures

    MSC Class: 57M50

  27. arXiv:1009.4955  [pdf, ps, other

    math.OA math.PR

    A Khintchine Decomposition for Free Probability

    Authors: John D. Williams

    Abstract: Let $μ$ be a probability measure on the real line. In this paper we prove that there exists a decomposition $μ= μ_{0} \boxplus μ_{1} \boxplus \... \boxplus μ_{n} \boxplus \...$ such that $μ_{0}$ is infinitely divisible and $μ_{i}$ is indecomposable for $i \geq 1$. Additionally, we prove that the family of all $\boxplus$-divisors of a measure $μ$ is compact up to translation. Analogous results are… ▽ More

    Submitted 8 April, 2011; v1 submitted 24 September, 2010; originally announced September 2010.

    Comments: Minor revisions, updated references

  28. arXiv:0905.0502  [pdf, ps, other

    math.GT math.SG

    The h-principle for broken Lefschetz fibrations

    Authors: Jonathan D. Williams

    Abstract: It is known that an arbitrary smooth, oriented 4-manifold admits the structure of what is called a broken Lefschetz fibration. Given a broken fibration, there are certain modifications, realized as homotopies of the fibration map, that enable one to construct infinitely many distinct fibrations of the same manifold. The aim of this paper is to prove that these modifications are sufficient to obt… ▽ More

    Submitted 1 July, 2009; v1 submitted 4 May, 2009; originally announced May 2009.

    Comments: 46 pages, submitted to Geometry & Topology. Corrected various typos, and a new section 4.0.2 gives uniqueness independent of homotopy class

    MSC Class: 57R70 (secondary)

    Journal ref: Geom. Topol. 14 (2010) 1015-1061

  29. Two-Loop Quark Self-Energy in a New Formalism (II): Renormalization of the Quark Propagator in the Light-Cone Gauge

    Authors: George Leibbrandt, Jimmy D. Williams

    Abstract: The complete two-loop correction to the quark propagator, consisting of the spider, rainbow, gluon bubble and quark bubble diagrams, is evaluated in the noncovariant light-cone gauge (lcg). (The overlap** self-energy diagram had already been computed.) The chief technical tools include the powerful matrix integration technique, the n^*-prescription for the spurious poles of 1/qn, and the detai… ▽ More

    Submitted 25 November, 1999; originally announced November 1999.

    Comments: 36 pages Latex, 5 eps figures, to appear in Nucl.Phys.B

    Report number: CERN-TH/99-201

    Journal ref: Nucl.Phys. B566 (2000) 373-401