Skip to main content

Showing 1–19 of 19 results for author: Moortgat, M

Searching in archive cs. Search in all archives.
.
  1. arXiv:2308.03679   

    cs.LO cs.CL

    Proceedings Modalities in substructural logics: Applications at the interfaces of logic, language and computation

    Authors: Michael Moortgat, Mehrnoosh Sadrzadeh

    Abstract: By calling into question the implicit structural rules that are taken for granted in classical logic, substructural logics have brought to the fore new forms of reasoning with applications in many interdisciplinary areas of interest. Modalities, in the substructural setting, provide the tools to control and finetune the logical resource management. The focus of the workshop is on applications in t… ▽ More

    Submitted 1 August, 2023; originally announced August 2023.

    Journal ref: EPTCS 381, 2023

  2. arXiv:2305.14917  [pdf, other

    cs.CL cs.AI

    Structural Ambiguity and its Disambiguation in Language Model Based Parsers: the Case of Dutch Clause Relativization

    Authors: Gijs Wijnholds, Michael Moortgat

    Abstract: This paper addresses structural ambiguity in Dutch relative clauses. By investigating the task of disambiguation by grounding, we study how the presence of a prior sentence can resolve relative clause ambiguities. We apply this method to two parsing architectures in an attempt to demystify the parsing and language model components of two present-day neural parsers. Results show that a neurosymboli… ▽ More

    Submitted 24 May, 2023; originally announced May 2023.

  3. arXiv:2302.12050  [pdf, other

    cs.CL cs.AI cs.LG cs.LO

    SPINDLE: Spinning Raw Text into Lambda Terms with Graph Attention

    Authors: Konstantinos Kogkalidis, Michael Moortgat, Richard Moot

    Abstract: This paper describes SPINDLE - an open source Python module implementing an efficient and accurate parser for written Dutch that transforms raw text input to programs for meaning composition, expressed as λ terms. The parser integrates a number of breakthrough advances made in recent years. Its output consists of hi-res derivations of a multimodal type-logical grammar, capturing two orthogonal axe… ▽ More

    Submitted 23 February, 2023; originally announced February 2023.

    Comments: EACL23 System Demonstrations

  4. Proceedings End-to-End Compositional Models of Vector-Based Semantics

    Authors: Michael Moortgat, Gijs Wijnholds

    Abstract: The workshop End-to-End Compositional Models of Vector-Based Semantics was held at NUI Galway on 15 and 16 August 2022 as part of the 33rd European Summer School in Logic, Language and Information (ESSLLI 2022). The workshop was sponsored by the research project 'A composition calculus for vector-based semantic modelling with a localization for Dutch' (Dutch Research Council 360-89-070, 2017-202… ▽ More

    Submitted 10 August, 2022; originally announced August 2022.

    Journal ref: EPTCS 366, 2022

  5. arXiv:2203.12235  [pdf, other

    cs.CL cs.LG

    Geometry-Aware Supertagging with Heterogeneous Dynamic Convolutions

    Authors: Konstantinos Kogkalidis, Michael Moortgat

    Abstract: The syntactic categories of categorial grammar formalisms are structured units made of smaller, indivisible primitives, bound together by the underlying grammar's category formation rules. In the trending approach of constructive supertagging, neural models are increasingly made aware of the internal category structure, which in turn enables them to more reliably predict rare and out-of-vocabulary… ▽ More

    Submitted 23 January, 2023; v1 submitted 23 March, 2022; originally announced March 2022.

    Comments: 8 pages plus references, unpublished preprint v2: fixed small typos, added appendix with a visualization of the decoding process; v3: improved presentation, improved the decoding figure

  6. arXiv:2106.05299  [pdf, ps, other

    quant-ph cs.CL

    Grover's Algorithm for Question Answering

    Authors: A. D. Correia, M. Moortgat, H. T. C. Stoof

    Abstract: Grover's algorithm, a well-know quantum search algorithm, allows one to find the correct item in a database, with quadratic speedup. In this paper we adapt Grover's algorithm to the problem of finding a correct answer to a natural language question in English, thus contributing to the growing field of Quantum Natural Language Processing. Using a grammar that can be interpreted as tensor contractio… ▽ More

    Submitted 27 January, 2022; v1 submitted 9 June, 2021; originally announced June 2021.

    Comments: Accepted for publication at Quantum Information Processing. 16 pages, 9 figures

  7. arXiv:2104.10516  [pdf, other

    cs.CL cs.LG

    Improving BERT Pretraining with Syntactic Supervision

    Authors: Giorgos Tziafas, Konstantinos Kogkalidis, Gijs Wijnholds, Michael Moortgat

    Abstract: Bidirectional masked Transformers have become the core theme in the current NLP landscape. Despite their impressive benchmarks, a recurring theme in recent research has been to question such models' capacity for syntactic generalization. In this work, we seek to address this question by adding a supervised, token-level supertagging objective to standard unsupervised pretraining, enabling the expli… ▽ More

    Submitted 21 April, 2021; originally announced April 2021.

    Comments: 4 pages, rejected by IWCS due to "not fitting the conference theme"

  8. arXiv:2101.05716  [pdf, other

    cs.CL

    SICKNL: A Dataset for Dutch Natural Language Inference

    Authors: Gijs Wijnholds, Michael Moortgat

    Abstract: We present SICK-NL (read: signal), a dataset targeting Natural Language Inference in Dutch. SICK-NL is obtained by translating the SICK dataset of Marelli et al. (2014)from English into Dutch. Having a parallel inference dataset allows us to compare both monolingual and multilingual NLP models for English and Dutch on the two tasks. In the paper, we motivate and detail the translation process, per… ▽ More

    Submitted 14 January, 2021; originally announced January 2021.

    Comments: To appear at EACL 2021

  9. arXiv:2011.02895  [pdf, other

    math.LO cs.LO

    Lambek-Grishin Calculus: Focusing, Display and Full Polarization

    Authors: Giuseppe Greco, Valentin D. Richard, Michael Moortgat, Apostolos Tzimoulis

    Abstract: \emph{Focused sequent calculi} are a refinement of sequent calculi, where additional side-conditions on the applicability of inference rules force the implementation of a proof search strategy. Focused cut-free proofs exhibit a special normal form that is used for defining identity of sequent calculi proofs. We introduce a novel focused display calculus fD.LG and a fully polarized algebraic semant… ▽ More

    Submitted 5 November, 2020; originally announced November 2020.

  10. Neural Proof Nets

    Authors: Konstantinos Kogkalidis, Michael Moortgat, Richard Moot

    Abstract: Linear logic and the linear λ-calculus have a long standing tradition in the study of natural language form and meaning. Among the proof calculi of linear logic, proof nets are of particular interest, offering an attractive geometric representation of derivations that is unburdened by the bureaucratic complications of conventional prooftheoretic formats. Building on recent advances in set-theoreti… ▽ More

    Submitted 26 September, 2020; originally announced September 2020.

    Comments: 14 pages, CoNLL2020

    Journal ref: Proceedings of the 24th Conference on Computational Natural Language Learning (2020)

  11. arXiv:2005.05639  [pdf, ps, other

    cs.CL

    A Frobenius Algebraic Analysis for Parasitic Gaps

    Authors: Michael Moortgat, Mehrnoosh Sadrzadeh, Gijs Wijnholds

    Abstract: The interpretation of parasitic gaps is an ostensible case of non-linearity in natural language composition. Existing categorial analyses, both in the typelogical and in the combinatory traditions, rely on explicit forms of syntactic copying. We identify two types of parasitic gap** where the duplication of semantic content can be confined to the lexicon. Parasitic gaps in adjuncts are analysed… ▽ More

    Submitted 7 July, 2020; v1 submitted 12 May, 2020; originally announced May 2020.

    Comments: SemSpace 2019, to appear in Journal of Applied Logics

  12. arXiv:2004.04128  [pdf, other

    cs.CL cs.LO quant-ph

    Putting a Spin on Language: A Quantum Interpretation of Unary Connectives for Linguistic Applications

    Authors: Adriana D. Correia, Henk T. C. Stoof, Michael Moortgat

    Abstract: Extended versions of the Lambek Calculus currently used in computational linguistics rely on unary modalities to allow for the controlled application of structural rules affecting word order and phrase structure. These controlled structural operations give rise to derivational ambiguities that are missed by the original Lambek Calculus or its pregroup simplification. Proposals for compositional in… ▽ More

    Submitted 5 September, 2021; v1 submitted 8 April, 2020; originally announced April 2020.

    Comments: In Proceedings QPL 2020, arXiv:2109.01534

    Journal ref: EPTCS 340, 2021, pp. 114-140

  13. arXiv:1912.12635  [pdf, other

    cs.CL

    ÆTHEL: Automatically Extracted Typelogical Derivations for Dutch

    Authors: Konstantinos Kogkalidis, Michael Moortgat, Richard Moot

    Abstract: We present ÆTHEL, a semantic compositionality dataset for written Dutch. ÆTHEL consists of two parts. First, it contains a lexicon of supertags for about 900 000 words in context. The supertags correspond to types of the simply typed linear lambda-calculus, enhanced with dependency decorations that capture grammatical roles supplementary to function-argument structures. On the basis of these types… ▽ More

    Submitted 6 March, 2020; v1 submitted 29 December, 2019; originally announced December 2019.

    Comments: 8 pages plus abstract, LREC 2020

    Journal ref: Proceedings of The 12th Language Resources and Evaluation Conference (2020)

  14. arXiv:1908.07347  [pdf, other

    cs.CL quant-ph

    Density Matrices with Metric for Derivational Ambiguity

    Authors: Adriana D. Correia, Michael Moortgat, Henk T. C. Stoof

    Abstract: Recent work on vector-based compositional natural language semantics has proposed the use of density matrices to model lexical ambiguity and (graded) entailment (e.g. Piedeleu et al 2015, Bankova et al 2019, Sadrzadeh et al 2018). Ambiguous word meanings, in this work, are represented as mixed states, and the compositional interpretation of phrases out of their constituent parts takes the form of… ▽ More

    Submitted 9 July, 2020; v1 submitted 20 August, 2019; originally announced August 2019.

    Comments: 24 pages, 10 figures. SemSpace 2019, to appear in J. of Applied Logics

  15. arXiv:1908.05528  [pdf, ps, other

    cs.LO cs.CL

    Vector spaces as Kripke frames

    Authors: Giuseppe Greco, Fei Liang, Michael Moortgat, Alessandra Palmigiano, Apostolos Tzimoulis

    Abstract: In recent years, the compositional distributional approach in computational linguistics has opened the way for an integration of the \emph{lexical} aspects of meaning into Lambek's type-logical grammar program. This approach is based on the observation that a sound semantics for the associative, commutative and unital Lambek calculus can be based on vector spaces by interpreting fusion as the tens… ▽ More

    Submitted 12 May, 2021; v1 submitted 15 August, 2019; originally announced August 2019.

    Comments: Fixed list of authors in metadata

  16. Constructive Type-Logical Supertagging with Self-Attention Networks

    Authors: Konstantinos Kogkalidis, Michael Moortgat, Tejaswini Deoskar

    Abstract: We propose a novel application of self-attention networks towards grammar induction. We present an attention-based supertagger for a refined type-logical grammar, trained on constructing types inductively. In addition to achieving a high overall type accuracy, our model is able to learn the syntax of the grammar's type system along with its denotational semantics. This lifts the closed world assum… ▽ More

    Submitted 31 May, 2019; originally announced May 2019.

    Comments: REPL4NLP 4, ACL 2019

    Journal ref: Proceedings of the 4th Workshop on Representation Learning for NLP (RepL4NLP-2019)

  17. arXiv:1711.11513  [pdf, ps, other

    cs.CL

    Lexical and Derivational Meaning in Vector-Based Models of Relativisation

    Authors: Michael Moortgat, Gijs Wijnholds

    Abstract: Sadrzadeh et al (2013) present a compositional distributional analysis of relative clauses in English in terms of the Frobenius algebraic structure of finite dimensional vector spaces. The analysis relies on distinct type assignments and lexical recipes for subject vs object relativisation. The situation for Dutch is different: because of the verb final nature of Dutch, relative clauses are ambigu… ▽ More

    Submitted 1 December, 2017; v1 submitted 30 November, 2017; originally announced November 2017.

    Comments: 10 page version to appear in Proceedings Amsterdam Colloquium, updated with appendix

  18. arXiv:1112.6384  [pdf, ps, other

    cs.CL

    Proof nets for the Lambek-Grishin calculus

    Authors: Michael Moortgat, Richard Moot

    Abstract: Grishin's generalization of Lambek's Syntactic Calculus combines a non-commutative multiplicative conjunction and its residuals (product, left and right division) with a dual family: multiplicative disjunction, right and left difference. Interaction between these two families takes the form of linear distributivity principles. We study proof nets for the Lambek-Grishin calculus and the corresponde… ▽ More

    Submitted 29 December, 2011; originally announced December 2011.

    Comments: Revised version to appear as a chapter in E. Grefenstette, C. Heunen, and M. Sadrzadeh (eds.) 'Compositional Methods in Physics and Linguistics', Oxford University Press

  19. arXiv:1008.0170  [pdf, other

    cs.CL

    Symmetric categorial grammar: residuation and Galois connections

    Authors: Michael Moortgat

    Abstract: The Lambek-Grishin calculus is a symmetric extension of the Lambek calculus: in addition to the residuated family of product, left and right division operations of Lambek's original calculus, one also considers a family of coproduct, right and left difference operations, related to the former by an arrow-reversing duality. Communication between the two families is implemented in terms of linear di… ▽ More

    Submitted 1 August, 2010; originally announced August 2010.

    Comments: Submitted to the Jim Lambek Festschrift of Linguistic Analysis (LA, volume 36, to appear)