Skip to main content

Showing 1–27 of 27 results for author: Pratt-Hartmann, I

.
  1. arXiv:2402.00723  [pdf, other

    cs.CL

    Improving Semantic Control in Discrete Latent Spaces with Transformer Quantized Variational Autoencoders

    Authors: Yingji Zhang, Danilo S. Carvalho, Marco Valentino, Ian Pratt-Hartmann, Andre Freitas

    Abstract: Achieving precise semantic control over the latent spaces of Variational AutoEncoders (VAEs) holds significant value for downstream tasks in NLP as the underlying generative mechanisms could be better localised, explained and improved upon. Recent research, however, has struggled to achieve consistent results, primarily due to the inevitable loss of semantic information in the variational bottlene… ▽ More

    Submitted 1 February, 2024; originally announced February 2024.

  2. arXiv:2312.13208  [pdf, other

    cs.CL

    LlaMaVAE: Guiding Large Language Model Generation via Continuous Latent Sentence Spaces

    Authors: Yingji Zhang, Danilo S. Carvalho, Ian Pratt-Hartmann, André Freitas

    Abstract: Deep generative neural networks, such as Variational AutoEncoders (VAEs), offer an opportunity to better understand and control language models from the perspective of sentence-level latent spaces. To combine the controllability of VAE latent spaces with the state-of-the-art performance of recent large language models (LLMs), we present in this work LlaMaVAE, which combines expressive encoder and… ▽ More

    Submitted 20 December, 2023; originally announced December 2023.

  3. arXiv:2311.08579  [pdf, other

    cs.CL

    Graph-Induced Syntactic-Semantic Spaces in Transformer-Based Variational AutoEncoders

    Authors: Yingji Zhang, Marco Valentino, Danilo S. Carvalho, Ian Pratt-Hartmann, André Freitas

    Abstract: The injection of syntactic information in Variational AutoEncoders (VAEs) has been shown to result in an overall improvement of performances and generalisation. An effective strategy to achieve such a goal is to separate the encoding of distributional semantic features and syntactic structures into heterogeneous latent spaces via multi-task learning or dual encoder architectures. However, existing… ▽ More

    Submitted 14 November, 2023; originally announced November 2023.

  4. arXiv:2308.03581  [pdf, other

    cs.CL

    Towards Controllable Natural Language Inference through Lexical Inference Types

    Authors: Yingji Zhang, Danilo S. Carvalho, Ian Pratt-Hartmann, Andre Freitas

    Abstract: Explainable natural language inference aims to provide a mechanism to produce explanatory (abductive) inference chains which ground claims to their supporting premises. A recent corpus called EntailmentBank strives to advance this task by explaining the answer to a question using an entailment tree \cite{dalvi2021explaining}. They employ the T5 model to directly generate the tree, which can explai… ▽ More

    Submitted 7 August, 2023; originally announced August 2023.

  5. arXiv:2305.03133  [pdf, other

    cs.LO

    On the Limits of Decision: the Adjacent Fragment of First-Order Logic

    Authors: Bartosz Bednarczyk, Daumantas Kojelis, Ian Pratt-Hartmann

    Abstract: We define the adjacent fragment AF of first-order logic, obtained by restricting the sequences of variables occurring as arguments in atomic formulas. The adjacent fragment generalizes (after a routine renaming) two-variable logic as well as the fluted fragment. We show that the adjacent fragment has the finite model property, and that its satisfiability problem is no harder than for the fluted fr… ▽ More

    Submitted 15 June, 2023; v1 submitted 4 May, 2023; originally announced May 2023.

    Comments: Full version of our ICALP 2023 paper

  6. arXiv:2211.05417  [pdf, ps, other

    cs.CL cs.AI

    Can Transformers Reason in Fragments of Natural Language?

    Authors: Viktor Schlegel, Kamen V. Pavlov, Ian Pratt-Hartmann

    Abstract: State-of-the-art deep-learning-based approaches to Natural Language Processing (NLP) are credited with various capabilities that involve reasoning with natural language texts. In this paper we carry out a large-scale empirical study investigating the detection of formally valid inferences in controlled fragments of natural language for which the satisfiability problem becomes increasingly complex.… ▽ More

    Submitted 10 November, 2022; originally announced November 2022.

    Comments: Accepted to EMNLP 2022

  7. arXiv:2210.06230  [pdf, other

    cs.CL cs.AI

    Formal Semantic Geometry over Transformer-based Variational AutoEncoder

    Authors: Yingji Zhang, Danilo S. Carvalho, Ian Pratt-Hartmann, André Freitas

    Abstract: Formal/symbolic semantics can provide canonical, rigid controllability and interpretability to sentence representations due to their \textit{localisation} or \textit{composition} property. How can we deliver such property to the current distributional sentence representations to control and interpret the generation of language models (LMs)? In this work, we theoretically frame the sentence semanti… ▽ More

    Submitted 11 June, 2024; v1 submitted 12 October, 2022; originally announced October 2022.

  8. arXiv:2208.08913  [pdf, ps, other

    cs.DM cs.FL

    Walking on Words

    Authors: Ian Pratt-Hartmann

    Abstract: Take any word over some alphabet. If it is non-empty, go to any position and print out the letter being scanned. Now repeat the following any number of times (possibly zero): either stay at the current letter, or move one letter leftwards (if possible) or move one letter rightwards (if possible); then print out the letter being scanned. In effect, we are going for a walk on the input word. Let u b… ▽ More

    Submitted 20 April, 2024; v1 submitted 18 August, 2022; originally announced August 2022.

    Comments: Considerably extended from v1. (Secs. 4, 5 and 6 added.)

    MSC Class: 68Q42 ACM Class: F.4.2; G.2.1

  9. arXiv:2105.01974  [pdf, other

    cs.CL cs.AI

    Do Natural Language Explanations Represent Valid Logical Arguments? Verifying Entailment in Explainable NLI Gold Standards

    Authors: Marco Valentino, Ian Pratt-Hartmann, André Freitas

    Abstract: An emerging line of research in Explainable NLP is the creation of datasets enriched with human-annotated explanations and rationales, used to build and evaluate models with step-wise inference and explanation generation capabilities. While human-annotated explanations are used as ground-truth for the inference, there is a lack of systematic assessment of their consistency and rigour. In an attemp… ▽ More

    Submitted 15 May, 2021; v1 submitted 5 May, 2021; originally announced May 2021.

    Comments: To appear in IWCS 2021 proceedings

  10. The Fluted Fragment with Transitive Relations

    Authors: Ian Pratt-Hartmann, Lidia Tendera

    Abstract: We study the satisfiability problem for the fluted fragment extended with transitive relations. The logic enjoys the finite model property when only one transitive relation is available and the finite model property is lost when additionally either equality or a second transitive relation is allowed. We show that the satisfiability problem for the fluted fragment with one transitive relation and e… ▽ More

    Submitted 19 June, 2020; originally announced June 2020.

    MSC Class: 03D15 ACM Class: F.4.1; F.2.2

    Journal ref: Annals of Pure and Applied Logic 173, 2022, art. 103042, pp. 1--43

  11. arXiv:1906.09131  [pdf, other

    cs.LO

    The Fluted Fragment with Transitivity

    Authors: Ian Pratt-Hartmann, Lidia Tendera

    Abstract: We study the satisfiability problem for the fluted fragment extended with transitive relations. We show that the logic enjoys the finite model property when only one transitive relation is available. On the other hand we show that the satisfiability problem is undecidable already for the two-variable fragment of the logic in the presence of three transitive relations.

    Submitted 21 June, 2019; originally announced June 2019.

    Comments: Extended version of MFCS 2019 paper

  12. arXiv:1812.06440  [pdf, ps, other

    cs.LO

    Quine's Fluted Fragment Revisited

    Authors: I. Pratt-Hartmann, W. Szwast, L. Tendera

    Abstract: We study the fluted fragment, a decidable fragment of first-order logic with an unbounded number of variables, originally identified in 1968 by W.V. Quine. We show that the satisfiability problem for this fragment has non-elementary complexity, thus refuting an earlier published claim by W.C. Purdy that it is in NExpTime. More precisely, we consider $\mathcal{FL}^m$, the intersection of the fluted… ▽ More

    Submitted 16 December, 2018; originally announced December 2018.

  13. The Finite Satisfiability Problem for Two-Variable, First-Order Logic with one Transitive Relation is Decidable

    Authors: Ian Pratt-Hartmann

    Abstract: We consider the two-variable fragment of first-order logic with one distinguished binary predicate constrained to be interpreted as a transitive relation. The finite satisfiability problem for this logic is shown to be decidable, in triply exponential non-deterministic time. The complexity falls to doubly exponential non-deterministic time if the distinguished binary predicate is constrained to be… ▽ More

    Submitted 18 July, 2017; originally announced July 2017.

    Journal ref: Mathematical Logic Quarterly, 64(3), 2018, pp. 218--248

  14. Adding Path-Functional Dependencies to the Guarded Two-Variable Fragment with Counting

    Authors: Georgios Kourtis, Ian Pratt-Hartmann

    Abstract: The satisfiability and finite satisfiability problems for the two-variable guarded fragment of first-order logic with counting quantifiers, a database, and path-functional dependencies are both ExpTime-complete.

    Submitted 27 October, 2017; v1 submitted 26 November, 2016; originally announced November 2016.

    Journal ref: Logical Methods in Computer Science, Volume 13, Issue 4 (October 30, 2017) lmcs:2557

  15. Topological Logics with Connectedness over Euclidean Spaces

    Authors: Roman Kontchakov, Yavor Nenov, Ian Pratt-Hartmann, Michael Zakharyaschev

    Abstract: We consider the quantifier-free languages, Bc and Bc0, obtained by augmenting the signature of Boolean algebras with a unary predicate representing, respectively, the property of being connected, and the property of having a connected interior. These languages are interpreted over the regular closed sets of n-dimensional Euclidean space (n greater than 1) and, additionally, over the regular closed… ▽ More

    Submitted 18 October, 2011; originally announced October 2011.

    MSC Class: 68T30 (Primary) 03D15; 68Q17 (Secondary) ACM Class: I.2.4; F.4.3; F.2.2

    Journal ref: ACM Transactions on Computational Logic, 14(2:13), 2013

  16. The Syllogistic with Unity

    Authors: Ian Pratt-Hartmann

    Abstract: We extend the language of the classical syllogisms with the sentence-forms "At most 1 p is a q" and "More than 1 p is a q". We show that the resulting logic does not admit a finite set of syllogism-like rules whose associated derivation relation is sound and complete, even when reductio ad absurdum is allowed.

    Submitted 11 October, 2011; originally announced October 2011.

    MSC Class: 03B65 ACM Class: F.4.0

    Journal ref: Journal of Philosophical Logic, 42(2),2013 , pp 391-407

  17. arXiv:1104.0219  [pdf, ps, other

    cs.LO

    On the Decidability of Connectedness Constraints in 2D and 3D Euclidean Spaces

    Authors: Roman Kontchakov, Yavor Nenov, Ian Pratt-Hartmann, Michael Zakharyaschev

    Abstract: We investigate (quantifier-free) spatial constraint languages with equality, contact and connectedness predicates as well as Boolean operations on regions, interpreted over low-dimensional Euclidean spaces. We show that the complexity of reasoning varies dramatically depending on the dimension of the space and on the type of regions considered. For example, the logic with the interior-connectednes… ▽ More

    Submitted 1 April, 2011; originally announced April 2011.

    Comments: Accepted for publication in the IJCAI 2011 proceedings

  18. The Hamiltonian Syllogistic

    Authors: Ian Pratt-Hartmann

    Abstract: This paper undertakes a re-examination of Sir William Hamilton's doctrine of the quantification of the predicate. Hamilton's doctrine comprises two theses. First, the predicates of traditional syllogistic sentence-forms contain implicit existential quantifiers, so that, for example, "All p are q" is to be understood as "All p are some q". Second, these implicit quantifiers can be meaningfully dual… ▽ More

    Submitted 12 November, 2010; originally announced November 2010.

    Comments: 30 pages

    MSC Class: 03B65 ACM Class: F.4.1; I.2.3

    Journal ref: Journal of Logic, Language and Information, 20(4), 2011, pp. 445--474

  19. Spatial logics with connectedness predicates

    Authors: Roman Kontchakov, Ian Pratt-Hartmann, Frank Wolter, Michael Zakharyaschev

    Abstract: We consider quantifier-free spatial logics, designed for qualitative spatial representation and reasoning in AI, and extend them with the means to represent topological connectedness of regions and restrict the number of their connected components. We investigate the computational complexity of these logics and show that the connectedness constraints can increase complexity from NP to PSpace, Exp… ▽ More

    Submitted 18 October, 2010; v1 submitted 28 March, 2010; originally announced March 2010.

    Comments: Some results of the paper were presented at LPAR 2008 and ECAI 2000

    ACM Class: F.4.1, I.2.4

    Journal ref: Logical Methods in Computer Science, Volume 6, Issue 3 (August 18, 2010) lmcs:1229

  20. arXiv:0911.5246  [pdf, ps, other

    cs.LO

    Complex Algebras of Arithmetic

    Authors: Ivo Düntsch, Ian Pratt-Hartmann

    Abstract: An 'arithmetic circuit' is a labeled, acyclic directed graph specifying a sequence of arithmetic and logical operations to be performed on sets of natural numbers. Arithmetic circuits can also be viewed as the elements of the smallest subalgebra of the complex algebra of the semiring of natural numbers. In the present paper, we investigate the algebraic structure of complex algebras of natural n… ▽ More

    Submitted 1 December, 2009; v1 submitted 27 November, 2009; originally announced November 2009.

    ACM Class: F.1.1

    Journal ref: Fundamenta Informaticae, 97 (4), 2009, pp. 347-367

  21. Functions Definable by Numerical Set-Expressions

    Authors: Ian Pratt-Hartmann, Ivo Düntsch

    Abstract: A "numerical set-expression" is a term specifying a cascade of arithmetic and logical operations to be performed on sets of non-negative integers. If these operations are confined to the usual Boolean operations together with the result of lifting addition to the level of sets, we speak of "additive circuits". If they are confined to the usual Boolean operations together with the result of lifti… ▽ More

    Submitted 31 October, 2009; originally announced November 2009.

    ACM Class: F.1.1

    Journal ref: Journal of Logic and Computation, 24(4), 2013, pp. 873-895

  22. arXiv:0905.3108  [pdf, ps, other

    cs.LO cs.AI cs.CC

    A Note on the Complexity of the Satisfiability Problem for Graded Modal Logics

    Authors: Yevgeny Kazakov, Ian Pratt-Hartmann

    Abstract: Graded modal logic is the formal language obtained from ordinary (propositional) modal logic by endowing its modal operators with cardinality constraints. Under the familiar possible-worlds semantics, these augmented modal operators receive interpretations such as "It is true at no fewer than 15 accessible worlds that...", or "It is true at no more than 2 accessible worlds that...". We investiga… ▽ More

    Submitted 19 May, 2009; originally announced May 2009.

    Comments: Full proofs for paper presented at the IEEE Conference on Logic in Computer Science, 2009

    ACM Class: F.4.1; F.2.2

    Journal ref: Proceedings, 24th Annual IEEE Symposium on Logic in Computer Science (LICS '09), IEEE Press, 2009, pp. 407--416

  23. arXiv:0808.0521  [pdf, ps, other

    cs.LO cs.CC cs.CL

    Logics for the Relational Syllogistic

    Authors: Ian Pratt-Hartmann, Lawrence S. Moss

    Abstract: The Aristotelian syllogistic cannot account for the validity of many inferences involving relational facts. In this paper, we investigate the prospects for providing a relational syllogistic. We identify several fragments based on (a) whether negation is permitted on all nouns, including those in the subject of a sentence; and (b) whether the subject noun phrase may contain a relative clause. Th… ▽ More

    Submitted 4 August, 2008; originally announced August 2008.

    ACM Class: F.4.1; I.2.3

    Journal ref: Review of Symbolic Logic, 2(4), 2009, pp. 647--683

  24. arXiv:0806.1636  [pdf, ps, other

    cs.LO cs.AI cs.CC

    Data-Complexity of the Two-Variable Fragment with Counting Quantifiers

    Authors: Ian Pratt-Hartmann

    Abstract: The data-complexity of both satisfiability and finite satisfiability for the two-variable fragment with counting is NP-complete; the data-complexity of both query-answering and finite query-answering for the two-variable guarded fragment with counting is co-NP-complete.

    Submitted 10 June, 2008; originally announced June 2008.

    ACM Class: F.4.1

    Journal ref: Information and Computation, 207(8), 2009, pp. 867--888

  25. arXiv:cs/0701039  [pdf, ps, other

    cs.LO cs.AI cs.CC

    On the Complexity of the Numerically Definite Syllogistic and Related Fragments

    Authors: Ian Pratt-Hartmann

    Abstract: In this paper, we determine the complexity of the satisfiability problem for various logics obtained by adding numerical quantifiers, and other constructions, to the traditional syllogistic. In addition, we demonstrate the incompleteness of some recently proposed proof-systems for these logics.

    Submitted 6 January, 2007; originally announced January 2007.

    Comments: 24 pages 1 figure

    ACM Class: F.4.1

    Journal ref: Bulletin of Symbolic Logic, 14(1), 2008, pp. 1--28

  26. Complexity of the Guarded Two-Variable Fragment with Counting Quantifiers

    Authors: Ian Pratt-Hartmann

    Abstract: We show that the finite satisfiability problem for the guarded two-variable fragment with counting quantifiers is in EXPTIME. The method employed also yields a simple proof of a result recently obtained by Y. Kazakov, that the satisfiability problem for the guarded two-variable fragment with counting quantifiers is in EXPTIME.

    Submitted 26 January, 2006; originally announced January 2006.

    Comments: 20 pages, 3 figures

    Journal ref: Journal of Logic and Computation, 17(1), 2007, pp. 133--155

  27. Complexity of the Two-Variable Fragment with (Binary-Coded) Counting Quantifiers

    Authors: Ian Pratt-Hartmann

    Abstract: We show that the satisfiability and finite satisfiability problems for the two-variable fragment of first-order logic with counting quantifiers are both in NEXPTIME, even when counting quantifiers are coded succinctly.

    Submitted 10 November, 2004; originally announced November 2004.

    Comments: 24 pages, 1 pstex_t figure

    ACM Class: F.4.1

    Journal ref: Journal of Logic, Language and Information, 14(3), 2005, pp. 369--395