Skip to main content

Showing 1–19 of 19 results for author: Halcrow, J

.
  1. arXiv:2406.09170  [pdf, other

    cs.CL

    Test of Time: A Benchmark for Evaluating LLMs on Temporal Reasoning

    Authors: Bahare Fatemi, Mehran Kazemi, Anton Tsitsulin, Karishma Malkan, **yeong Yim, John Palowitch, Sungyong Seo, Jonathan Halcrow, Bryan Perozzi

    Abstract: Large language models (LLMs) have showcased remarkable reasoning capabilities, yet they remain susceptible to errors, particularly in temporal reasoning tasks involving complex temporal logic. Existing research has explored LLM performance on temporal reasoning using diverse datasets and benchmarks. However, these studies often rely on real-world data that LLMs may have encountered during pre-trai… ▽ More

    Submitted 13 June, 2024; originally announced June 2024.

  2. arXiv:2405.18512  [pdf, ps, other

    cs.LG cs.AI

    Understanding Transformer Reasoning Capabilities via Graph Algorithms

    Authors: Clayton Sanford, Bahare Fatemi, Ethan Hall, Anton Tsitsulin, Mehran Kazemi, Jonathan Halcrow, Bryan Perozzi, Vahab Mirrokni

    Abstract: Which transformer scaling regimes are able to perfectly solve different classes of algorithmic problems? While tremendous empirical advances have been attained by transformer-based neural networks, a theoretical understanding of their algorithmic reasoning capabilities in realistic parameter regimes is lacking. We investigate this question in terms of the network's depth, width, and number of extr… ▽ More

    Submitted 28 May, 2024; originally announced May 2024.

    Comments: 43 pages, 8 figures

  3. arXiv:2402.05862  [pdf, other

    cs.LG cs.AI cs.SI stat.ML

    Let Your Graph Do the Talking: Encoding Structured Data for LLMs

    Authors: Bryan Perozzi, Bahare Fatemi, Dustin Zelle, Anton Tsitsulin, Mehran Kazemi, Rami Al-Rfou, Jonathan Halcrow

    Abstract: How can we best encode structured data into sequential form for use in large language models (LLMs)? In this work, we introduce a parameter-efficient method to explicitly represent structured data for LLMs. Our method, GraphToken, learns an encoding function to extend prompts with explicit structured information. Unlike other work which focuses on limited domains (e.g. knowledge graph representati… ▽ More

    Submitted 8 February, 2024; originally announced February 2024.

    ACM Class: I.5.1; I.2.6; I.2.7

  4. arXiv:2310.04560  [pdf, other

    cs.LG

    Talk like a Graph: Encoding Graphs for Large Language Models

    Authors: Bahare Fatemi, Jonathan Halcrow, Bryan Perozzi

    Abstract: Graphs are a powerful tool for representing and analyzing complex relationships in real-world applications such as social networks, recommender systems, and computational finance. Reasoning on graphs is essential for drawing inferences about the relationships between entities in a complex system, and to identify hidden patterns and trends. Despite the remarkable progress in automated reasoning wit… ▽ More

    Submitted 6 October, 2023; originally announced October 2023.

  5. arXiv:2308.10737  [pdf, other

    cs.LG

    UGSL: A Unified Framework for Benchmarking Graph Structure Learning

    Authors: Bahare Fatemi, Sami Abu-El-Haija, Anton Tsitsulin, Mehran Kazemi, Dustin Zelle, Neslihan Bulut, Jonathan Halcrow, Bryan Perozzi

    Abstract: Graph neural networks (GNNs) demonstrate outstanding performance in a broad range of applications. While the majority of GNN applications assume that a graph structure is given, some recent methods substantially expanded the applicability of GNNs by showing that they may be effective even when no graph structure is explicitly provided. The GNN parameters and a graph structure are jointly learned.… ▽ More

    Submitted 21 August, 2023; originally announced August 2023.

  6. arXiv:2307.14490  [pdf, other

    cs.LG cs.DC cs.SI

    HUGE: Huge Unsupervised Graph Embeddings with TPUs

    Authors: Brandon Mayer, Anton Tsitsulin, Hendrik Fichtenberger, Jonathan Halcrow, Bryan Perozzi

    Abstract: Graphs are a representation of structured data that captures the relationships between sets of objects. With the ubiquity of available network data, there is increasing industrial and academic need to quickly analyze graphs with billions of nodes and trillions of edges. A common first step for network understanding is Graph Embedding, the process of creating a continuous representation of nodes in… ▽ More

    Submitted 26 July, 2023; originally announced July 2023.

    Comments: As appeared at KDD 2023

  7. arXiv:2212.02635  [pdf, ps, other

    cs.LG cs.DS

    Stars: Tera-Scale Graph Building for Clustering and Graph Learning

    Authors: CJ Carey, Jonathan Halcrow, Rajesh Jayaram, Vahab Mirrokni, Warren Schudy, Peilin Zhong

    Abstract: A fundamental procedure in the analysis of massive datasets is the construction of similarity graphs. Such graphs play a key role for many downstream tasks, including clustering, classification, graph learning, and nearest neighbor search. For these tasks, it is critical to build graphs which are sparse yet still representative of the underlying data. The benefits of sparsity are twofold: firstly,… ▽ More

    Submitted 9 January, 2023; v1 submitted 5 December, 2022; originally announced December 2022.

    Comments: NeurIPS 2022

  8. arXiv:2207.03522  [pdf, other

    cs.LG cs.NE cs.SI physics.soc-ph stat.ML

    TF-GNN: Graph Neural Networks in TensorFlow

    Authors: Oleksandr Ferludin, Arno Eigenwillig, Martin Blais, Dustin Zelle, Jan Pfeifer, Alvaro Sanchez-Gonzalez, Wai Lok Sibon Li, Sami Abu-El-Haija, Peter Battaglia, Neslihan Bulut, Jonathan Halcrow, Filipe Miguel Gonçalves de Almeida, Pedro Gonnet, Liangze Jiang, Parth Kothari, Silvio Lattanzi, André Linhares, Brandon Mayer, Vahab Mirrokni, John Palowitch, Mihir Paradkar, Jennifer She, Anton Tsitsulin, Kevin Villela, Lisa Wang , et al. (2 additional authors not shown)

    Abstract: TensorFlow-GNN (TF-GNN) is a scalable library for Graph Neural Networks in TensorFlow. It is designed from the bottom up to support the kinds of rich heterogeneous graph data that occurs in today's information ecosystems. In addition to enabling machine learning researchers and advanced developers, TF-GNN offers low-code solutions to empower the broader developer community in graph learning. Many… ▽ More

    Submitted 23 July, 2023; v1 submitted 7 July, 2022; originally announced July 2022.

  9. arXiv:2007.12002  [pdf, other

    cs.LG cs.SI stat.ML

    Grale: Designing Networks for Graph Learning

    Authors: Jonathan Halcrow, Alexandru Moşoi, Sam Ruth, Bryan Perozzi

    Abstract: How can we find the right graph for semi-supervised learning? In real world applications, the choice of which edges to use for computation is the first step in any graph learning process. Interestingly, there are often many types of similarity available to choose as the edges between nodes, and the choice of edges can drastically affect the performance of downstream semi-supervised learning system… ▽ More

    Submitted 23 July, 2020; originally announced July 2020.

    Comments: 10 pages, 6 figures, to be published in KDD'20

  10. Electromagnetic transition rates of Carbon-12 and Oxygen-16 in rotational-vibrational models

    Authors: C. J. Halcrow, J. I. Rawlinson

    Abstract: We develop a formalism to calculate electromagnetic (EM) transition rates for rotational-vibrational models of nuclei. The formalism is applied to recently proposed models of Carbon-12 and Oxygen-16 which are inspired by nuclear dynamics in the Skyrme model. We compare the results to experimental data, as well as other nuclear models. The results for Carbon-12 are in good agreement with the data a… ▽ More

    Submitted 27 July, 2020; v1 submitted 21 January, 2020; originally announced January 2020.

    Comments: 18 pages, 5 figures

    Journal ref: Phys. Rev. C 102, 014314 (2020)

  11. Oxygen-16 Spectrum from Tetrahedral Vibrations and their Rotational Excitations

    Authors: C. J. Halcrow, C. King, N. S. Manton

    Abstract: A reinterpretation of the complete energy spectrum of the Oxygen-16 nucleus up to 20 MeV, and partly beyond, is proposed. The underlying intrinsic shape of the nucleus is tetrahedral, as in the naïve alpha-particle model and other cluster models, and A, E and F vibrational phonons are included. The A- and F-phonons are treated in the harmonic approximation, but the E-vibrations are extended into a… ▽ More

    Submitted 29 May, 2019; v1 submitted 25 February, 2019; originally announced February 2019.

    Comments: 27 pages, 7 figures. This version accepted for publication in Int. J. Mod. Phys. E

    Report number: DAMTP-2019-6

    Journal ref: Int. J. Mod. Phys. E 28, No. 3 (2019) 1950026

  12. Effect of Coulomb energy on Skyrmions

    Authors: Nana Ma, Chris James Halcrow, Hongfei Zhang

    Abstract: The Coulomb effect, an essential ingredient in nuclear systems, is quantitatively investigated for certain Skyrmions within the Skyrme model. To do this we calculate the Coulomb energy from numerically generated multi-Skyrmions and, simultaneously, introduce an effective alpha-like particle approximation for large Skyrmions with baryon number $B$, where $B$ is a multiple of four. The calculated Co… ▽ More

    Submitted 17 January, 2019; originally announced January 2019.

    Journal ref: Phys. Rev. C 99, 044312 (2019)

  13. Quantized Skyrmions from SU(4) Weight Diagrams

    Authors: C. J. Halcrow, N. S. Manton, J. I. Rawlinson

    Abstract: Starting from solutions of the lightly-bound Skyrme model, we construct many new Skyrmion solutions of the standard Skyrme model with tetrahedral or octahedral symmetry. These solutions are closely related to weight diagrams of the group SU(4), which enables us to systematically derive some geometric and energetic properties of the Skyrmions, up to baryon number 85. We discuss the rigid body quant… ▽ More

    Submitted 20 December, 2017; originally announced December 2017.

    Comments: 31 pages, 5 figures

    Report number: DAMTP-2017-43

    Journal ref: Phys. Rev. C 97, 034307 (2018)

  14. A dynamical $α$-cluster model of $^{16}$O

    Authors: C. J. Halcrow, C. King, N. S. Manton

    Abstract: We calculate the low-lying spectrum of the $^{16}$O nucleus using an $α$-cluster model which includes the important tetrahedral and square configurations. Our approach is motivated by the dynamics of $α$-particle scattering in the Skyrme model. We are able to replicate the large energy splitting that is observed between states of identical spin but opposite parities, as well as introduce states th… ▽ More

    Submitted 17 August, 2016; originally announced August 2016.

    Comments: 5 pages, 9 figures

    Report number: DAMTP-2016-57

    Journal ref: Phys. Rev. C 95, 031303 (2017)

  15. Vibrational quantisation of the B=7 Skyrmion

    Authors: C. J. Halcrow

    Abstract: We consider the inclusion of the most important vibrational modes in the quantisation of the dodecahedral $B=7$ Skyrmion. In contrast to a rigid body quantisation, this formalism allows a spin $\frac{3}{2}$ state to lie below the spin $\frac{7}{2}$ state, in agreement with experimental data. There is also a low lying spin $\frac{1}{2}$ state and two spin $\frac{5}{2} $ states. We find that the exc… ▽ More

    Submitted 2 November, 2015; originally announced November 2015.

    Comments: 24 pages, 6 figures

    Report number: DAMTP-2015-67

    Journal ref: Nucl. Phys. B 904, 106-123, 2016

  16. A Skyrme model approach to the spin-orbit force

    Authors: C. J. Halcrow, N. S. Manton

    Abstract: The spin-orbit force is a vital tool in describing finite nuclei and nucleon interactions; however its microscopic origin is not fully understood. In this paper we study a model inspired by Skyrmions which provides a classical explanation of the force. To simplify the calculations the Skyrmions are approximated as two-dimensional rigid discs which behave like quantum cogwheels.

    Submitted 3 October, 2014; originally announced October 2014.

    Comments: 18 pages, 9 figures

    Report number: DAMTP-2014-58

    Journal ref: JHEP 2015:16

  17. Equilibrium and traveling-wave solutions of plane Couette flow

    Authors: John F. Gibson, Jonathan Halcrow, Predrag Cvitanović

    Abstract: We present ten new equilibrium solutions to plane Couette flow in small periodic cells at low Reynolds number (Re) and two new traveling-wave solutions. The solutions are continued under changes of Re and spanwise period. We provide a partial classification of the isotropy groups of plane Couette flow and show which kinds of solutions are allowed by each isotropy group. We find two complementary… ▽ More

    Submitted 16 June, 2009; v1 submitted 25 August, 2008; originally announced August 2008.

    Comments: 23 pages, 12 figures, Accepted for publication in J. Fluid Mechanics

  18. Heteroclinic connections in plane Couette flow

    Authors: Jonathan Halcrow, John F. Gibson, Predrag Cvitanović, Divakar Viswanath

    Abstract: Plane Couette flow transitions to turbulence for Re~325 even though the laminar solution with a linear profile is linearly stable for all Re (Reynolds number). One starting point for understanding this subcritical transition is the existence of invariant sets in the state space of the Navier Stokes equation, such as upper and lower branch equilibria and periodic and relative periodic solutions,… ▽ More

    Submitted 13 August, 2008; originally announced August 2008.

    Comments: 11 pages, 4 figures, to be submitted to Journal of Fluid Mechanics

  19. arXiv:0705.3957  [pdf, ps, other

    physics.flu-dyn math.DS

    Visualizing the geometry of state space in plane Couette flow

    Authors: John F. Gibson, Jonathan Halcrow, Predrag Cvitanović

    Abstract: Motivated by recent experimental and numerical studies of coherent structures in wall-bounded shear flows, we initiate a systematic exploration of the hierarchy of unstable invariant solutions of the Navier-Stokes equations. We construct a dynamical, 10^5-dimensional state-space representation of plane Couette flow at Re = 400 in a small, periodic cell and offer a new method of visualizing invar… ▽ More

    Submitted 11 February, 2008; v1 submitted 27 May, 2007; originally announced May 2007.

    Comments: 32 pages, 13 figures submitted to Journal of Fluid Mechanics