Skip to main content

Showing 1–16 of 16 results for author: Chi, R

.
  1. arXiv:2406.17038  [pdf, other

    cs.CL

    modeLing: A Novel Dataset for Testing Linguistic Reasoning in Language Models

    Authors: Nathan A. Chi, Teodor Malchev, Riley Kong, Ryan A. Chi, Lucas Huang, Ethan A. Chi, R. Thomas McCoy, Dragomir Radev

    Abstract: We introduce modeLing, a novel benchmark of Linguistics Olympiad-style puzzles which tests few-shot reasoning in AI systems. Solving these puzzles necessitates inferring aspects of a language's grammatical structure from a small number of examples. Such puzzles provide a natural testbed for language models, as they require compositional generalization and few-shot inductive reasoning. Consisting s… ▽ More

    Submitted 24 June, 2024; originally announced June 2024.

  2. arXiv:2406.06196  [pdf, other

    cs.CL

    LINGOLY: A Benchmark of Olympiad-Level Linguistic Reasoning Puzzles in Low-Resource and Extinct Languages

    Authors: Andrew M. Bean, Simi Hellsten, Harry Mayne, Jabez Magomere, Ethan A. Chi, Ryan Chi, Scott A. Hale, Hannah Rose Kirk

    Abstract: In this paper, we present the LingOly benchmark, a novel benchmark for advanced reasoning abilities in large language models. Using challenging Linguistic Olympiad puzzles, we evaluate (i) capabilities for in-context identification and generalisation of linguistic patterns in very low-resource or extinct languages, and (ii) abilities to follow complex task instructions. The LingOly benchmark cover… ▽ More

    Submitted 11 June, 2024; v1 submitted 10 June, 2024; originally announced June 2024.

    Comments: 9 pages, 5 figures, 16 pages supplemental materials

  3. arXiv:2404.14163  [pdf, other

    cond-mat.str-el

    Dynamical Spectra of Spin Supersolid States in Triangular Antiferromagnets

    Authors: Runze Chi, Jiahang Hu, Hai-Jun Liao, T. Xiang

    Abstract: We employ tensor network renormalization to explore the dynamical spectra of the easy-axis triangular-lattice antiferromagnet (TLAF) in a magnetic field. Our analysis identifies two distinct low-energy magnon excitations: a gapless Goldstone mode and a gapped mode. At zero field, the spectra display two nearly degenerate roton modes near the M point. With the increase of the magnetic field within… ▽ More

    Submitted 22 April, 2024; originally announced April 2024.

  4. arXiv:2403.12141  [pdf, other

    cond-mat.str-el

    Fractionalization Signatures in the Dynamics of Quantum Spin Liquids

    Authors: Kang Wang, Shi Feng, Penghao Zhu, Runze Chi, Hai-Jun Liao, Nandini Trivedi, Tao Xiang

    Abstract: We investigate the signatures of fractionalization in quantum spin liquids by studying different phases of the Kitaev honeycomb model in the presence of an out-of-plane magnetic field through which the model becomes non-integrable. Using the infinite Projected Entangled Pair States (iPEPS) ansatz, along with analytical calculations and exact diagonalization, we calculate dynamical signatures of fr… ▽ More

    Submitted 20 March, 2024; v1 submitted 18 March, 2024; originally announced March 2024.

    Comments: 5+8 pages, 4+9 figures

  5. arXiv:2402.08939  [pdf, other

    cs.AI cs.CL

    Premise Order Matters in Reasoning with Large Language Models

    Authors: Xinyun Chen, Ryan A. Chi, Xuezhi Wang, Denny Zhou

    Abstract: Large language models (LLMs) have accomplished remarkable reasoning performance in various domains. However, in the domain of reasoning tasks, we discover a frailty: LLMs are surprisingly brittle to the ordering of the premises, despite the fact that such ordering does not alter the underlying task. In particular, we observe that LLMs achieve the best performance when the premise order aligns with… ▽ More

    Submitted 28 May, 2024; v1 submitted 13 February, 2024; originally announced February 2024.

    Comments: Published at ICML 2024. Xinyun and Ryan contribute equally

  6. arXiv:2401.08980  [pdf, other

    cond-mat.str-el

    Luttinger Liquid phase in the Aubry-André Hubbard chain

    Authors: Runze Chi, Josephine J. Yu, Chaitanya Murthy, T. Xiang

    Abstract: We study the interplay between an on-site Hubbard repulsion and quasiperiodic potential in one-dimensional fermion chains using the density matrix renormalization group. We find that, at half-filling, the quasiperiodic potential can destroy the Mott gap, leading to a metallic Luttinger liquid phase between the gapped Mott insulator at strong repulsion and localized gapless Aubry- André insulator a… ▽ More

    Submitted 17 January, 2024; originally announced January 2024.

  7. 2D excitation information by MPS method on infinite helixes

    Authors: Xing-Yu Zhang, Runze Chi, Yang Liu, Lei Wang

    Abstract: Understanding the excitation spectrum in two-dimensional quantum many-body systems has long been a challenging task. We present an approach by introducing an excitation ansatz based on an infinite matrix product state (MPS) on a helix structure. With the canonical form of MPS states, we can accurately extract key properties such as energy, degeneracy, spectrum weight, and scaling behavior of low-e… ▽ More

    Submitted 23 February, 2024; v1 submitted 24 October, 2023; originally announced October 2023.

    Journal ref: Phys. Rev. B 109, 075129 (2024)

  8. Spectral evidence for Dirac spinons in a kagome lattice antiferromagnet

    Authors: Zhenyuan Zeng, Chengkang Zhou, Honglin Zhou, Lankun Han, Runze Chi, Kuo Li, Maiko Kofu, Kenji Nakajima, Yuan Wei, Wenliang Zhang, Daniel G. Mazzone, Zi Yang Meng, Shiliang Li

    Abstract: Emergent quasiparticles with a Dirac dispersion in condensed matter systems can be described by the Dirac equation for relativistic electrons, in analogy with Dirac particles in high-energy physics. For example, electrons with a Dirac dispersion have been intensively studied in electronic systems such as graphene and topological insulators. However, charge is not a prerequisite for Dirac fermions,… ▽ More

    Submitted 21 May, 2024; v1 submitted 17 October, 2023; originally announced October 2023.

    Comments: 6 pages, 4 figures

    Journal ref: Nat. Phys. (2024)

  9. arXiv:2305.15868  [pdf, other

    cond-mat.str-el

    Accurate determination of low-energy eigenspectra with multi-target matrix product states

    Authors: Xuan Li, Zongsheng Zhou, Guanglei Xu, Runze Chi, Yibin Guo, Tong Liu, Haijun Liao, Tao Xiang

    Abstract: Determining the low-energy eigenspectra of quantum many-body systems is a long-standing challenge in physics. In this work, we solve this problem by introducing two novel algorithms to determine low-energy eigenstates based on a compact matrix product state (MPS) representation of the multiple targeted eigenstates. The first algorithm utilizes a canonicalization approach that takes advantage of th… ▽ More

    Submitted 25 May, 2023; originally announced May 2023.

    Comments: 11 pages, 6 figures

  10. arXiv:2212.10972  [pdf, other

    cond-mat.str-el cond-mat.supr-con

    Umklapp scattering in the one-dimensional Hubbard model

    Authors: Tong Liu, Kang Wang, Runze Chi, Yang Liu, Haijun Liao, Tao Xiang

    Abstract: The Mott metal-insulator transition is a typical strong correlation effect triggered by the Umklapp scattering. However, in a physical system, the Umklapp scattering coexists with the normal scattering, including both forward and backward scattering, which conserves the total momentum of scattered electrons. Therefore, it is not easy to quantify the contribution of the Umklapp scattering in a Mott… ▽ More

    Submitted 21 December, 2022; originally announced December 2022.

    Comments: 7 pages,6 figures

  11. arXiv:2211.09110  [pdf, other

    cs.CL cs.AI cs.LG

    Holistic Evaluation of Language Models

    Authors: Percy Liang, Rishi Bommasani, Tony Lee, Dimitris Tsipras, Dilara Soylu, Michihiro Yasunaga, Yian Zhang, Deepak Narayanan, Yuhuai Wu, Ananya Kumar, Benjamin Newman, Binhang Yuan, Bobby Yan, Ce Zhang, Christian Cosgrove, Christopher D. Manning, Christopher Ré, Diana Acosta-Navas, Drew A. Hudson, Eric Zelikman, Esin Durmus, Faisal Ladhak, Frieda Rong, Hongyu Ren, Huaxiu Yao , et al. (25 additional authors not shown)

    Abstract: Language models (LMs) are becoming the foundation for almost all major language technologies, but their capabilities, limitations, and risks are not well understood. We present Holistic Evaluation of Language Models (HELM) to improve the transparency of language models. First, we taxonomize the vast space of potential scenarios (i.e. use cases) and metrics (i.e. desiderata) that are of interest fo… ▽ More

    Submitted 1 October, 2023; v1 submitted 16 November, 2022; originally announced November 2022.

    Comments: Authored by the Center for Research on Foundation Models (CRFM) at the Stanford Institute for Human-Centered Artificial Intelligence (HAI). Project page: https://crfm.stanford.edu/helm/v1.0

    Journal ref: Published in Transactions on Machine Learning Research (TMLR), 2023

  12. arXiv:2206.04615  [pdf, other

    cs.CL cs.AI cs.CY cs.LG stat.ML

    Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

    Authors: Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R. Brown, Adam Santoro, Aditya Gupta, Adrià Garriga-Alonso, Agnieszka Kluska, Aitor Lewkowycz, Akshat Agarwal, Alethea Power, Alex Ray, Alex Warstadt, Alexander W. Kocurek, Ali Safaya, Ali Tazarv, Alice Xiang, Alicia Parrish, Allen Nie, Aman Hussain, Amanda Askell, Amanda Dsouza , et al. (426 additional authors not shown)

    Abstract: Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabilities are as yet poorly characterized. In order to inform future research, prepare for disruptive new model capabilities, and ameliorate socially harmful effects, it is vital that we understand the present and near-futur… ▽ More

    Submitted 12 June, 2023; v1 submitted 9 June, 2022; originally announced June 2022.

    Comments: 27 pages, 17 figures + references and appendices, repo: https://github.com/google/BIG-bench

    Journal ref: Transactions on Machine Learning Research, May/2022, https://openreview.net/forum?id=uyTL5Bvosj

  13. arXiv:2201.12121  [pdf, other

    cond-mat.str-el cond-mat.mtrl-sci

    Spin Excitation Spectra of Anisotropic Spin-$1/2$ Triangular Lattice Heisenberg Antiferromagnets

    Authors: Run-Ze Chi, Yang Liu, Yuan Wan, Hai-Jun Liao, T. Xiang

    Abstract: Investigation of dynamical excitations is difficult but crucial to the understanding of many exotic quantum phenomena discovered in quantum materials. This is particularly true for highly frustrated quantum antiferromagnets whose dynamical properties deviate strongly from theoretical predictions made based on the spin-wave or other approximations. Here we present a large-scale numerical calculatio… ▽ More

    Submitted 23 November, 2022; v1 submitted 28 January, 2022; originally announced January 2022.

    Comments: 6 pages, 3 figures, and a Supplemental Material

    Journal ref: Phys. Rev. Lett. 129, 227201(2022)

  14. arXiv:2105.09793  [pdf, other

    cond-mat.mes-hall cond-mat.quant-gas quant-ph

    Entanglement Entropy of Non-Hermitian Free Fermions

    Authors: Yi-Bin Guo, Yi-Cong Yu, Rui-Zhen Huang, Li-** Yang, Run-Ze Chi, Hai-Jun Liao, Tao Xiang

    Abstract: We study the entanglement properties of non-Hermitian free fermionic models with translation symmetry using the correlation matrix technique. Our results show that the entanglement entropy has a logarithmic correction to the area law in both one-dimensional and two-dimensional systems. For any one-dimensional one-band system, we prove that each Fermi point of the system contributes exactly 1/2 to… ▽ More

    Submitted 2 September, 2021; v1 submitted 20 May, 2021; originally announced May 2021.

    Comments: 10 pages, 8 figures and 1 table, includes appendix

  15. arXiv:1912.11480  [pdf, ps, other

    eess.SY

    Data-Driven Robust Stabilization with Robust DOA Enlargement for Nonlinear Systems

    Authors: Chaolun Lu, Yongqiang Li, Zhongsheng Hou, Yuan**g Feng, Yu Feng, Ronghu Chi, Xuhui Bu

    Abstract: Most of nonlinear robust control methods just consider the affine nonlinear nominal model. When the nominal model is assumed to be affine nonlinear, available information about existing non-affine nonlinearities is ignored. For non-affine nonlinear system, Li et al. (2019) proposes a new nonlinear control method to solve the robust stabilization problem with estimation of the robust closed-loop DO… ▽ More

    Submitted 24 December, 2019; originally announced December 2019.

    Comments: 6 pages, 6 figures, preprint submitted to IFAC World Congress(2020). arXiv admin note: text overlap with arXiv:1909.12561

  16. arXiv:0803.1748  [pdf

    cs.SE cs.CY

    A Computational Framework for the Near Elimination of Spreadsheet Risk

    Authors: Yusuf Jafry, Fredrika Sidoroff, Roger Chi

    Abstract: We present Risk Integrated's Enterprise Spreadsheet Platform (ESP), a technical approach to the near-elimination of spreadsheet risk in the enterprise computing environment, whilst maintaining the full flexibility of spreadsheets for modelling complex financial structures and processes. In its Basic Mode of use, the system comprises a secure and robust centralised spreadsheet management framewor… ▽ More

    Submitted 12 March, 2008; originally announced March 2008.

    Comments: 9 pages, 3 colour figures

    ACM Class: D.1.7; D.2.1; D.2.11; D.3.2; H.4.1; K.6.4; K.8.1

    Journal ref: Proc. European Spreadsheet Risks Int. Grp. (EuSpRIG) 2006 85-93 ISBN:1-905617-08-9