Skip to main content

Showing 1–20 of 20 results for author: Kinney, R

.
  1. arXiv:2402.00838  [pdf, other

    cs.CL

    OLMo: Accelerating the Science of Language Models

    Authors: Dirk Groeneveld, Iz Beltagy, Pete Walsh, Akshita Bhagia, Rodney Kinney, Oyvind Tafjord, Ananya Harsh Jha, Hamish Ivison, Ian Magnusson, Yizhong Wang, Shane Arora, David Atkinson, Russell Authur, Khyathi Raghavi Chandu, Arman Cohan, Jennifer Dumas, Yanai Elazar, Yuling Gu, Jack Hessel, Tushar Khot, William Merrill, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam , et al. (18 additional authors not shown)

    Abstract: Language models (LMs) have become ubiquitous in both NLP research and in commercial product offerings. As their commercial importance has surged, the most powerful models have become closed off, gated behind proprietary interfaces, with important details of their training data, architectures, and development undisclosed. Given the importance of these details in scientifically studying these models… ▽ More

    Submitted 7 June, 2024; v1 submitted 1 February, 2024; originally announced February 2024.

  2. arXiv:2402.00159  [pdf, other

    cs.CL

    Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research

    Authors: Luca Soldaini, Rodney Kinney, Akshita Bhagia, Dustin Schwenk, David Atkinson, Russell Authur, Ben Bogin, Khyathi Chandu, Jennifer Dumas, Yanai Elazar, Valentin Hofmann, Ananya Harsh Jha, Sachin Kumar, Li Lucy, Xinxi Lyu, Nathan Lambert, Ian Magnusson, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Abhilasha Ravichander, Kyle Richardson, Zejiang Shen , et al. (11 additional authors not shown)

    Abstract: Information about pretraining corpora used to train the current best-performing language models is seldom discussed: commercial models rarely detail their data, and even open models are often released without accompanying training data or recipes to reproduce them. As a result, it is challenging to conduct and advance scientific research on language modeling, such as understanding how training dat… ▽ More

    Submitted 6 June, 2024; v1 submitted 31 January, 2024; originally announced February 2024.

    Comments: Accepted at ACL 2024; Dataset: https://hf.co/datasets/allenai/dolma; Code: https://github.com/allenai/dolma

  3. arXiv:2306.09360  [pdf, other

    nucl-ex hep-ex hep-ph nucl-th

    Strong Interaction Physics at the Luminosity Frontier with 22 GeV Electrons at Jefferson Lab

    Authors: A. Accardi, P. Achenbach, D. Adhikari, A. Afanasev, C. S. Akondi, N. Akopov, M. Albaladejo, H. Albataineh, M. Albrecht, B. Almeida-Zamora, M. Amaryan, D. Androić, W. Armstrong, D. S. Armstrong, M. Arratia, J. Arrington, A. Asaturyan, A. Austregesilo, H. Avagyan, T. Averett, C. Ayerbe Gayoso, A. Bacchetta, A. B. Balantekin, N. Baltzell, L. Barion , et al. (419 additional authors not shown)

    Abstract: This document presents the initial scientific case for upgrading the Continuous Electron Beam Accelerator Facility (CEBAF) at Jefferson Lab (JLab) to 22 GeV. It is the result of a community effort, incorporating insights from a series of workshops conducted between March 2022 and April 2023. With a track record of over 25 years in delivering the world's most intense and precise multi-GeV electron… ▽ More

    Submitted 24 August, 2023; v1 submitted 13 June, 2023; originally announced June 2023.

    Comments: Updates to the list of authors; Preprint number changed from theory to experiment; Updates to sections 4 and 6, including additional figures

    Report number: JLAB-PHY-23-3840

  4. arXiv:2303.14334  [pdf, other

    cs.HC cs.AI cs.CL

    The Semantic Reader Project: Augmenting Scholarly Documents through AI-Powered Interactive Reading Interfaces

    Authors: Kyle Lo, Joseph Chee Chang, Andrew Head, Jonathan Bragg, Amy X. Zhang, Cassidy Trier, Chloe Anastasiades, Tal August, Russell Authur, Danielle Bragg, Erin Bransom, Isabel Cachola, Stefan Candra, Yoganand Chandrasekhar, Yen-Sung Chen, Evie Yu-Yen Cheng, Yvonne Chou, Doug Downey, Rob Evans, Raymond Fok, Fangzhou Hu, Regan Huff, Dongyeop Kang, Tae Soo Kim, Rodney Kinney , et al. (30 additional authors not shown)

    Abstract: Scholarly publications are key to the transfer of knowledge from scholars to others. However, research papers are information-dense, and as the volume of the scientific literature grows, the need for new technology to support the reading process grows. In contrast to the process of finding papers, which has been transformed by Internet technology, the experience of reading research papers has chan… ▽ More

    Submitted 23 April, 2023; v1 submitted 24 March, 2023; originally announced March 2023.

  5. Estimation of Combinatoric Background in SeaQuest using an Event-Mixing Method

    Authors: S. F. Pate, A. Pun, M. F. Hossain, K. Nagai, C. A. Aidala, C. Ayuso, L. El Fassi, D. F. Geesaman, T. J. Hague, E. R. Kinney, W. Lorenzon, K. Nakano, P. E. Reimer, M. B. C. Scott, R. S. Towell

    Abstract: All experiments observing dilepton pairs (e.g. $e^+e^-$, $μ^+μ^-$) must confront the existence of a combinatoric background caused by the combining of tracks not arising from the same physics vertex. Some method must be devised to calculate and remove this background. In this document we describe a particular event-mixing method relying on many of the unique aspects of the SeaQuest spectrometer an… ▽ More

    Submitted 11 August, 2023; v1 submitted 8 February, 2023; originally announced February 2023.

    Comments: Submitted to JINST; revised due to second round of referee comments

    Report number: FERMILAB-PUB-23-044-PPD

    Journal ref: JINST 18 P10032 (2023)

  6. arXiv:2301.10140  [pdf, other

    cs.DL cs.CL

    The Semantic Scholar Open Data Platform

    Authors: Rodney Kinney, Chloe Anastasiades, Russell Authur, Iz Beltagy, Jonathan Bragg, Alexandra Buraczynski, Isabel Cachola, Stefan Candra, Yoganand Chandrasekhar, Arman Cohan, Miles Crawford, Doug Downey, Jason Dunkelberger, Oren Etzioni, Rob Evans, Sergey Feldman, Joseph Gorney, David Graham, Fangzhou Hu, Regan Huff, Daniel King, Sebastian Kohlmeier, Bailey Kuehl, Michael Langan, Daniel Lin , et al. (23 additional authors not shown)

    Abstract: The volume of scientific output is creating an urgent need for automated tools to help scientists keep up with developments in their field. Semantic Scholar (S2) is an open data platform and website aimed at accelerating science by hel** scholars discover and understand scientific literature. We combine public and proprietary data sources using state-of-the-art techniques for scholarly PDF conte… ▽ More

    Submitted 24 January, 2023; originally announced January 2023.

    Comments: 8 pages, 6 figures

  7. arXiv:2212.12160  [pdf, other

    hep-ph hep-ex nucl-ex

    Measurement of flavor asymmetry of light-quark sea in the proton with Drell-Yan dimuon production in $p+p$ and $p+d$ collisions at 120 GeV

    Authors: J. Dove, B. Kerns, C. Leung, R. E. McClellan, S. Miyasaka, D. H. Morton, K. Nagai, S. Prasad, F. Sanftl, M. B. C. Scott, A. S. Tadepalli, C. A. Aidala, J. Arrington, C. Ayuso, C. T. Barker, C. N. Brown, T. H. Chang, W. C. Chang, A. Chen, D. C. Christian, B. P. Dannowitz, M. Daugherity, M. Diefenthaler, L. El Fassi, D. F. Geesaman , et al. (44 additional authors not shown)

    Abstract: Evidence for a flavor asymmetry between the $\bar u$ and $\bar d$ quark distributions in the proton has been found in deep-inelastic scattering and Drell-Yan experiments. The pronounced dependence of this flavor asymmetry on $x$ (fraction of nucleon momentum carried by partons) observed in the Fermilab E866 Drell-Yan experiment suggested a drop of the $\bar d\left(x\right) / \bar u\left(x\right)$… ▽ More

    Submitted 2 October, 2023; v1 submitted 23 December, 2022; originally announced December 2022.

  8. arXiv:2209.11838  [pdf, other

    nucl-ex

    Jefferson Lab Hall C: Precision Physics at the Luminosity Frontier

    Authors: J. Benesch, V. Berdnikov, P. Brindza, S. Covrig Dusa, D. Dutta, D. Gaskell, T. Gogami, J. M. Grames, D. J. Hamilton, D. W. Higinbotham, T. Horn, G. M. Huber, M. K. Jones, C. Keith, C. Keppel, E. R. Kinney, W. B. Li, Shujie Li, N. Liyanage, E. Long, D. J. Mack, B. Metzger, C. Muñoz Camacho, S. N. Nakamura, B. Sawatzky , et al. (6 additional authors not shown)

    Abstract: Over the last three decades, Hall C has been a key contributor to progress in the understanding of hadron structure and interactions. An outline of a potential future Hall C physics program focused on precision measurements of small cross sections is presented. A detailed overview of this unique facility, whose flexible configuration allows many opportunities for new experimental equipment that he… ▽ More

    Submitted 23 September, 2022; originally announced September 2022.

    Comments: 67 pages, 20 figures

  9. arXiv:2103.04024  [pdf, ps, other

    hep-ph hep-ex nucl-ex

    The Asymmetry of Antimatter in the Proton

    Authors: J. Dove, B. Kerns, R. E. McClellan, S. Miyasaka, D. H. Morton, K. Nagai, S. Prasad, F. Sanftl, M. B. C. Scott, A. S. Tadepalli, C. A. Aidala, J. Arrington, C. Ayuso, C. L. Barker, C. N. Brown, W. C. Chang, A. Chen, D. C. Christian, B. P. Dannowitz, M. Daugherity, M. Diefenthaler, L. El Fassi, D. F. Geesaman, R. Gilman, Y. Goto , et al. (42 additional authors not shown)

    Abstract: The fundamental building blocks of the proton, quarks and gluons, have been known for decades. However, we still have an incomplete theoretical and experimental understanding of how these particles and their dynamics give rise to the quantum bound state of the proton and its physical properties, such as for example its spin. The two up and the single down quarks that comprise the proton in the sim… ▽ More

    Submitted 5 March, 2021; originally announced March 2021.

    Comments: 10 pages, 5 figures, 5 tables; Matches published version

    Report number: FERMILAB-PUB-21-073-E

    Journal ref: Nature, 590, 561-565 (2021)

  10. arXiv:2004.10706  [pdf, other

    cs.DL cs.CL

    CORD-19: The COVID-19 Open Research Dataset

    Authors: Lucy Lu Wang, Kyle Lo, Yoganand Chandrasekhar, Russell Reas, Jiangjiang Yang, Doug Burdick, Darrin Eide, Kathryn Funk, Yannis Katsis, Rodney Kinney, Yunyao Li, Ziyang Liu, William Merrill, Paul Mooney, Dewey Murdick, Devvret Rishi, Jerry Sheehan, Zhihong Shen, Brandon Stilson, Alex Wade, Kuansan Wang, Nancy Xin Ru Wang, Chris Wilhelm, Boya Xie, Douglas Raymond , et al. (3 additional authors not shown)

    Abstract: The COVID-19 Open Research Dataset (CORD-19) is a growing resource of scientific papers on COVID-19 and related historical coronavirus research. CORD-19 is designed to facilitate the development of text mining and information retrieval systems over its rich collection of metadata and structured full text papers. Since its release, CORD-19 has been downloaded over 200K times and has served as the b… ▽ More

    Submitted 10 July, 2020; v1 submitted 22 April, 2020; originally announced April 2020.

    Comments: ACL NLP-COVID Workshop 2020

  11. arXiv:1911.02782  [pdf, other

    cs.CL cs.DL

    S2ORC: The Semantic Scholar Open Research Corpus

    Authors: Kyle Lo, Lucy Lu Wang, Mark Neumann, Rodney Kinney, Dan S. Weld

    Abstract: We introduce S2ORC, a large corpus of 81.1M English-language academic papers spanning many academic disciplines. The corpus consists of rich metadata, paper abstracts, resolved bibliographic references, as well as structured full text for 8.1M open access papers. Full text is annotated with automatically-detected inline mentions of citations, figures, and tables, each linked to their corresponding… ▽ More

    Submitted 6 July, 2020; v1 submitted 7 November, 2019; originally announced November 2019.

    Comments: ACL 2020

  12. arXiv:1805.02262  [pdf, other

    cs.CL

    Construction of the Literature Graph in Semantic Scholar

    Authors: Waleed Ammar, Dirk Groeneveld, Chandra Bhagavatula, Iz Beltagy, Miles Crawford, Doug Downey, Jason Dunkelberger, Ahmed Elgohary, Sergey Feldman, Vu Ha, Rodney Kinney, Sebastian Kohlmeier, Kyle Lo, Tyler Murray, Hsu-Han Ooi, Matthew Peters, Joanna Power, Sam Skjonsberg, Lucy Lu Wang, Chris Wilhelm, Zheng Yuan, Madeleine van Zuylen, Oren Etzioni

    Abstract: We describe a deployed scalable system for organizing published scientific literature into a heterogeneous graph to facilitate algorithmic manipulation and discovery. The resulting literature graph consists of more than 280M nodes, representing papers, authors, entities and various interactions between them (e.g., authorships, citations, entity mentions). We reduce literature graph construction in… ▽ More

    Submitted 6 May, 2018; originally announced May 2018.

    Comments: To appear in NAACL 2018 industry track

  13. arXiv:1706.09990  [pdf, other

    physics.ins-det nucl-ex

    The SeaQuest Spectrometer at Fermilab

    Authors: SeaQuest Collaboration, C. A. Aidala, J. R. Arrington, C. Ayuso, B. M. Bowen, M. L. Bowen, K. L. Bowling, A. W. Brown, C. N. Brown, R. Byrd, R. E. Carlisle, T. Chang, W. -C. Chang, A. Chen, J. -Y. Chen, D. C. Christian, X. Chu, B. P. Dannowitz, M. Daugherity, M. Diefenthaler, J. Dove, C. Durandet, L. El Fassi, E. Erdos, D. M. Fox , et al. (73 additional authors not shown)

    Abstract: The SeaQuest spectrometer at Fermilab was designed to detect oppositely-charged pairs of muons (dimuons) produced by interactions between a 120 GeV proton beam and liquid hydrogen, liquid deuterium and solid nuclear targets. The primary physics program uses the Drell-Yan process to probe antiquark distributions in the target nucleon. The spectrometer consists of a target system, two dipole magnets… ▽ More

    Submitted 9 February, 2019; v1 submitted 29 June, 2017; originally announced June 2017.

    Report number: FERMILAB-PUB-17-209-E

  14. Angular dependence of recoil proton polarization in high-energy γd \to p n

    Authors: X. Jiang, J. Arrington, F. Benmokhtar, A. Camsonne, J. P. Chen, S. Choi, E. Chudakov, F. Cusanno, A. Deur, D. Dutta, F. Garibaldi, D. Gaskell, O. Gayou, R. Gilman, C. Glashauser, D. Hamilton, O. Hansen, D. W. Higinbotham, R. J. Holt, C. W. de Jager, M. K. Jones, L. J. Kaufman, E. R. Kinney, K. Kramer, L. Lagamba , et al. (30 additional authors not shown)

    Abstract: We measured the angular dependence of the three recoil proton polarization components in two-body photodisintegration of the deuteron at a photon energy of 2 GeV. These new data provide a benchmark for calculations based on quantum chromodynamics. Two of the five existing models have made predictions of polarization observables. Both explain the longitudinal polarization transfer satisfactorily.… ▽ More

    Submitted 2 February, 2007; originally announced February 2007.

    Comments: 5 pages, 1 figure, submitted to Physical Review Letters

    Journal ref: Phys.Rev.Lett.98:182302,2007

  15. Inclusive pion double charge exchange in light p-shell nuclei

    Authors: W. Fong, J. L. Matthews, M. L. Dowell, E. R. Kinney, T. Soos, M. Y. Wang, S. A. Wood, P. A. M. Gram, G. A. Rebka, Jr., D. A. Roberts

    Abstract: We report the results of a series of measurements of the differential cross sections for inclusive pion double charge exchange in 6,7Li, 9Be, and 12C for positive and negative incident pions of energies 120, 180, and 240 MeV. The data are compared with the predictions of an intranuclear cascade model and a model based on two sequential single charge exchange processes.

    Submitted 3 January, 2007; originally announced January 2007.

    Comments: 36 pages, 14 figures, 6 tables

    Journal ref: Phys.Rev.C75:064605,2007

  16. arXiv:cond-mat/0607025  [pdf, ps, other

    cond-mat.stat-mech cond-mat.dis-nn

    Slow dynamics at the smeared phase transition of randomly layered magnets

    Authors: Shellie Huether, Ryan Kinney, Thomas Vojta

    Abstract: We investigate a model for randomly layered magnets, viz. a three-dimensional Ising model with planar defects. The magnetic phase transition in this system is smeared because static long-range order can develop on isolated rare spatial regions. Here, we report large-scale kinetic Monte Carlo simulations of the dynamical behavior close to the smeared phase transition which we characterize by the… ▽ More

    Submitted 22 September, 2006; v1 submitted 2 July, 2006; originally announced July 2006.

    Comments: 7 pages, 6 eps figures, final version as published

    Journal ref: Phys. Rev. B 74, 094425 (2006)

  17. Inclusive Pion Double Charge Exchange in 4He at Intermediate Energies

    Authors: E. R. Kinney, J. L. Matthews, P. A. M. Gram, D. W. MacArthur, E. Piasetzky, G. A. Rebka, Jr., D. A. Roberts

    Abstract: A systematic experimental study of inclusive pion double charge exchange in 4He has been undertaken. The reaction 4He(pi+,pi-)4p was observed at incident energies 120, 150, 180, 240 and 270 MeV; the 4He(pi-,pi+)4n reaction was observed at incident energies 180 and 240 MeV. At each incident energy, the doubly differential cross section was measured at three to five outgoing pion laboratory angles… ▽ More

    Submitted 1 July, 2005; originally announced July 2005.

    Comments: 59 pages, 22 figures, 2 tables

    Journal ref: Phys.Rev. C72 (2005) 044608

  18. arXiv:cond-mat/0410318  [pdf, ps, other

    cond-mat.other cond-mat.dis-nn

    Modeling Cascading Failures in the North American Power Grid

    Authors: Ryan Kinney, Paolo Crucitti, Reka Albert, Vito Latora

    Abstract: The North American power grid is one of the most complex technological networks, and its interconnectivity allows both for long-distance power transmission and for the propagation of disturbances. We model the power grid using its actual topology and plausible assumptions about the load and overload of transmission substations. Our results indicate that the loss of a single substation can lead t… ▽ More

    Submitted 13 October, 2004; originally announced October 2004.

    Comments: 6 pages, 6 figures

    Journal ref: Eur. Phys. J. B 46 (2005) 101.

  19. Evidence for a three-nucleon-force effect in proton-deuteron elastic scattering

    Authors: R. V. Cadman, J. Brack, W. J. Cummings, J. A. Fedchak, B. D. Fox, H. Gao, W. Glöckle, C. Grosshauser, R. J. Holt, C. E. Jones, E. R. Kinney, M. A. Miller, W. Nagengast, B. R. Owen, K. Rith, F. Schmidt, E. C. Schulte, J. Sowinski, F. Sperisen, E. L. Thorsland, R. Tobey, J. Wilbert, H. Witała

    Abstract: Developments in spin-polarized internal targets for storage rings have permitted measurements of 197 MeV polarized protons scattering from vector polarized deuterons. This work presents measurements of the polarization observables A_y, iT_11, and C_y,y in proton-deuteron elastic scattering. When compared to calculations with and without three-nucleon forces, the measurements indicate that three-… ▽ More

    Submitted 7 October, 2000; originally announced October 2000.

    Comments: 8 pages 2 figures Latex, submitted to Phys. Rev. Letters

    Journal ref: Phys.Rev.Lett.86:967,2001

  20. Inclusive Electron Scattering from Nuclei at $x \simeq 1$

    Authors: J. Arrington, P. Anthony, R. G. Arnold, E. J. Beise, J. E. Belz, P. E. Bosted, H. -J. Bulten, M. S. Chapman, K. P. Coulter, F. Dietrich, R. Ent, M. Epstein, B. W. Filippone, H. Gao, R. A. Gearhart, D. F. Geesaman, J. -O. Hansen, R. J. Holt, H. E. Jackson, C. E. Jones, C. E. Keppel, E. R. Kinney, S. Kuhn, K. Lee, W. Lorenzon , et al. (21 additional authors not shown)

    Abstract: The inclusive A(e,e') cross section for $x \simeq 1$ was measured on $^2$H, C, Fe, and Au for momentum transfers $Q^2$ from 1-7 (GeV/c)$^2$. The scaling behavior of the data was examined in the region of transition from y-scaling to x-scaling. Throughout this transitional region, the data exhibit $ξ$-scaling, reminiscent of the Bloom-Gilman duality seen in free nucleon scattering.

    Submitted 25 April, 1995; originally announced April 1995.

    Comments: 4 pages, RevTeX; 4 figures (postscript in .tar.Z file)

    Journal ref: Phys.Rev.C53:2248-2251,1996