Skip to main content

Showing 1–18 of 18 results for author: Bout, A

.
  1. arXiv:2311.11813  [pdf, other

    cs.CL

    Efficient Grammatical Error Correction Via Multi-Task Training and Optimized Training Schedule

    Authors: Andrey Bout, Alexander Podolskiy, Sergey Nikolenko, Irina Piontkovskaya

    Abstract: Progress in neural grammatical error correction (GEC) is hindered by the lack of annotated training data. Sufficient amounts of high-quality manually annotated data are not available, so recent research has relied on generating synthetic data, pretraining on it, and then fine-tuning on real datasets; performance gains have been achieved either by ensembling or by using huge pretrained models such… ▽ More

    Submitted 20 November, 2023; originally announced November 2023.

    Comments: EMNLP 2023

  2. arXiv:2311.08191  [pdf, other

    cs.CL

    GEC-DePenD: Non-Autoregressive Grammatical Error Correction with Decoupled Permutation and Decoding

    Authors: Konstantin Yakovlev, Alexander Podolskiy, Andrey Bout, Sergey Nikolenko, Irina Piontkovskaya

    Abstract: Grammatical error correction (GEC) is an important NLP task that is currently usually solved with autoregressive sequence-to-sequence models. However, approaches of this class are inherently slow due to one-by-one token generation, so non-autoregressive alternatives are needed. In this work, we propose a novel non-autoregressive approach to GEC that decouples the architecture into a permutation ne… ▽ More

    Submitted 14 November, 2023; originally announced November 2023.

    Comments: ACL 2023

  3. arXiv:2311.08143  [pdf, other

    cs.CL

    Sinkhorn Transformations for Single-Query Postprocessing in Text-Video Retrieval

    Authors: Konstantin Yakovlev, Gregory Polyakov, Ilseyar Alimova, Alexander Podolskiy, Andrey Bout, Sergey Nikolenko, Irina Piontkovskaya

    Abstract: A recent trend in multimodal retrieval is related to postprocessing test set results via the dual-softmax loss (DSL). While this approach can bring significant improvements, it usually presumes that an entire matrix of test samples is available as DSL input. This work introduces a new postprocessing approach based on Sinkhorn transformations that outperforms DSL. Further, we propose a new postproc… ▽ More

    Submitted 14 November, 2023; originally announced November 2023.

    Comments: SIGIR 2023

  4. arXiv:2303.10845  [pdf, other

    cs.CL

    PanGu-Σ: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computing

    Authors: Xiaozhe Ren, **yi Zhou, Xinfan Meng, Xin**g Huang, Yadao Wang, Weichao Wang, Pengfei Li, Xiaoda Zhang, Alexander Podolskiy, Grigory Arshinov, Andrey Bout, Irina Piontkovskaya, Jiansheng Wei, Xin Jiang, Teng Su, Qun Liu, Jun Yao

    Abstract: The scaling of large language models has greatly improved natural language understanding, generation, and reasoning. In this work, we develop a system that trained a trillion-parameter language model on a cluster of Ascend 910 AI processors and MindSpore framework, and present the language model with 1.085T parameters named PanGu-Σ. With parameter inherent from PanGu-α, we extend the dense Transfo… ▽ More

    Submitted 19 March, 2023; originally announced March 2023.

  5. arXiv:2206.10914  [pdf, other

    cs.CL

    Template-based Approach to Zero-shot Intent Recognition

    Authors: Dmitry Lamanov, Pavel Burnyshev, Ekaterina Artemova, Valentin Malykh, Andrey Bout, Irina Piontkovskaya

    Abstract: The recent advances in transfer learning techniques and pre-training of large contextualized encoders foster innovation in real-life applications, including dialog assistants. Practical needs of intent recognition require effective data usage and the ability to constantly update supported intents, adopting new ones, and abandoning outdated ones. In particular, the generalized zero-shot paradigm, i… ▽ More

    Submitted 22 June, 2022; originally announced June 2022.

    Comments: accepted to INLG 2022

  6. arXiv:2108.06991  [pdf, other

    cs.CL

    A Single Example Can Improve Zero-Shot Data Generation

    Authors: Pavel Burnyshev, Valentin Malykh, Andrey Bout, Ekaterina Artemova, Irina Piontkovskaya

    Abstract: Sub-tasks of intent classification, such as robustness to distribution shift, adaptation to specific user groups and personalization, out-of-domain detection, require extensive and flexible datasets for experiments and evaluation. As collecting such datasets is time- and labor-consuming, we propose to use text generation methods to gather datasets. The generator should be trained to generate utter… ▽ More

    Submitted 16 August, 2021; originally announced August 2021.

    Comments: To appear in INLG2021 proceedings

  7. arXiv:2101.03778  [pdf, other

    cs.CL cs.LG

    Revisiting Mahalanobis Distance for Transformer-Based Out-of-Domain Detection

    Authors: Alexander Podolskiy, Dmitry Lipin, Andrey Bout, Ekaterina Artemova, Irina Piontkovskaya

    Abstract: Real-life applications, heavily relying on machine learning, such as dialog systems, demand out-of-domain detection methods. Intent classification models should be equipped with a mechanism to distinguish seen intents from unseen ones so that the dialog agent is capable of rejecting the latter and avoiding undesired behavior. However, despite increasing attention paid to the task, the best practic… ▽ More

    Submitted 23 May, 2022; v1 submitted 11 January, 2021; originally announced January 2021.

    Comments: AAAI 2021

  8. arXiv:1301.2224  [pdf

    astro-ph.IM

    The University of Texas Millimeter Wave Observatory

    Authors: Paul A. Vanden Bout, John H. Davis, Robert B. Loren

    Abstract: This is an account of the Millimeter Wave Observatory, a 4.9 meter diameter antenna facility that pioneered continuum observations of planets and interstellar molecular spectroscopy from 1971 to 1988. The circumstances of its founding, development of its instrumentation, and major research contributions are discussed. The MWO role in training of personnel in this new field is illustrated by a list… ▽ More

    Submitted 10 January, 2013; originally announced January 2013.

    Journal ref: Journal of Astronomical History and Heritage, 15(3), 232-245 (2012)

  9. CO(1-0) in z>2 Quasar Host Galaxies: No Evidence for Extended Molecular Gas Reservoirs

    Authors: Dominik A. Riechers, Christopher L. Carilli, Ronald J. Maddalena, Jacqueline Hodge, Andrew I. Harris, Andrew J. Baker, Fabian Walter, Jeff Wagg, Paul A. Vanden Bout, Axel Weiss, Chelsea E. Sharon

    Abstract: We report the detection of CO(1-0) emission in the strongly lensed high-redshift quasars IRAS F10214+4724 (z=2.286), the Cloverleaf (z=2.558), RX J0911+0551 (z=2.796), SMM J04135+10277 (z=2.846), and MG 0751+2716 (z=3.200), using the Expanded Very Large Array and the Green Bank Telescope. We report lensing-corrected CO(1-0) line luminosities of L'(CO) = 0.34-18.4 x 10^10 K km/s pc^2 and total mole… ▽ More

    Submitted 13 June, 2011; originally announced June 2011.

    Comments: 6 pages, 4 figures, 1 table, to appear in ApJL (EVLA Special Issue; accepted June 10, 2011)

    Journal ref: Astrophys.J.739:L32,2011

  10. arXiv:0911.0413  [pdf, ps, other

    astro-ph.CO astro-ph.GA

    Enhanced Dense Gas Fraction in Ultra-Luminous Infrared Galaxies

    Authors: S. Juneau, D. T. Narayanan, J. Moustakas, Y. L. Shirley, R. S. Bussmann, R. C. Kennicutt Jr, P. A. Vanden Bout

    Abstract: We present a detailed analysis of the relation between infrared luminosity and molecular line luminosity, for a variety of molecular transitions, using a sample of 34 nearby galaxies spanning a broad range of infrared luminosities (10^{10} < L_{IR} < 10^{12.5} L_sun). We show that the power-law index of the relation is sensitive to the critical density of the molecular gas tracer used, and that… ▽ More

    Submitted 3 December, 2009; v1 submitted 2 November, 2009; originally announced November 2009.

    Comments: 20 pages, 10 figures. Published in The Astrophysical Journal (ApJ 707, 1217). Fixed a reference

    Journal ref: Astrophys.J.707:1217-1232,2009

  11. The Star Formation Rate - Dense Gas Relation in Galaxies as Measured by HCN (3-2) Emission

    Authors: R. S. Bussmann, D. Narayanan, Y. L. Shirley, S. Juneau, J. Wu, P. M. Solomon, P. A. Vanden Bout, J. Moustakas, C. K. Walker

    Abstract: We present observations made with the 10m Heinrich Hertz Sub-Millimeter Telescope of HCN (3-2) emission from a sample of 30 nearby galaxies ranging in infrared luminosity from 10^10 - 10^12.5 L_sun and HCN (3-2) luminosity from 10^6 - 10^9 K km s^-1 pc^2. We examine the correlation between the infrared luminosity and HCN (3-2) luminosity and find that the best fit linear regression has a slope (… ▽ More

    Submitted 28 May, 2008; originally announced May 2008.

    Comments: 4 pages, 1 table, 2 figures; accepted to the ApJL

  12. VLA Limits for Intermediate Mass Black Holes in Three Globular Clusters

    Authors: F. N. Bash, K. Gebhardt, W. M. Goss, P. A. Vanden Bout

    Abstract: The observational evidence for central black holes in globular clusters has been argued extensively, and their existence has important consequences for both the formation and evolution of the cluster. Most of the evidence comes from dynamical arguments, but the interpretation is difficult, given the short relaxation times and old ages of the clusters. One of the most robust signatures for the ex… ▽ More

    Submitted 1 October, 2007; originally announced October 2007.

    Comments: 5 pages, accepted for publication in the Astronomical Journal

    Journal ref: Astron.J.135:182-186,2008

  13. HCN Observations of Dense Star-Forming Gas in High Redshift Galaxies

    Authors: Yu Gao, Chris L. Carilli, Philip M. Solomon, Paul A. Vanden Bout

    Abstract: We present here the sensitive HCN(1-0) observations made with the VLA of two submillimeter galaxies and two QSOs at high-redshift. HCN emission is the signature of dense molecular gas found in GMC cores, the actual sites of massive star formation. We have made the first detection of HCN in a submillimeter galaxy, SMM J16359+6612. The HCN emission is seen with a signal to noise ratio of 4$σ$ and… ▽ More

    Submitted 21 March, 2007; originally announced March 2007.

    Comments: 14 pages including 4 figures; ApJL accepted

  14. A New Probe of Dense Gas at High Redshift: Detection of HCO+(5-4) Line Emission in APM 08279+5255

    Authors: S. Garcia-Burillo, J. Gracia-Carpio, M. Guelin, R. Neri, P. Cox, P. Planesas, P. M. Solomon, L. J. Tacconi, P. A. Vanden Bout

    Abstract: We report the detection of HCO+(5-4) emission from the Broad Absorption Line (BAL) quasar APM08279+5255 at z=3.911 based on observations conducted at the IRAM Plateau de Bure interferometer. This represents the first detection of this molecular ion at such a high redshift. The inferred line luminosity, uncorrected for lensing, is L'(HCO+)=(3.5+-0.6)x10^10 Kkms^-1pc^2. The HCO+ J=5-4 source posit… ▽ More

    Submitted 25 May, 2006; originally announced May 2006.

    Comments: Accepted for publication in ApJ Letters, May 25

    Journal ref: Astrophys.J. 645 (2006) L17-L20

  15. Connecting Dense Gas Tracers of Star Formation in our Galaxy to High-z Star Formation

    Authors: **gwen Wu, Neal J. Evans II, Yu Gao, Philip M. Solomon, Yancy L. Shirley, Paul A. Vanden Bout

    Abstract: Observations have revealed prodigious amounts of star formation in starburst galaxies as traced by dust and molecular emission, even at large redshifts. Recent work shows that for both nearby spiral galaxies and distant starbursts, the global star formation rate, as indicated by the infrared luminosity, has a tight and almost linear correlation with the amount of dense gas as traced by the lumin… ▽ More

    Submitted 5 December, 2005; v1 submitted 15 November, 2005; originally announced November 2005.

    Comments: 10 pages, 2 figures. In press for ApJ Letters

    Journal ref: Astrophys.J.635:L173-L176,2005

  16. Molecular Gas at High Redshift

    Authors: P. M. Solomon, P. A. Vanden Bout

    Abstract: The Early Universe Molecular Emission Line Galaxies (EMGs) are a population of galaxies with only 36 examples that hold great promise for the study of galaxy formation and evolution at high redshift. The classification, luminosity of molecular line emission, molecular mass, far-infrared (FIR) luminosity, star formation efficiency, morphology, and dynamical mass of the currently known sample are… ▽ More

    Submitted 23 August, 2005; originally announced August 2005.

    Comments: 49 pages, 10 figures, to appear Ann. Rev. Ast. & Astrophys. 43 (2005)

    Journal ref: Ann.Rev.Astron.Astrophys.43:677-725,2005

  17. arXiv:astro-ph/0411071  [pdf, ps, other

    astro-ph

    Origins of the ALMA Project in the scientific visions of the North American, European, and Japanese astronomical communities

    Authors: Paul A. Vanden Bout

    Abstract: ALMA is a worldwide project, the synthesis of early visions of astronomers in its three partner communities, Europe, North America, and Japan. The evolution of these concepts and their eventual merger into ALMA are discussed, setting the background for the papers which follow on the scientific requirements and expected performance of ALMA for extra-galactic, galactic, and solar system research.

    Submitted 2 November, 2004; originally announced November 2004.

    Comments: 4 pages, including 1 figure; to appear in ESA SP-577, Proceedings of the conference "Dusty and Molecular Universe - A prelude to HERSCHEL AND ALMA", October 25-27, 2004, Paris

  18. High Redshift HCN Emission: Dense Star-Forming Molecular Gas in IRAS F10214+4724

    Authors: P. A. Vanden Bout, P. M. Solomon, R. J. Maddalena

    Abstract: Hydrogen cyanide emission in the J=1-0 transition has been detected at redshift z=2.2858 in IRAS F10214+4724 using the Green Bank Telescope . This is the second detection of HCN emission at high redshift. The large HCN line luminosity in F10214 is similar to that in the Cloverleaf (z=2.6) and the ultra-luminous infrared galaxies Mrk231 and Arp220. This is also true of the ratio of HCN to CO lumi… ▽ More

    Submitted 9 September, 2004; originally announced September 2004.

    Comments: 9 pages, 2 figures; accepted ApJ(Letters)

    Journal ref: Astrophys.J. 614 (2004) L97-L100