Showing 1–4 of 4 results for author: Munch, N

Language Models are Surprisingly Fragile to Drug Names in Biomedical Benchmarks

Authors: Jack Gallifant, Shan Chen, Pedro Moreira, Nikolaj Munch, Mingye Gao, Jackson Pond, Leo Anthony Celi, Hugo Aerts, Thomas Hartvigsen, Danielle Bitterman

Abstract: Medical knowledge is context-dependent and requires consistent reasoning across various natural language expressions of semantically equivalent phrases. This is particularly crucial for drug names, where patients often use brand names like Advil or Tylenol instead of their generic equivalents. To study this, we create a new robustness dataset, RABBITS, to evaluate performance differences on medica… ▽ More Medical knowledge is context-dependent and requires consistent reasoning across various natural language expressions of semantically equivalent phrases. This is particularly crucial for drug names, where patients often use brand names like Advil or Tylenol instead of their generic equivalents. To study this, we create a new robustness dataset, RABBITS, to evaluate performance differences on medical benchmarks after swap** brand and generic drug names using physician expert annotations. We assess both open-source and API-based LLMs on MedQA and MedMCQA, revealing a consistent performance drop ranging from 1-10\%. Furthermore, we identify a potential source of this fragility as the contamination of test data in widely used pre-training datasets. All code is accessible at https://github.com/BittermanLab/RABBITS, and a HuggingFace leaderboard is available at https://huggingface.co/spaces/AIM-Harvard/rabbits-leaderboard. △ Less

Submitted 18 June, 2024; v1 submitted 17 June, 2024; originally announced June 2024.

Comments: submitted for review, total 15 pages

Cross-Care: Assessing the Healthcare Implications of Pre-training Data on Language Model Bias

Authors: Shan Chen, Jack Gallifant, Mingye Gao, Pedro Moreira, Nikolaj Munch, Ajay Muthukkumar, Arvind Rajan, Jaya Kolluri, Amelia Fiske, Janna Hastings, Hugo Aerts, Brian Anthony, Leo Anthony Celi, William G. La Cava, Danielle S. Bitterman

Abstract: Large language models (LLMs) are increasingly essential in processing natural languages, yet their application is frequently compromised by biases and inaccuracies originating in their training data. In this study, we introduce Cross-Care, the first benchmark framework dedicated to assessing biases and real world knowledge in LLMs, specifically focusing on the representation of disease prevalence… ▽ More Large language models (LLMs) are increasingly essential in processing natural languages, yet their application is frequently compromised by biases and inaccuracies originating in their training data. In this study, we introduce Cross-Care, the first benchmark framework dedicated to assessing biases and real world knowledge in LLMs, specifically focusing on the representation of disease prevalence across diverse demographic groups. We systematically evaluate how demographic biases embedded in pre-training corpora like $ThePile$ influence the outputs of LLMs. We expose and quantify discrepancies by juxtaposing these biases against actual disease prevalences in various U.S. demographic groups. Our results highlight substantial misalignment between LLM representation of disease prevalence and real disease prevalence rates across demographic subgroups, indicating a pronounced risk of bias propagation and a lack of real-world grounding for medical applications of LLMs. Furthermore, we observe that various alignment methods minimally resolve inconsistencies in the models' representation of disease prevalence across different languages. For further exploration and analysis, we make all data and a data visualization tool available at: www.crosscare.net. △ Less

Submitted 24 June, 2024; v1 submitted 8 May, 2024; originally announced May 2024.

Comments: Submitted for review, data visualization tool available at: www.crosscare.net

Diffraction-limited integral-field spectroscopy for extreme adaptive optics systems with the Multi-Core fiber-fed Integral-Field Unit

Authors: Sebastiaan Y. Haffert, Robert J. Harris, Alessio Zanutta, Fraser A. Pike, Andrea Bianco, Eduardo Redaelli, Aurélien Benoît, David G. MacLachlan, Calum A. Ross, Itandehui Gris-Sánchez, Mareike D. Trappen, Yilin Xu, Matthias Blaicher, Pascal Maier, Giulio Riva, Baptiste Sinquin, Caroline Kulcsár, Nazim Ali Bharmal, Eric Gendron, Lazar Staykov, Tim J. Morris, Santiago Barboza, Norbert Muench, Lisa Bardou, Léonard Prengère , et al. (9 additional authors not shown)

Abstract: Direct imaging instruments have the spatial resolution to resolve exoplanets from their host star. This enables direct characterization of the exoplanets atmosphere, but most direct imaging instruments do not have spectrographs with high enough resolving power for detailed atmospheric characterization. We investigate the use of a single-mode diffraction-limited integral-field unit that is compact… ▽ More Direct imaging instruments have the spatial resolution to resolve exoplanets from their host star. This enables direct characterization of the exoplanets atmosphere, but most direct imaging instruments do not have spectrographs with high enough resolving power for detailed atmospheric characterization. We investigate the use of a single-mode diffraction-limited integral-field unit that is compact and easy to integrate into current and future direct imaging instruments for exoplanet characterization. This achieved by making use of recent progress in photonic manufacturing to create a single-mode fiber-fed image reformatter. The fiber-link is created with 3D printed lenses on top of a single-mode multi-core fiber that feeds an ultrafast laser inscribed photonic chip that reformats the fiber into a pseudo-slit. We then couple it to a first-order spectrograph with a triple stacked volume phase holographic grating for a high efficiency over a large bandwidth. The prototype system has had a successful first-light observing run at the 4.2 meter William Herschel Telescope. The measured on-sky resolving power is between 2500 and 3000, depending on the wavelength. With our observations we show that single-mode integral-field spectroscopy is a viable option for current and future exoplanet imaging instruments. △ Less

Submitted 8 September, 2020; originally announced September 2020.

Comments: submitted to JATIS

The MICADO first light imager for the ELT: overview, operation, simulation

Authors: Richard Davies, João Alves, Yann Clénet, Florian Lang-Bardl, Harald Nicklas, Jörg-Uwe Pott, Roberto Ragazzoni, Eline Tolstoy, Paola Amico, Heiko Anwand-Heerwart, Santiago Barboza, Lothar Barl, Pierre Baudoz, Ralf Bender, Naidu Bezawada, Peter Bizenberger, Wilfried Boland, Piercarlo Bonifacio, Bruno Borgo, Tristan Buey, Frédéric Chapron, Fanny Chemla, Mathieu Cohen, Oliver Czoske, Vincent Deo , et al. (76 additional authors not shown)

Abstract: MICADO will enable the ELT to perform diffraction limited near-infrared observations at first light. The instrument's capabilities focus on imaging (including astrometric and high contrast) as well as single object spectroscopy. This contribution looks at how requirements from the observing modes have driven the instrument design and functionality. Using examples from specific science cases, and m… ▽ More MICADO will enable the ELT to perform diffraction limited near-infrared observations at first light. The instrument's capabilities focus on imaging (including astrometric and high contrast) as well as single object spectroscopy. This contribution looks at how requirements from the observing modes have driven the instrument design and functionality. Using examples from specific science cases, and making use of the data simulation tool, an outline is presented of what we can expect the instrument to achieve. △ Less

Submitted 26 July, 2018; originally announced July 2018.

Comments: Proc SPIE 10702. SPIE's copyright notice: "Copyright 2018 Society of PhotoOptical Instrumentation Engineers. One print or electronic copy may be made for personal use only. Systematic reproduction and distribution, duplication of any material in this paper for a fee or for commercial purposes, or modification of the content of the paper are prohibited."