-
An Approach to Automatically generating Riddles aiding Concept Attainment
Authors:
Niharika Sri Parasa,
Chaitali Diwan,
Srinath Srinivasa
Abstract:
One of the primary challenges in online learning environments, is to retain learner engagement. Several different instructional strategies are proposed both in online and offline environments to enhance learner engagement. The Concept Attainment Model is one such instructional strategy that focuses on learners acquiring a deeper understanding of a concept rather than just its dictionary definition…
▽ More
One of the primary challenges in online learning environments, is to retain learner engagement. Several different instructional strategies are proposed both in online and offline environments to enhance learner engagement. The Concept Attainment Model is one such instructional strategy that focuses on learners acquiring a deeper understanding of a concept rather than just its dictionary definition. This is done by searching and listing the properties used to distinguish examples from non-examples of various concepts. Our work attempts to apply the Concept Attainment Model to build conceptual riddles, to deploy over online learning environments. The approach involves creating factual triples from learning resources, classifying them based on their uniqueness to a concept into `Topic Markers' and `Common', followed by generating riddles based on the Concept Attainment Model's format and capturing all possible solutions to those riddles. The results obtained from the human evaluation of riddles prove encouraging.
△ Less
Submitted 27 October, 2023;
originally announced October 2023.
-
Mask-conditioned latent diffusion for generating gastrointestinal polyp images
Authors:
Roman Macháček,
Leila Mozaffari,
Zahra Sepasdar,
Sravanthi Parasa,
Pål Halvorsen,
Michael A. Riegler,
Vajira Thambawita
Abstract:
In order to take advantage of AI solutions in endoscopy diagnostics, we must overcome the issue of limited annotations. These limitations are caused by the high privacy concerns in the medical field and the requirement of getting aid from experts for the time-consuming and costly medical data annotation process. In computer vision, image synthesis has made a significant contribution in recent year…
▽ More
In order to take advantage of AI solutions in endoscopy diagnostics, we must overcome the issue of limited annotations. These limitations are caused by the high privacy concerns in the medical field and the requirement of getting aid from experts for the time-consuming and costly medical data annotation process. In computer vision, image synthesis has made a significant contribution in recent years as a result of the progress of generative adversarial networks (GANs) and diffusion probabilistic models (DPM). Novel DPMs have outperformed GANs in text, image, and video generation tasks. Therefore, this study proposes a conditional DPM framework to generate synthetic GI polyp images conditioned on given generated segmentation masks. Our experimental results show that our system can generate an unlimited number of high-fidelity synthetic polyp images with the corresponding ground truth masks of polyps. To test the usefulness of the generated data, we trained binary image segmentation models to study the effect of using synthetic data. Results show that the best micro-imagewise IOU of 0.7751 was achieved from DeepLabv3+ when the training data consists of both real data and synthetic data. However, the results reflect that achieving good segmentation performance with synthetic data heavily depends on model architectures.
△ Less
Submitted 11 April, 2023;
originally announced April 2023.
-
PolypConnect: Image inpainting for generating realistic gastrointestinal tract images with polyps
Authors:
Jan Andre Fagereng,
Vajira Thambawita,
Andrea M. Storås,
Sravanthi Parasa,
Thomas de Lange,
Pål Halvorsen,
Michael A. Riegler
Abstract:
Early identification of a polyp in the lower gastrointestinal (GI) tract can lead to prevention of life-threatening colorectal cancer. Develo** computer-aided diagnosis (CAD) systems to detect polyps can improve detection accuracy and efficiency and save the time of the domain experts called endoscopists. Lack of annotated data is a common challenge when building CAD systems. Generating syntheti…
▽ More
Early identification of a polyp in the lower gastrointestinal (GI) tract can lead to prevention of life-threatening colorectal cancer. Develo** computer-aided diagnosis (CAD) systems to detect polyps can improve detection accuracy and efficiency and save the time of the domain experts called endoscopists. Lack of annotated data is a common challenge when building CAD systems. Generating synthetic medical data is an active research area to overcome the problem of having relatively few true positive cases in the medical domain. To be able to efficiently train machine learning (ML) models, which are the core of CAD systems, a considerable amount of data should be used. In this respect, we propose the PolypConnect pipeline, which can convert non-polyp images into polyp images to increase the size of training datasets for training. We present the whole pipeline with quantitative and qualitative evaluations involving endoscopists. The polyp segmentation model trained using synthetic data, and real data shows a 5.1% improvement of mean intersection over union (mIOU), compared to the model trained only using real data. The codes of all the experiments are available on GitHub to reproduce the results.
△ Less
Submitted 30 May, 2022;
originally announced May 2022.
-
Visual explanations for polyp detection: How medical doctors assess intrinsic versus extrinsic explanations
Authors:
Steven Hicks,
Andrea Storås,
Michael Riegler,
Cise Midoglu,
Malek Hammou,
Thomas de Lange,
Sravanthi Parasa,
Pål Halvorsen,
Inga Strümke
Abstract:
Deep learning has in recent years achieved immense success in all areas of computer vision and has the potential of assisting medical doctors in analyzing visual content for disease and other abnormalities. However, the current state of deep learning is very much a black box, making medical professionals highly skeptical about integrating these methods into clinical practice. Several methods have…
▽ More
Deep learning has in recent years achieved immense success in all areas of computer vision and has the potential of assisting medical doctors in analyzing visual content for disease and other abnormalities. However, the current state of deep learning is very much a black box, making medical professionals highly skeptical about integrating these methods into clinical practice. Several methods have been proposed in order to shine some light onto these black boxes, but there is no consensus on the opinion of the medical doctors that will consume these explanations. This paper presents a study asking medical doctors about their opinion of current state-of-the-art explainable artificial intelligence methods when applied to a gastrointestinal disease detection use case. We compare two different categories of explanation methods, intrinsic and extrinsic, and gauge their opinion of the current value of these explanations. The results indicate that intrinsic explanations are preferred and that explanation.
△ Less
Submitted 23 March, 2022;
originally announced April 2022.
-
Literature-Augmented Clinical Outcome Prediction
Authors:
Aakanksha Naik,
Sravanthi Parasa,
Sergey Feldman,
Lucy Lu Wang,
Tom Hope
Abstract:
We present BEEP (Biomedical Evidence-Enhanced Predictions), a novel approach for clinical outcome prediction that retrieves patient-specific medical literature and incorporates it into predictive models. Based on each individual patient's clinical notes, we train language models (LMs) to find relevant papers and fuse them with information from notes to predict outcomes such as in-hospital mortalit…
▽ More
We present BEEP (Biomedical Evidence-Enhanced Predictions), a novel approach for clinical outcome prediction that retrieves patient-specific medical literature and incorporates it into predictive models. Based on each individual patient's clinical notes, we train language models (LMs) to find relevant papers and fuse them with information from notes to predict outcomes such as in-hospital mortality. We develop methods to retrieve literature based on noisy, information-dense patient notes, and to augment existing outcome prediction models with retrieved papers in a manner that maximizes predictive accuracy. Our approach boosts predictive performance on three important clinical tasks in comparison to strong recent LM baselines, increasing F1 by up to 5 points and precision@Top-K by a large margin of over 25%.
△ Less
Submitted 16 November, 2022; v1 submitted 16 November, 2021;
originally announced November 2021.
-
A Search Engine for Discovery of Scientific Challenges and Directions
Authors:
Dan Lahav,
Jon Saad Falcon,
Bailey Kuehl,
Sophie Johnson,
Sravanthi Parasa,
Noam Shomron,
Duen Horng Chau,
Diyi Yang,
Eric Horvitz,
Daniel S. Weld,
Tom Hope
Abstract:
Kee** track of scientific challenges, advances and emerging directions is a fundamental part of research. However, researchers face a flood of papers that hinders discovery of important knowledge. In biomedicine, this directly impacts human lives. To address this problem, we present a novel task of extraction and search of scientific challenges and directions, to facilitate rapid knowledge disco…
▽ More
Kee** track of scientific challenges, advances and emerging directions is a fundamental part of research. However, researchers face a flood of papers that hinders discovery of important knowledge. In biomedicine, this directly impacts human lives. To address this problem, we present a novel task of extraction and search of scientific challenges and directions, to facilitate rapid knowledge discovery. We construct and release an expert-annotated corpus of texts sampled from full-length papers, labeled with novel semantic categories that generalize across many types of challenges and directions. We focus on a large corpus of interdisciplinary work relating to the COVID-19 pandemic, ranging from biomedicine to areas such as AI and economics. We apply a model trained on our data to identify challenges and directions across the corpus and build a dedicated search engine. In experiments with 19 researchers and clinicians using our system, we outperform a popular scientific search engine in assisting knowledge discovery. Finally, we show that models trained on our resource generalize to the wider biomedical domain and to AI papers, highlighting its broad utility. We make our data, model and search engine publicly available. https://challenges.apps.allenai.org/
△ Less
Submitted 19 January, 2022; v1 submitted 31 August, 2021;
originally announced August 2021.
-
SinGAN-Seg: Synthetic training data generation for medical image segmentation
Authors:
Vajira Thambawita,
Pegah Salehi,
Sajad Amouei Sheshkal,
Steven A. Hicks,
Hugo L. Hammer,
Sravanthi Parasa,
Thomas de Lange,
Pål Halvorsen,
Michael A. Riegler
Abstract:
Analyzing medical data to find abnormalities is a time-consuming and costly task, particularly for rare abnormalities, requiring tremendous efforts from medical experts. Artificial intelligence has become a popular tool for the automatic processing of medical data, acting as a supportive tool for doctors. However, the machine learning models used to build these tools are highly dependent on the da…
▽ More
Analyzing medical data to find abnormalities is a time-consuming and costly task, particularly for rare abnormalities, requiring tremendous efforts from medical experts. Artificial intelligence has become a popular tool for the automatic processing of medical data, acting as a supportive tool for doctors. However, the machine learning models used to build these tools are highly dependent on the data used to train them. Large amounts of data can be difficult to obtain in medicine due to privacy, expensive and time-consuming annotations, and a general lack of data samples for infrequent lesions. Here, we present a novel synthetic data generation pipeline, called SinGAN-Seg, to produce synthetic medical images with corresponding masks using a single training image. Our method is different from the traditional GANs because our model needs only a single image and the corresponding ground truth to train. Our method produces alternative artificial segmentation datasets with ground truth masks when real datasets are not allowed to share. The pipeline is evaluated using qualitative and quantitative comparisons between real and synthetic data to show that the style transfer technique used in our pipeline significantly improves the quality of the generated data and our method is better than other state-of-the-art GANs to prepare synthetic images when the size of training datasets are limited. By training UNet++ using both real and the synthetic data generated from the SinGAN-Seg pipeline, we show that models trained with synthetic data have very close performances to those trained on real data when the datasets have a considerable amount of data. In contrast, Synthetic data generated from the SinGAN-Seg pipeline can improve the performance of segmentation models when training datasets do not have a considerable amount of data. The code is available on GitHub.
△ Less
Submitted 25 April, 2022; v1 submitted 29 June, 2021;
originally announced July 2021.
-
MedICaT: A Dataset of Medical Images, Captions, and Textual References
Authors:
Sanjay Subramanian,
Lucy Lu Wang,
Sachin Mehta,
Ben Bogin,
Madeleine van Zuylen,
Sravanthi Parasa,
Sameer Singh,
Matt Gardner,
Hannaneh Hajishirzi
Abstract:
Understanding the relationship between figures and text is key to scientific document understanding. Medical figures in particular are quite complex, often consisting of several subfigures (75% of figures in our dataset), with detailed text describing their content. Previous work studying figures in scientific papers focused on classifying figure content rather than understanding how images relate…
▽ More
Understanding the relationship between figures and text is key to scientific document understanding. Medical figures in particular are quite complex, often consisting of several subfigures (75% of figures in our dataset), with detailed text describing their content. Previous work studying figures in scientific papers focused on classifying figure content rather than understanding how images relate to the text. To address challenges in figure retrieval and figure-to-text alignment, we introduce MedICaT, a dataset of medical images in context. MedICaT consists of 217K images from 131K open access biomedical papers, and includes captions, inline references for 74% of figures, and manually annotated subfigures and subcaptions for a subset of figures. Using MedICaT, we introduce the task of subfigure to subcaption alignment in compound figures and demonstrate the utility of inline references in image-text matching. Our data and code can be accessed at https://github.com/allenai/medicat.
△ Less
Submitted 12 October, 2020;
originally announced October 2020.
-
Extracting a Knowledge Base of Mechanisms from COVID-19 Papers
Authors:
Tom Hope,
Aida Amini,
David Wadden,
Madeleine van Zuylen,
Sravanthi Parasa,
Eric Horvitz,
Daniel Weld,
Roy Schwartz,
Hannaneh Hajishirzi
Abstract:
The COVID-19 pandemic has spawned a diverse body of scientific literature that is challenging to navigate, stimulating interest in automated tools to help find useful knowledge. We pursue the construction of a knowledge base (KB) of mechanisms -- a fundamental concept across the sciences encompassing activities, functions and causal relations, ranging from cellular processes to economic impacts. W…
▽ More
The COVID-19 pandemic has spawned a diverse body of scientific literature that is challenging to navigate, stimulating interest in automated tools to help find useful knowledge. We pursue the construction of a knowledge base (KB) of mechanisms -- a fundamental concept across the sciences encompassing activities, functions and causal relations, ranging from cellular processes to economic impacts. We extract this information from the natural language of scientific papers by develo** a broad, unified schema that strikes a balance between relevance and breadth. We annotate a dataset of mechanisms with our schema and train a model to extract mechanism relations from papers. Our experiments demonstrate the utility of our KB in supporting interdisciplinary scientific search over COVID-19 literature, outperforming the prominent PubMed search in a study with clinical experts.
△ Less
Submitted 19 April, 2021; v1 submitted 8 October, 2020;
originally announced October 2020.
-
Quantum Pseudo-fractional Fourier Transform and its application to quantum phase estimation
Authors:
Srinivas V. Parasa,
K. Eswaran
Abstract:
- In this paper we present a method to compute the coefficients of the fractional Fourier transform (FrFT) on a quantum computer using quantum gates of polynomial complexity of the order O(n^3). The FrFt, a generalization of the DFT, has wide applications in signal processing and is particularly useful to implement the Pseudopolar and Radon transforms. Even though the FrFT is a non-unitary opera…
▽ More
- In this paper we present a method to compute the coefficients of the fractional Fourier transform (FrFT) on a quantum computer using quantum gates of polynomial complexity of the order O(n^3). The FrFt, a generalization of the DFT, has wide applications in signal processing and is particularly useful to implement the Pseudopolar and Radon transforms. Even though the FrFT is a non-unitary operation, to develop its quantum counterpart, we develop a unitary operator called the quantum Pseudo-fraction Fourier Transform (QPFrFT) in a higher-dimensional Hilbert space, in order to computer the coefficients of the FrFT. In this process we develop a unitary operator denoted U by which is an essential step to implement the QPFrFT. We then show the application of the operator U in the problem of quantum phase estimation.
△ Less
Submitted 4 June, 2009;
originally announced June 2009.
