Showing 1–31 of 31 results for author: Dutt, R

Leveraging Machine-Generated Rationales to Facilitate Social Meaning Detection in Conversations

Authors: Ritam Dutt, Zhen Wu, Kelly Shi, Divyanshu Sheth, Prakhar Gupta, Carolyn Penstein Rose

Abstract: We present a generalizable classification approach that leverages Large Language Models (LLMs) to facilitate the detection of implicitly encoded social meaning in conversations. We design a multi-faceted prompt to extract a textual explanation of the reasoning that connects visible cues to underlying social meanings. These extracted explanations or rationales serve as augmentations to the conversa… ▽ More We present a generalizable classification approach that leverages Large Language Models (LLMs) to facilitate the detection of implicitly encoded social meaning in conversations. We design a multi-faceted prompt to extract a textual explanation of the reasoning that connects visible cues to underlying social meanings. These extracted explanations or rationales serve as augmentations to the conversational text to facilitate dialogue understanding and transfer. Our empirical results over 2,340 experimental settings demonstrate the significant positive impact of adding these rationales. Our findings hold true for in-domain classification, zero-shot, and few-shot domain transfer for two different social meaning detection tasks, each spanning two different corpora. △ Less

Submitted 27 June, 2024; originally announced June 2024.

Comments: To appear at The Proceedings of the Association for Computational Linguistics, 2024

MemControl: Mitigating Memorization in Medical Diffusion Models via Automated Parameter Selection

Authors: Raman Dutt, Pedro Sanchez, Ondrej Bohdal, Sotirios A. Tsaftaris, Timothy Hospedales

Abstract: Diffusion models show a remarkable ability in generating images that closely mirror the training distribution. However, these models are prone to training data memorization, leading to significant privacy, ethical, and legal concerns, particularly in sensitive fields such as medical imaging. We hypothesize that memorization is driven by the overparameterization of deep models, suggesting that regu… ▽ More Diffusion models show a remarkable ability in generating images that closely mirror the training distribution. However, these models are prone to training data memorization, leading to significant privacy, ethical, and legal concerns, particularly in sensitive fields such as medical imaging. We hypothesize that memorization is driven by the overparameterization of deep models, suggesting that regularizing model capacity during fine-tuning could be an effective mitigation strategy. Parameter-efficient fine-tuning (PEFT) methods offer a promising approach to capacity control by selectively updating specific parameters. However, finding the optimal subset of learnable parameters that balances generation quality and memorization remains elusive. To address this challenge, we propose a bi-level optimization framework that guides automated parameter selection by utilizing memorization and generation quality metrics as rewards. Our framework successfully identifies the optimal parameter set to be updated to satisfy the generation-memorization tradeoff. We perform our experiments for the specific task of medical image generation and outperform existing state-of-the-art training-time mitigation strategies by fine-tuning as few as 0.019% of model parameters. Furthermore, we show that the strategies learned through our framework are transferable across different datasets and domains. Our proposed framework is scalable to large datasets and agnostic to the choice of reward functions. Finally, we show that our framework can be combined with existing approaches for further memorization mitigation. △ Less

Submitted 29 May, 2024; originally announced May 2024.

Counting the Bugs in ChatGPT's Wugs: A Multilingual Investigation into the Morphological Capabilities of a Large Language Model

Authors: Leonie Weissweiler, Valentin Hofmann, Anjali Kantharuban, Anna Cai, Ritam Dutt, Amey Hengle, Anubha Kabra, Atharva Kulkarni, Abhishek Vijayakumar, Haofei Yu, Hinrich Schütze, Kemal Oflazer, David R. Mortensen

Abstract: Large language models (LLMs) have recently reached an impressive level of linguistic capability, prompting comparisons with human language skills. However, there have been relatively few systematic inquiries into the linguistic capabilities of the latest generation of LLMs, and those studies that do exist (i) ignore the remarkable ability of humans to generalize, (ii) focus only on English, and (i… ▽ More Large language models (LLMs) have recently reached an impressive level of linguistic capability, prompting comparisons with human language skills. However, there have been relatively few systematic inquiries into the linguistic capabilities of the latest generation of LLMs, and those studies that do exist (i) ignore the remarkable ability of humans to generalize, (ii) focus only on English, and (iii) investigate syntax or semantics and overlook other capabilities that lie at the heart of human language, like morphology. Here, we close these gaps by conducting the first rigorous analysis of the morphological capabilities of ChatGPT in four typologically varied languages (specifically, English, German, Tamil, and Turkish). We apply a version of Berko's (1958) wug test to ChatGPT, using novel, uncontaminated datasets for the four examined languages. We find that ChatGPT massively underperforms purpose-built systems, particularly in English. Overall, our results -- through the lens of morphology -- cast a new light on the linguistic capabilities of ChatGPT, suggesting that claims of human-like language skills are premature and misleading. △ Less

Submitted 26 October, 2023; v1 submitted 23 October, 2023; originally announced October 2023.

Comments: EMNLP 2023

FairTune: Optimizing Parameter Efficient Fine Tuning for Fairness in Medical Image Analysis

Authors: Raman Dutt, Ondrej Bohdal, Sotirios A. Tsaftaris, Timothy Hospedales

Abstract: Training models with robust group fairness properties is crucial in ethically sensitive application areas such as medical diagnosis. Despite the growing body of work aiming to minimise demographic bias in AI, this problem remains challenging. A key reason for this challenge is the fairness generalisation gap: High-capacity deep learning models can fit all training data nearly perfectly, and thus a… ▽ More Training models with robust group fairness properties is crucial in ethically sensitive application areas such as medical diagnosis. Despite the growing body of work aiming to minimise demographic bias in AI, this problem remains challenging. A key reason for this challenge is the fairness generalisation gap: High-capacity deep learning models can fit all training data nearly perfectly, and thus also exhibit perfect fairness during training. In this case, bias emerges only during testing when generalisation performance differs across subgroups. This motivates us to take a bi-level optimisation perspective on fair learning: Optimising the learning strategy based on validation fairness. Specifically, we consider the highly effective workflow of adapting pre-trained models to downstream medical imaging tasks using parameter-efficient fine-tuning (PEFT) techniques. There is a trade-off between updating more parameters, enabling a better fit to the task of interest vs. fewer parameters, potentially reducing the generalisation gap. To manage this tradeoff, we propose FairTune, a framework to optimise the choice of PEFT parameters with respect to fairness. We demonstrate empirically that FairTune leads to improved fairness on a range of medical imaging datasets. The code is available at https://github.com/Raman1121/FairTune △ Less

Submitted 17 January, 2024; v1 submitted 8 October, 2023; originally announced October 2023.

Comments: Accepted in ICLR 2024

Linguistic representations for fewer-shot relation extraction across domains

Authors: Sireesh Gururaja, Ritam Dutt, Tinglong Liao, Carolyn Rose

Abstract: Recent work has demonstrated the positive impact of incorporating linguistic representations as additional context and scaffolding on the in-domain performance of several NLP tasks. We extend this work by exploring the impact of linguistic representations on cross-domain performance in a few-shot transfer setting. An important question is whether linguistic representations enhance generalizability… ▽ More Recent work has demonstrated the positive impact of incorporating linguistic representations as additional context and scaffolding on the in-domain performance of several NLP tasks. We extend this work by exploring the impact of linguistic representations on cross-domain performance in a few-shot transfer setting. An important question is whether linguistic representations enhance generalizability by providing features that function as cross-domain pivots. We focus on the task of relation extraction on three datasets of procedural text in two domains, cooking and materials science. Our approach augments a popular transformer-based architecture by alternately incorporating syntactic and semantic graphs constructed by freely available off-the-shelf tools. We examine their utility for enhancing generalization, and investigate whether earlier findings, e.g. that semantic representations can be more helpful than syntactic ones, extend to relation extraction in multiple domains. We find that while the inclusion of these graphs results in significantly higher performance in few-shot transfer, both types of graph exhibit roughly equivalent utility. △ Less

Submitted 7 July, 2023; originally announced July 2023.

Comments: ACL 2023

Parameter-Efficient Fine-Tuning for Medical Image Analysis: The Missed Opportunity

Authors: Raman Dutt, Linus Ericsson, Pedro Sanchez, Sotirios A. Tsaftaris, Timothy Hospedales

Abstract: Foundation models have significantly advanced medical image analysis through the pre-train fine-tune paradigm. Among various fine-tuning algorithms, Parameter-Efficient Fine-Tuning (PEFT) is increasingly utilized for knowledge transfer across diverse tasks, including vision-language and text-to-image generation. However, its application in medical image analysis is relatively unexplored due to the… ▽ More Foundation models have significantly advanced medical image analysis through the pre-train fine-tune paradigm. Among various fine-tuning algorithms, Parameter-Efficient Fine-Tuning (PEFT) is increasingly utilized for knowledge transfer across diverse tasks, including vision-language and text-to-image generation. However, its application in medical image analysis is relatively unexplored due to the lack of a structured benchmark for evaluating PEFT methods. This study fills this gap by evaluating 17 distinct PEFT algorithms across convolutional and transformer-based networks on image classification and text-to-image generation tasks using six medical datasets of varying size, modality, and complexity. Through a battery of over 700 controlled experiments, our findings demonstrate PEFT's effectiveness, particularly in low data regimes common in medical imaging, with performance gains of up to 22% in discriminative and generative tasks. These recommendations can assist the community in incorporating PEFT into their workflows and facilitate fair comparisons of future PEFT methods, ensuring alignment with advancements in other areas of machine learning and AI. △ Less

Submitted 10 June, 2024; v1 submitted 14 May, 2023; originally announced May 2023.

Comments: Accepted as Oral Presentation at MIDL 2024

Ab initio Prediction of Mechanical, Electronic, Magnetic and Transport Properties of Bulk and Heterostructure of a Novel Fe-Cr based Full Heusler Chalcogenide

Authors: Joydipto Bhattacharya, Rajeev Dutt, Aparna Chakrabarti

Abstract: Using electronic structure calculations based on density functional theory, we predict and study the structural, mechanical, electronic, magnetic and transport properties of a new full Heusler chalcogenide, namely, Fe$_2$CrTe, both in bulk and heterostructure form. The system shows a ferromagnetic and half-metallic(HM) like behavior, with a very high (about 95%) spin polarization at the Fermi leve… ▽ More Using electronic structure calculations based on density functional theory, we predict and study the structural, mechanical, electronic, magnetic and transport properties of a new full Heusler chalcogenide, namely, Fe$_2$CrTe, both in bulk and heterostructure form. The system shows a ferromagnetic and half-metallic(HM) like behavior, with a very high (about 95%) spin polarization at the Fermi level, in its cubic phase. Interestingly, under tetragonal distortion, a clear minimum (with almost the same energy as the cubic phase) has also been found, at a c/a value of 1.26, which, however, shows a ferrimagnetic and fully metallic nature. The compound has been found to be dynamically stable in both the phases against the lattice vibration. The elastic properties indicate that the compound is mechanically stable in both the phases, following the stability criteria of the cubic and tetragonal phases. The elastic parameters unveil the mechanically anisotropic and ductile nature of the alloy system. Due to the HM-like behavior of the cubic phase and kee** in mind the practical aspects, we probe the effect of strain as well as substrate on various physical properties of this alloy. Transmission profile of the Fe$_2$CrTe/MgO/Fe$_2$CrTe heterojunction has been calculated to probe it as a magnetic tunneling junction (MTJ) material in both the cubic and tetragonal phases. Considerably large tunneling magnetoresistance ratio (TMR) of 1000% is observed for the tetragonal phase, which is found to be one order of magnitude larger than that of the cubic phase. △ Less

Submitted 24 January, 2023; originally announced January 2023.

Charge density wave induced nodal lines in LaTe$_3$

Authors: Shuvam Sarkar, Joydipto Bhattacharya, Pampa Sadhukhan, Davide Curcio, Rajeev Dutt, Vipin Kumar Singh, Marco Bianchi, Arnab Pariari, Shubhankar Roy, Prabhat Mandal, Tanmoy Das, Philip Hofmann, Aparna Chakrabarti, Sudipta Roy Barman

Abstract: LaTe$_3$ is a noncentrosymmetric (NC) material with time reversal (TR) symmetry in which the charge density wave (CDW) is hosted by the Te bilayers. Here, we show that LaTe$_3$ hosts a Kramers nodal line (KNL), a twofold degenerate nodal line that connects the TR invariant momenta in NC achiral systems, using angle resolved photoemission spectroscopy (ARPES), density functional theory (DFT), effec… ▽ More LaTe$_3$ is a noncentrosymmetric (NC) material with time reversal (TR) symmetry in which the charge density wave (CDW) is hosted by the Te bilayers. Here, we show that LaTe$_3$ hosts a Kramers nodal line (KNL), a twofold degenerate nodal line that connects the TR invariant momenta in NC achiral systems, using angle resolved photoemission spectroscopy (ARPES), density functional theory (DFT), effective band structure (EBS) calculated by band unfolding, and symmetry arguments. DFT incorporating spin-orbit coupling (SOC) reveals that the KNL -- protected by the TR and lattice symmetries -- imposes gapless crossings between the bilayer-split CDW-induced shadow bands and the main bands. In excellent agreement with the EBS, ARPES data corroborate the presence of the KNL and show that the crossings traverse the Fermi level. Furthermore, spinless nodal lines - entirely gapped out by the SOC - are formed by the linear crossings of the shadow and main bands with a high Fermi velocity. △ Less

Submitted 2 December, 2022; originally announced December 2022.

Comments: 24 pages, 4 figures

Journal ref: Final version published in Nature Communications 14, 3628 (2023)

The EMory BrEast imaging Dataset (EMBED): A Racially Diverse, Granular Dataset of 3.5M Screening and Diagnostic Mammograms

Authors: Jiwoong J. Jeong, Brianna L. Vey, Ananth Reddy, Thomas Kim, Thiago Santos, Ramon Correa, Raman Dutt, Marina Mosunjac, Gabriela Oprea-Ilies, Geoffrey Smith, Minjae Woo, Christopher R. McAdams, Mary S. Newell, Imon Banerjee, Judy Gichoya, Hari Trivedi

Abstract: Develo** and validating artificial intelligence models in medical imaging requires datasets that are large, granular, and diverse. To date, the majority of publicly available breast imaging datasets lack in one or more of these areas. Models trained on these data may therefore underperform on patient populations or pathologies that have not previously been encountered. The EMory BrEast imaging D… ▽ More Develo** and validating artificial intelligence models in medical imaging requires datasets that are large, granular, and diverse. To date, the majority of publicly available breast imaging datasets lack in one or more of these areas. Models trained on these data may therefore underperform on patient populations or pathologies that have not previously been encountered. The EMory BrEast imaging Dataset (EMBED) addresses these gaps by providing 3650,000 2D and DBT screening and diagnostic mammograms for 116,000 women divided equally between White and African American patients. The dataset also contains 40,000 annotated lesions linked to structured imaging descriptors and 61 ground truth pathologic outcomes grouped into six severity classes. Our goal is to share this dataset with research partners to aid in development and validation of breast AI models that will serve all patients fairly and help decrease bias in medical AI. △ Less

Submitted 8 February, 2022; originally announced February 2022.

You too Brutus! Trap** Hateful Users in Social Media: Challenges, Solutions & Insights

Authors: Mithun Das, Punyajoy Saha, Ritam Dutt, Pawan Goyal, Animesh Mukherjee, Binny Mathew

Abstract: Hate speech is regarded as one of the crucial issues plaguing the online social media. The current literature on hate speech detection leverages primarily the textual content to find hateful posts and subsequently identify hateful users. However, this methodology disregards the social connections between users. In this paper, we run a detailed exploration of the problem space and investigate an ar… ▽ More Hate speech is regarded as one of the crucial issues plaguing the online social media. The current literature on hate speech detection leverages primarily the textual content to find hateful posts and subsequently identify hateful users. However, this methodology disregards the social connections between users. In this paper, we run a detailed exploration of the problem space and investigate an array of models ranging from purely textual to graph based to finally semi-supervised techniques using Graph Neural Networks (GNN) that utilize both textual and graph-based features. We run exhaustive experiments on two datasets -- Gab, which is loosely moderated and Twitter, which is strictly moderated. Overall the AGNN model achieves 0.791 macro F1-score on the Gab dataset and 0.780 macro F1-score on the Twitter dataset using only 5% of the labeled instances, considerably outperforming all the other models including the fully supervised ones. We perform detailed error analysis on the best performing text and graph based models and observe that hateful users have unique network neighborhood signatures and the AGNN model benefits by paying attention to these signatures. This property, as we observe, also allows the model to generalize well across platforms in a zero-shot setting. Lastly, we utilize the best performing GNN model to analyze the evolution of hateful users and their targets over time in Gab. △ Less

Submitted 1 August, 2021; originally announced August 2021.

Comments: Extended Version of this paper has been accepted at ACM HT'21. Link to the Code: https://github.com/hate-alert/Hateful-users-detection

When Fair Ranking Meets Uncertain Inference

Authors: Avijit Ghosh, Ritam Dutt, Christo Wilson

Abstract: Existing fair ranking systems, especially those designed to be demographically fair, assume that accurate demographic information about individuals is available to the ranking algorithm. In practice, however, this assumption may not hold -- in real-world contexts like ranking job applicants or credit seekers, social and legal barriers may prevent algorithm operators from collecting peoples' demogr… ▽ More Existing fair ranking systems, especially those designed to be demographically fair, assume that accurate demographic information about individuals is available to the ranking algorithm. In practice, however, this assumption may not hold -- in real-world contexts like ranking job applicants or credit seekers, social and legal barriers may prevent algorithm operators from collecting peoples' demographic information. In these cases, algorithm operators may attempt to infer peoples' demographics and then supply these inferences as inputs to the ranking algorithm. In this study, we investigate how uncertainty and errors in demographic inference impact the fairness offered by fair ranking algorithms. Using simulations and three case studies with real datasets, we show how demographic inferences drawn from real systems can lead to unfair rankings. Our results suggest that developers should not use inferred demographic data as input to fair ranking algorithms, unless the inferences are extremely accurate. △ Less

Submitted 4 May, 2022; v1 submitted 5 May, 2021; originally announced May 2021.

Comments: Accepted as full paper at SIGIR 2021

RESPER: Computationally Modelling Resisting Strategies in Persuasive Conversations

Authors: Ritam Dutt, Sayan Sinha, Rishabh Joshi, Surya Shekhar Chakraborty, Meredith Riggs, Xinru Yan, Haogang Bao, Carolyn Penstein Rosé

Abstract: Modelling persuasion strategies as predictors of task outcome has several real-world applications and has received considerable attention from the computational linguistics community. However, previous research has failed to account for the resisting strategies employed by an individual to foil such persuasion attempts. Grounded in prior literature in cognitive and social psychology, we propose a… ▽ More Modelling persuasion strategies as predictors of task outcome has several real-world applications and has received considerable attention from the computational linguistics community. However, previous research has failed to account for the resisting strategies employed by an individual to foil such persuasion attempts. Grounded in prior literature in cognitive and social psychology, we propose a generalised framework for identifying resisting strategies in persuasive conversations. We instantiate our framework on two distinct datasets comprising persuasion and negotiation conversations. We also leverage a hierarchical sequence-labelling neural architecture to infer the aforementioned resisting strategies automatically. Our experiments reveal the asymmetry of power roles in non-collaborative goal-directed conversations and the benefits accrued from incorporating resisting strategies on the final conversation outcome. We also investigate the role of different resisting strategies on the conversation outcome and glean insights that corroborate with past findings. We also make the code and the dataset of this work publicly available at https://github.com/americast/resper. △ Less

Submitted 25 January, 2021; originally announced January 2021.

Comments: Accepted as a long paper at the 16th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2021)

Kee** Up Appearances: Computational Modeling of Face Acts in Persuasion Oriented Discussions

Authors: Ritam Dutt, Rishabh Joshi, Carolyn Penstein Rose

Abstract: The notion of face refers to the public self-image of an individual that emerges both from the individual's own actions as well as from the interaction with others. Modeling face and understanding its state changes throughout a conversation is critical to the study of maintenance of basic human needs in and through interaction. Grounded in the politeness theory of Brown and Levinson (1978), we pro… ▽ More The notion of face refers to the public self-image of an individual that emerges both from the individual's own actions as well as from the interaction with others. Modeling face and understanding its state changes throughout a conversation is critical to the study of maintenance of basic human needs in and through interaction. Grounded in the politeness theory of Brown and Levinson (1978), we propose a generalized framework for modeling face acts in persuasion conversations, resulting in a reliable coding manual, an annotated corpus, and computational models. The framework reveals insights about differences in face act utilization between asymmetric roles in persuasion conversations. Using computational models, we are able to successfully identify face acts as well as predict a key conversational outcome (e.g. donation success). Finally, we model a latent representation of the conversational state to analyze the impact of predicted face acts on the probability of a positive conversational outcome and observe several correlations that corroborate previous findings. △ Less

Submitted 23 September, 2020; v1 submitted 22 September, 2020; originally announced September 2020.

Comments: To appear at Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP, 2020) as a full paper

LTIatCMU at SemEval-2020 Task 11: Incorporating Multi-Level Features for Multi-Granular Propaganda Span Identification

Authors: Sopan Khosla, Rishabh Joshi, Ritam Dutt, Alan W Black, Yulia Tsvetkov

Abstract: In this paper we describe our submission for the task of Propaganda Span Identification in news articles. We introduce a BERT-BiLSTM based span-level propaganda classification model that identifies which token spans within the sentence are indicative of propaganda. The "multi-granular" model incorporates linguistic knowledge at various levels of text granularity, including word, sentence and docum… ▽ More In this paper we describe our submission for the task of Propaganda Span Identification in news articles. We introduce a BERT-BiLSTM based span-level propaganda classification model that identifies which token spans within the sentence are indicative of propaganda. The "multi-granular" model incorporates linguistic knowledge at various levels of text granularity, including word, sentence and document level syntactic, semantic and pragmatic affect features, which significantly improve model performance, compared to its language-agnostic variant. To facilitate better representation learning, we also collect a corpus of 10k news articles, and use it for fine-tuning the model. The final model is a majority-voting ensemble which learns different propaganda class boundaries by leveraging different subsets of incorporated knowledge and attains $4^{th}$ position on the test leaderboard. Our final model and code is released at https://github.com/sopu/PropagandaSemEval2020. △ Less

Submitted 20 August, 2020; v1 submitted 11 August, 2020; originally announced August 2020.

Utilizing Microblogs for Assisting Post-Disaster Relief Operations via Matching Resource Needs and Availabilities

Authors: Ritam Dutt, Moumita Basu, Kripabandhu Ghosh, Saptarshi Ghosh

Abstract: During a disaster event, two types of information that are especially useful for coordinating relief operations are needs and availabilities of resources (e.g., food, water, medicines) in the affected region. Information posted on microblogging sites is increasingly being used for assisting post-disaster relief operations. In this context, two practical challenges are (i)~to identify tweets that i… ▽ More During a disaster event, two types of information that are especially useful for coordinating relief operations are needs and availabilities of resources (e.g., food, water, medicines) in the affected region. Information posted on microblogging sites is increasingly being used for assisting post-disaster relief operations. In this context, two practical challenges are (i)~to identify tweets that inform about resource needs and availabilities (termed as need-tweets and availability-tweets respectively), and (ii)~to automatically match needs with appropriate availabilities. While several works have addressed the first problem, there has been little work on automatically matching needs with availabilities. The few prior works that attempted matching only considered the resources, and no attempt has been made to understand other aspects of needs/availabilities that are essential for matching in practice. In this work, we develop a methodology for understanding five important aspects of need-tweets and availability-tweets, including what resource and what quantity is needed/available, the geographical location of the need/availability, and who needs / is providing the resource. Understanding these aspects helps us to address the need-availability matching problem considering not only the resources, but also other factors such as the geographical proximity between the need and the availability. To our knowledge, this study is the first attempt to develop methods for understanding the semantics of need-tweets and availability-tweets. We also develop a novel methodology for matching need-tweets with availability-tweets, considering both resource similarity and geographical proximity. Experiments on two datasets corresponding to two disaster events, demonstrate that our proposed methods perform substantially better matching than those in prior works. △ Less

Submitted 18 July, 2020; originally announced July 2020.

Journal ref: Information Processing and Management, Elsevier, vol. 56, issue 5, pages 1680--1697, September 2019

NARMADA: Need and Available Resource Managing Assistant for Disasters and Adversities

Authors: Kaustubh Hiware, Ritam Dutt, Sayan Sinha, Sohan Patro, Kripabandhu Ghosh, Saptarshi Ghosh

Abstract: Although a lot of research has been done on utilising Online Social Media during disasters, there exists no system for a specific task that is critical in a post-disaster scenario -- identifying resource-needs and resource-availabilities in the disaster-affected region, coupled with their subsequent matching. To this end, we present NARMADA, a semi-automated platform which leverages the crowd-sour… ▽ More Although a lot of research has been done on utilising Online Social Media during disasters, there exists no system for a specific task that is critical in a post-disaster scenario -- identifying resource-needs and resource-availabilities in the disaster-affected region, coupled with their subsequent matching. To this end, we present NARMADA, a semi-automated platform which leverages the crowd-sourced information from social media posts for assisting post-disaster relief coordination efforts. The system employs Natural Language Processing and Information Retrieval techniques for identifying resource-needs and resource-availabilities from microblogs, extracting resources from the posts, and also matching the needs to suitable availabilities. The system is thus capable of facilitating the judicious management of resources during post-disaster relief operations. △ Less

Submitted 27 May, 2020; originally announced May 2020.

Comments: ACL 2020 Workshop on Natural Language Processing for Social Media (SocialNLP)

Improving Broad-Coverage Medical Entity Linking with Semantic Type Prediction and Large-Scale Datasets

Authors: Shikhar Vashishth, Denis Newman-Griffis, Rishabh Joshi, Ritam Dutt, Carolyn Rose

Abstract: Medical entity linking is the task of identifying and standardizing medical concepts referred to in an unstructured text. Most of the existing methods adopt a three-step approach of (1) detecting mentions, (2) generating a list of candidate concepts, and finally (3) picking the best concept among them. In this paper, we probe into alleviating the problem of overgeneration of candidate concepts in… ▽ More Medical entity linking is the task of identifying and standardizing medical concepts referred to in an unstructured text. Most of the existing methods adopt a three-step approach of (1) detecting mentions, (2) generating a list of candidate concepts, and finally (3) picking the best concept among them. In this paper, we probe into alleviating the problem of overgeneration of candidate concepts in the candidate generation module, the most under-studied component of medical entity linking. For this, we present MedType, a fully modular system that prunes out irrelevant candidate concepts based on the predicted semantic type of an entity mention. We incorporate MedType into five off-the-shelf toolkits for medical entity linking and demonstrate that it consistently improves entity linking performance across several benchmark datasets. To address the dearth of annotated training data for medical entity linking, we present WikiMed and PubMedDS, two large-scale medical entity linking datasets, and demonstrate that pre-training MedType on these datasets further improves entity linking performance. We make our source code and datasets publicly available for medical entity linking research. △ Less

Submitted 22 August, 2021; v1 submitted 1 May, 2020; originally announced May 2020.

Comments: 44 pages

Journal ref: Journal of Biomedical Informatics 2021

Analysing the Extent of Misinformation in Cancer Related Tweets

Authors: Rakesh Bal, Sayan Sinha, Swastika Dutta, Rishabh Joshi, Sayan Ghosh, Ritam Dutt

Abstract: Twitter has become one of the most sought after places to discuss a wide variety of topics, including medically relevant issues such as cancer. This helps spread awareness regarding the various causes, cures and prevention methods of cancer. However, no proper analysis has been performed, which discusses the validity of such claims. In this work, we aim to tackle the misinformation spread in such… ▽ More Twitter has become one of the most sought after places to discuss a wide variety of topics, including medically relevant issues such as cancer. This helps spread awareness regarding the various causes, cures and prevention methods of cancer. However, no proper analysis has been performed, which discusses the validity of such claims. In this work, we aim to tackle the misinformation spread in such platforms. We collect and present a dataset regarding tweets which talk specifically about cancer and propose an attention-based deep learning model for automated detection of misinformation along with its spread. We then do a comparative analysis of the linguistic variation in the text corresponding to misinformation and truth. This analysis helps us gather relevant insights on various social aspects related to misinformed tweets. △ Less

Submitted 2 April, 2020; v1 submitted 30 March, 2020; originally announced March 2020.

Comments: Proceedings of the 14th International Conference on Web and Social Media (ICWSM-20)

Journal ref: ICWSM 2020, 14, 924-928

Public Sphere 2.0: Targeted Commenting in Online News Media

Authors: Ankan Mullick, Sayan Ghosh, Ritam Dutt, Avijit Ghosh, Abhijnan Chakraborty

Abstract: With the increase in online news consumption, to maximize advertisement revenue, news media websites try to attract and retain their readers on their sites. One of the most effective tools for reader engagement is commenting, where news readers post their views as comments against the news articles. Traditionally, it has been assumed that the comments are mostly made against the full article. In t… ▽ More With the increase in online news consumption, to maximize advertisement revenue, news media websites try to attract and retain their readers on their sites. One of the most effective tools for reader engagement is commenting, where news readers post their views as comments against the news articles. Traditionally, it has been assumed that the comments are mostly made against the full article. In this work, we show that present commenting landscape is far from this assumption. Because the readers lack the time to go over an entire article, most of the comments are relevant to only particular sections of an article. In this paper, we build a system which can automatically classify comments against relevant sections of an article. To implement that, we develop a deep neural network based mechanism to find comments relevant to any section and a paragraph wise commenting interface to showcase them. We believe that such a data driven commenting system can help news websites to further increase reader engagement. △ Less

Submitted 21 February, 2019; originally announced February 2019.

Comments: Accepted at ECIR 2019

Spread of hate speech in online social media

Authors: Binny Mathew, Ritam Dutt, Pawan Goyal, Animesh Mukherjee

Abstract: The present online social media platform is afflicted with several issues, with hate speech being on the predominant forefront. The prevalence of online hate speech has fueled horrific real-world hate-crime such as the mass-genocide of Rohingya Muslims, communal violence in Colombo and the recent massacre in the Pittsburgh synagogue. Consequently, It is imperative to understand the diffusion of su… ▽ More The present online social media platform is afflicted with several issues, with hate speech being on the predominant forefront. The prevalence of online hate speech has fueled horrific real-world hate-crime such as the mass-genocide of Rohingya Muslims, communal violence in Colombo and the recent massacre in the Pittsburgh synagogue. Consequently, It is imperative to understand the diffusion of such hateful content in an online setting. We conduct the first study that analyses the flow and dynamics of posts generated by hateful and non-hateful users on Gab (gab.com) over a massive dataset of 341K users and 21M posts. Our observations confirms that hateful content diffuse farther, wider and faster and have a greater outreach than those of non-hateful users. A deeper inspection into the profiles and network of hateful and non-hateful users reveals that the former are more influential, popular and cohesive. Thus, our research explores the interesting facets of diffusion dynamics of hateful users and broadens our understanding of hate speech in the online world. △ Less

Submitted 4 December, 2018; originally announced December 2018.

Comments: 8 pages, 5 figures, and 4 table

Deep Dive into Anonymity: A Large Scale Analysis of Quora Questions

Authors: Binny Mathew, Ritam Dutt, Suman Kalyan Maity, Pawan Goyal, Animesh Mukherjee

Abstract: Anonymity forms an integral and important part of our digital life. It enables us to express our true selves without the fear of judgment. In this paper, we investigate the different aspects of anonymity in the social Q&A site Quora. The choice of Quora is motivated by the fact that this is one of the rare social Q&A sites that allow users to explicitly post anonymous questions and such activity i… ▽ More Anonymity forms an integral and important part of our digital life. It enables us to express our true selves without the fear of judgment. In this paper, we investigate the different aspects of anonymity in the social Q&A site Quora. The choice of Quora is motivated by the fact that this is one of the rare social Q&A sites that allow users to explicitly post anonymous questions and such activity in this forum has become normative rather than a taboo. Through an analysis of 5.1 million questions, we observe that at a global scale almost no difference manifests between the linguistic structure of the anonymous and the non-anonymous questions. We find that topical mixing at the global scale to be the primary reason for the absence. However, the differences start to feature once we "deep dive" and (topically) cluster the questions and compare the clusters that have high volumes of anonymous questions with those that have low volumes of anonymous questions. In particular, we observe that the choice to post the question as anonymous is dependent on the user's perception of anonymity and they often choose to speak about depression, anxiety, social ties and personal issues under the guise of anonymity. We further perform personality trait analysis and observe that the anonymous group of users has positive correlation with extraversion, agreeableness, and negative correlation with openness. Subsequently, to gain further insights, we build an anonymity grid to identify the differences in the perception on anonymity of the user posting the question and the community of users answering it. We also look into the first response time of the questions and observe that it is lowest for topics which talk about personal and sensitive issues, which hints toward a higher degree of community support and user engagement. △ Less

Submitted 17 November, 2018; originally announced November 2018.

Comments: 12 pages, 6 figures, and 12 tables

'Senator, We Sell Ads': Analysis of the 2016 Russian Facebook Ads Campaign

Authors: Ritam Dutt, Ashok Deb, Emilio Ferrara

Abstract: One of the key aspects of the United States democracy is free and fair elections that allow for a peaceful transfer of power from one President to the next. The 2016 US presidential election stands out due to suspected foreign influence before, during, and after the election. A significant portion of that suspected influence was carried out via social media. In this paper, we look specifically at… ▽ More One of the key aspects of the United States democracy is free and fair elections that allow for a peaceful transfer of power from one President to the next. The 2016 US presidential election stands out due to suspected foreign influence before, during, and after the election. A significant portion of that suspected influence was carried out via social media. In this paper, we look specifically at 3,500 Facebook ads allegedly purchased by the Russian government. These ads were released on May 10, 2018 by the US Congress House Intelligence Committee. We analyzed the ads using natural language processing techniques to determine textual and semantic features associated with the most effective ones. We clustered the ads over time into the various campaigns and the labeled parties associated with them. We also studied the effectiveness of Ads on an individual, campaign and party basis. The most effective ads tend to have less positive sentiment, focus on past events and are more specific and personalized in nature. The more effective campaigns also show such similar characteristics. The campaigns' duration and promotion of the Ads suggest a desire to sow division rather than sway the election. △ Less

Submitted 26 September, 2018; originally announced September 2018.

Comments: Accepted: Third International Conference on Intelligent Information Technologies (ICIIT 2018), Chennai, India, December 11-14, 2018

CL Scholar: The ACL Anthology Knowledge Graph Miner

Authors: Mayank Singh, Pradeep Dogga, Sohan Patro, Dhiraj Barnwal, Ritam Dutt, Rajarshi Haldar, Pawan Goyal, Animesh Mukherjee

Abstract: We present CL Scholar, the ACL Anthology knowledge graph miner to facilitate high-quality search and exploration of current research progress in the computational linguistics community. In contrast to previous works, periodically crawling, indexing and processing of new incoming articles is completely automated in the current system. CL Scholar utilizes both textual and network information for kno… ▽ More We present CL Scholar, the ACL Anthology knowledge graph miner to facilitate high-quality search and exploration of current research progress in the computational linguistics community. In contrast to previous works, periodically crawling, indexing and processing of new incoming articles is completely automated in the current system. CL Scholar utilizes both textual and network information for knowledge graph construction. As an additional novel initiative, CL Scholar supports more than 1200 scholarly natural language queries along with standard keyword-based search on constructed knowledge graph. It answers binary, statistical and list based natural language queries. The current system is deployed at http://cnerg.iitkgp.ac.in/aclakg. We also provide REST API support along with bulk download facility. Our code and data are available at https://github.com/CLScholar. △ Less

Submitted 16 April, 2018; originally announced April 2018.

Comments: 5 pages

SAVITR: A System for Real-time Location Extraction from Microblogs during Emergencies

Authors: Ritam Dutt, Kaustubh Hiware, Avijit Ghosh, Rameshwar Bhaskaran

Abstract: We present SAVITR, a system that leverages the information posted on the Twitter microblogging site to monitor and analyse emergency situations. Given that only a very small percentage of microblogs are geo-tagged, it is essential for such a system to extract locations from the text of the microblogs. We employ natural language processing techniques to infer the locations mentioned in the microblo… ▽ More We present SAVITR, a system that leverages the information posted on the Twitter microblogging site to monitor and analyse emergency situations. Given that only a very small percentage of microblogs are geo-tagged, it is essential for such a system to extract locations from the text of the microblogs. We employ natural language processing techniques to infer the locations mentioned in the microblog text, in an unsupervised fashion and display it on a map-based interface. The system is designed for efficient performance, achieving an F-score of 0.79, and is approximately two orders of magnitude faster than other available tools for location extraction. △ Less

Submitted 19 November, 2018; v1 submitted 23 January, 2018; originally announced January 2018.

Comments: Presented at SMERP - WWW 2018. Please cite this link for references: https://dl.acm.org/citation.cfm?id=3191623

Model Independent Constraints on Solar Neutrinos

Authors: Lal Singh, Bhag C. Chauhan, Ravi Dutt, K. K. Sharma, S. Dev

Abstract: Using the data from SNO NCD phase, SuperK, Borexino and KamLAND Solar phase, we derive in a model independent way, bounds on the possible components in the solar neutrino flux. We update the limits on the antineutrino ($\barν_x$) flux and sterile ($ν_s$) component and compare them with the previous results obtained using SNO Salt phase data and data from SuperKamiokande experiments. It is affirmed… ▽ More Using the data from SNO NCD phase, SuperK, Borexino and KamLAND Solar phase, we derive in a model independent way, bounds on the possible components in the solar neutrino flux. We update the limits on the antineutrino ($\barν_x$) flux and sterile ($ν_s$) component and compare them with the previous results obtained using SNO Salt phase data and data from SuperKamiokande experiments. It is affirmed that the upper bound on $\barν_x$ is independent of the $ν_s$ component. We recover the $ν_s$ and $\barν_x$ upper bounds existing in the literature. We also obtain bounds on $f_B$, the SSM normalization factor and the common parameter range for $f_B$ and the $ν_s$ components in the light of latest data. In summary, we update, in a model independent way, the previous results existing in literature in the light of latest solar neutrino data. △ Less

Submitted 24 February, 2011; originally announced February 2011.

Comments: 21 pages, 3 figures and 13 tables

Shape invariant potentials in SUSY quantum mechanics and periodic orbit theory

Authors: Rajat K. Bhaduri, Jamal Sakhr, D. W. L. Sprung, Ranabir Dutt, Akira Suzuki

Abstract: We examine shape invariant potentials (excluding those that are obtained by scaling) in supersymmetric quantum mechanics from the stand-point of periodic orbit theory. An exact trace formula for the quantum spectra of such potentials is derived. Based on this result, and Barclay's functional relationship for such potentials, we present a new derivation of the result that the lowest order SWKB qu… ▽ More We examine shape invariant potentials (excluding those that are obtained by scaling) in supersymmetric quantum mechanics from the stand-point of periodic orbit theory. An exact trace formula for the quantum spectra of such potentials is derived. Based on this result, and Barclay's functional relationship for such potentials, we present a new derivation of the result that the lowest order SWKB quantisation rule is exact. △ Less

Submitted 15 October, 2004; v1 submitted 5 October, 2004; originally announced October 2004.

Comments: 4 pages, 1 figure, corrected typos, minor revisions, added references

Journal ref: J.Phys. A38 (2005) L183

New Solvable Singular Potentials

Authors: R. Dutt, A. Gangopadhyaya, C. Rasinariu, U. Sukhatme

Abstract: We obtain three new solvable, real, shape invariant potentials starting from the harmonic oscillator, Pöschl-Teller I and Pöschl-Teller II potentials on the half-axis and extending their domain to the full line, while taking special care to regularize the inverse square singularity at the origin. The regularization procedure gives rise to a delta-function behavior at the origin. Our new systems… ▽ More We obtain three new solvable, real, shape invariant potentials starting from the harmonic oscillator, Pöschl-Teller I and Pöschl-Teller II potentials on the half-axis and extending their domain to the full line, while taking special care to regularize the inverse square singularity at the origin. The regularization procedure gives rise to a delta-function behavior at the origin. Our new systems possess underlying non-linear potential algebras, which can also be used to determine their spectra analytically. △ Less

Submitted 12 November, 2000; originally announced November 2000.

Comments: 19 pages, 4 figures

Report number: UICHEP-TH/00-2

Journal ref: J.Phys.A34:4129-4142,2001

Coordinate Realizations of Deformed Lie Algebras with Three Generators

Authors: R. Dutt, A. Gangopadhyaya, C. Rasinariu, U. Sukhatme

Abstract: Differential realizations in coordinate space for deformed Lie algebras with three generators are obtained using bosonic creation and annihilation operators satisfying Heisenberg commutation relations. The unified treatment presented here contains as special cases all previously given coordinate realizations of $so(2,1),so(3)$ and their deformations. Applications to physical problems involving e… ▽ More Differential realizations in coordinate space for deformed Lie algebras with three generators are obtained using bosonic creation and annihilation operators satisfying Heisenberg commutation relations. The unified treatment presented here contains as special cases all previously given coordinate realizations of $so(2,1),so(3)$ and their deformations. Applications to physical problems involving eigenvalue determination in nonrelativistic quantum mechanics are discussed. △ Less

Submitted 7 April, 1999; originally announced April 1999.

Comments: 11 pages, 0 figures

Report number: UICHEP-TH/98-8

Journal ref: Phys.Rev. A60 (1999) 3482-3486

Algebraic Shape Invariant Models

Authors: S. Chaturvedi, R. Dutt, A. Gangopadhyaya, P. Panigrahi, C. Rasinariu, U. Sukhatme

Abstract: Motivated by the shape invariance condition in supersymmetric quantum mechanics, we develop an algebraic framework for shape invariant Hamiltonians with a general change of parameters. This approach involves nonlinear generalizations of Lie algebras. Our work extends previous results showing the equivalence of shape invariant potentials involving translational change of parameters with standard… ▽ More Motivated by the shape invariance condition in supersymmetric quantum mechanics, we develop an algebraic framework for shape invariant Hamiltonians with a general change of parameters. This approach involves nonlinear generalizations of Lie algebras. Our work extends previous results showing the equivalence of shape invariant potentials involving translational change of parameters with standard $SO(2,1)$ potential algebra for Natanzon type potentials. △ Less

Submitted 10 July, 1998; originally announced July 1998.

Comments: 8 pages, 2 figures

Report number: UICHEP-TH/98-7

Journal ref: Phys.Lett. A248 (1998) 109-113; Erratum-ibid. A251 (1999) 406

Non-Central Potentials and Spherical Harmonics Using Supersymmetry and Shape Invariance

Authors: Ranabir Dutt, Asim Gangopadhyaya, Uday P. Sukhatme

Abstract: It is shown that the operator methods of supersymmetric quantum mechanics and the concept of shape invariance can profitably be used to derive properties of spherical harmonics in a simple way. The same operator techniques can also be applied to several problems with non-central vector and scalar potentials. As examples, we analyze the bound state spectra of an electron in a Coulomb plus an Ahar… ▽ More It is shown that the operator methods of supersymmetric quantum mechanics and the concept of shape invariance can profitably be used to derive properties of spherical harmonics in a simple way. The same operator techniques can also be applied to several problems with non-central vector and scalar potentials. As examples, we analyze the bound state spectra of an electron in a Coulomb plus an Aharonov-Bohm field and/or in the magnetic field of a Dirac monopole. △ Less

Submitted 12 November, 1996; originally announced November 1996.

Comments: Latex, 12 pages. To appear in American Journal of Physics

Journal ref: Am.J.Phys. 65 (1997) 400-403

New Eaxactly Solvable Hamiltonians: Shape Invariance and Self-Similarity

Authors: D. T. Barclay, R. Dutt, A. Gangopadhyaya, Avinash Khare, A. Pagnamenta, U. Sukhatme

Abstract: We discuss in some detail the self-similar potentials of Shabat and Spiridonov which are reflectionless and have an infinite number of bound states. We demonstrate that these self-similar potentials are in fact shape invariant potentials within the formalism of supersymmetric quantum mechanics. In particular, using a scaling ansatz for the change of parameters, we obtain a large class of new, re… ▽ More We discuss in some detail the self-similar potentials of Shabat and Spiridonov which are reflectionless and have an infinite number of bound states. We demonstrate that these self-similar potentials are in fact shape invariant potentials within the formalism of supersymmetric quantum mechanics. In particular, using a scaling ansatz for the change of parameters, we obtain a large class of new, reflectionless, shape invariant potentials of which the Shabat-Spiridonov ones are a special case. These new potentials can be viewed as q-deformations of the single soliton solution corresponding to the Rosen-Morse potential. Explicit expressions for the energy eigenvalues, eigenfunctions and transmission coefficients for these potentials are obtained. We show that these potentials can also be obtained numerically. Included as an intriguing case is a shape invariant double well potential whose supersymmetric partner potential is only a single well. Our class of exactly solvable Hamiltonians is further enlarged by examining two new directions: (i) changes of parameters which are different from the previously studied cases of translation and scaling; (ii) extending the usual concept of shape invariance in one step to a multi-step situation. These extensions can be viewed as q-deformations of the harmonic oscillator or multi-soliton solutions corresponding to the Rosen-Morse potential. △ Less

Submitted 28 April, 1993; originally announced April 1993.

Comments: 26 pages, plain tex, request figures by e-mail

Report number: UIC HEP_TH/93-4

Journal ref: Phys.Rev. A48 (1993) 2786-2797