-
Pulsation in TESS Objects of Interest
Authors:
R. L. Gomes,
B. L. Canto Martins,
D. O. Fontinele,
L. A. Almeida,
R. Alves Freire,
A. C. Brito,
R. G. S. B. de Amorim,
C. E. Ferreira Lopes,
D. Hazarika,
E. Janot-Pacheco,
I. C. Leão,
Y. S. Messias,
R. A. A. Souza,
J. R. De Medeiros
Abstract:
We report the discovery of three Transiting Exoplanet Survey Satellite Objects of Interest (TOI) with signatures of pulsation, observed in more than one sector. Our main goal is to explore how large is the variety of classical pulsators such as $δ$ Sct, $γ$ Dor, RR Lyrae and Cepheid among TOI pulsators. The analysis reveals two stars with signatures of $δ$ Sct and one of $γ$ Dor, out of a sample o…
▽ More
We report the discovery of three Transiting Exoplanet Survey Satellite Objects of Interest (TOI) with signatures of pulsation, observed in more than one sector. Our main goal is to explore how large is the variety of classical pulsators such as $δ$ Sct, $γ$ Dor, RR Lyrae and Cepheid among TOI pulsators. The analysis reveals two stars with signatures of $δ$ Sct and one of $γ$ Dor, out of a sample of 3901 TOIs with available light curves (LCs). To date, there is a very scarce number of known pulsating stars hosting planets. The present finding also emerges as an exciting laboratory for studying different astrophysical phenomena, including the effects of star-planet interaction on pulsation and timing detection of planetary companions. We have also identified 16 TOI stars with periodicities and LCs morphology compatible with different classical pulsating classes, but for most of them, the dominant frequency signals originate from contaminating sources.
△ Less
Submitted 24 February, 2024;
originally announced February 2024.
-
CESAR: Automatic Induction of Compositional Instructions for Multi-turn Dialogs
Authors:
Taha Aksu,
Devamanyu Hazarika,
Shikib Mehri,
Seokhwan Kim,
Dilek Hakkani-Tür,
Yang Liu,
Mahdi Namazifar
Abstract:
Instruction-based multitasking has played a critical role in the success of large language models (LLMs) in multi-turn dialog applications. While publicly available LLMs have shown promising performance, when exposed to complex instructions with multiple constraints, they lag against state-of-the-art models like ChatGPT. In this work, we hypothesize that the availability of large-scale complex dem…
▽ More
Instruction-based multitasking has played a critical role in the success of large language models (LLMs) in multi-turn dialog applications. While publicly available LLMs have shown promising performance, when exposed to complex instructions with multiple constraints, they lag against state-of-the-art models like ChatGPT. In this work, we hypothesize that the availability of large-scale complex demonstrations is crucial in bridging this gap. Focusing on dialog applications, we propose a novel framework, CESAR, that unifies a large number of dialog tasks in the same format and allows programmatic induction of complex instructions without any manual effort.
We apply CESAR on InstructDial, a benchmark for instruction-based dialog tasks. We further enhance InstructDial with new datasets and tasks and utilize CESAR to induce complex tasks with compositional instructions. This results in a new benchmark called InstructDial++, which includes 63 datasets with 86 basic tasks and 68 composite tasks. Through rigorous experiments, we demonstrate the scalability of CESAR in providing rich instructions. Models trained on InstructDial++ can follow compositional prompts, such as prompts that ask for multiple stylistic constraints.
△ Less
Submitted 29 November, 2023;
originally announced November 2023.
-
Data-Efficient Alignment of Large Language Models with Human Feedback Through Natural Language
Authors:
Di **,
Shikib Mehri,
Devamanyu Hazarika,
Aishwarya Padmakumar,
Sung** Lee,
Yang Liu,
Mahdi Namazifar
Abstract:
Learning from human feedback is a prominent technique to align the output of large language models (LLMs) with human expectations. Reinforcement learning from human feedback (RLHF) leverages human preference signals that are in the form of ranking of response pairs to perform this alignment. However, human preference on LLM outputs can come in much richer forms including natural language, which ma…
▽ More
Learning from human feedback is a prominent technique to align the output of large language models (LLMs) with human expectations. Reinforcement learning from human feedback (RLHF) leverages human preference signals that are in the form of ranking of response pairs to perform this alignment. However, human preference on LLM outputs can come in much richer forms including natural language, which may provide detailed feedback on strengths and weaknesses of a given response. In this work we investigate data efficiency of modeling human feedback that is in natural language. Specifically, we fine-tune an open-source LLM, e.g., Falcon-40B-Instruct, on a relatively small amount (1000 records or even less) of human feedback in natural language in the form of critiques and revisions of responses. We show that this model is able to improve the quality of responses from even some of the strongest LLMs such as ChatGPT, BARD, and Vicuna, through critique and revision of those responses. For instance, through one iteration of revision of ChatGPT responses, the revised responses have 56.6% win rate over the original ones, and this win rate can be further improved to 65.9% after applying the revision for five iterations.
△ Less
Submitted 24 November, 2023;
originally announced November 2023.
-
"What do others think?": Task-Oriented Conversational Modeling with Subjective Knowledge
Authors:
Chao Zhao,
Spandana Gella,
Seokhwan Kim,
Di **,
Devamanyu Hazarika,
Alexandros Papangelis,
Behnam Hedayatnia,
Mahdi Namazifar,
Yang Liu,
Dilek Hakkani-Tur
Abstract:
Task-oriented Dialogue (TOD) Systems aim to build dialogue systems that assist users in accomplishing specific goals, such as booking a hotel or a restaurant. Traditional TODs rely on domain-specific APIs/DBs or external factual knowledge to generate responses, which cannot accommodate subjective user requests (e.g., "Is the WIFI reliable?" or "Does the restaurant have a good atmosphere?"). To add…
▽ More
Task-oriented Dialogue (TOD) Systems aim to build dialogue systems that assist users in accomplishing specific goals, such as booking a hotel or a restaurant. Traditional TODs rely on domain-specific APIs/DBs or external factual knowledge to generate responses, which cannot accommodate subjective user requests (e.g., "Is the WIFI reliable?" or "Does the restaurant have a good atmosphere?"). To address this issue, we propose a novel task of subjective-knowledge-based TOD (SK-TOD). We also propose the first corresponding dataset, which contains subjective knowledge-seeking dialogue contexts and manually annotated responses grounded in subjective knowledge sources. When evaluated with existing TOD approaches, we find that this task poses new challenges such as aggregating diverse opinions from multiple knowledge snippets. We hope this task and dataset can promote further research on TOD and subjective content understanding. The code and the dataset are available at https://github.com/alexa/dstc11-track5.
△ Less
Submitted 2 October, 2023; v1 submitted 20 May, 2023;
originally announced May 2023.
-
KILM: Knowledge Injection into Encoder-Decoder Language Models
Authors:
Yan Xu,
Mahdi Namazifar,
Devamanyu Hazarika,
Aishwarya Padmakumar,
Yang Liu,
Dilek Hakkani-Tür
Abstract:
Large pre-trained language models (PLMs) have been shown to retain implicit knowledge within their parameters. To enhance this implicit knowledge, we propose Knowledge Injection into Language Models (KILM), a novel approach that injects entity-related knowledge into encoder-decoder PLMs, via a generative knowledge infilling objective through continued pre-training. This is done without architectur…
▽ More
Large pre-trained language models (PLMs) have been shown to retain implicit knowledge within their parameters. To enhance this implicit knowledge, we propose Knowledge Injection into Language Models (KILM), a novel approach that injects entity-related knowledge into encoder-decoder PLMs, via a generative knowledge infilling objective through continued pre-training. This is done without architectural modifications to the PLMs or adding additional parameters. Experimental results over a suite of knowledge-intensive tasks spanning numerous datasets show that KILM enables models to retain more knowledge and hallucinate less, while preserving their original performance on general NLU and NLG tasks. KILM also demonstrates improved zero-shot performances on tasks such as entity disambiguation, outperforming state-of-the-art models having 30x more parameters.
△ Less
Submitted 17 February, 2023;
originally announced February 2023.
-
Role of Bias Terms in Dot-Product Attention
Authors:
Mahdi Namazifar,
Devamanyu Hazarika,
Dilek Hakkani-Tur
Abstract:
Dot-product attention is a core module in the present generation of neural network models, particularly transformers, and is being leveraged across numerous areas such as natural language processing and computer vision. This attention module is comprised of three linear transformations, namely query, key, and value linear transformations, each of which has a bias term. In this work, we study the r…
▽ More
Dot-product attention is a core module in the present generation of neural network models, particularly transformers, and is being leveraged across numerous areas such as natural language processing and computer vision. This attention module is comprised of three linear transformations, namely query, key, and value linear transformations, each of which has a bias term. In this work, we study the role of these bias terms, and mathematically show that the bias term of the key linear transformation is redundant and could be omitted without any impact on the attention module. Moreover, we argue that the bias term of the value linear transformation has a more prominent role than that of the bias term of the query linear transformation. We empirically verify these findings through multiple experiments on language modeling, natural language understanding, and natural language generation tasks.
△ Less
Submitted 16 February, 2023;
originally announced February 2023.
-
Selective In-Context Data Augmentation for Intent Detection using Pointwise V-Information
Authors:
Yen-Ting Lin,
Alexandros Papangelis,
Seokhwan Kim,
Sung** Lee,
Devamanyu Hazarika,
Mahdi Namazifar,
Di **,
Yang Liu,
Dilek Hakkani-Tur
Abstract:
This work focuses on in-context data augmentation for intent detection. Having found that augmentation via in-context prompting of large pre-trained language models (PLMs) alone does not improve performance, we introduce a novel approach based on PLMs and pointwise V-information (PVI), a metric that can measure the usefulness of a datapoint for training a model. Our method first fine-tunes a PLM o…
▽ More
This work focuses on in-context data augmentation for intent detection. Having found that augmentation via in-context prompting of large pre-trained language models (PLMs) alone does not improve performance, we introduce a novel approach based on PLMs and pointwise V-information (PVI), a metric that can measure the usefulness of a datapoint for training a model. Our method first fine-tunes a PLM on a small seed of training data and then synthesizes new datapoints - utterances that correspond to given intents. It then employs intent-aware filtering, based on PVI, to remove datapoints that are not helpful to the downstream intent classifier. Our method is thus able to leverage the expressive power of large language models to produce diverse training data. Empirical results demonstrate that our method can produce synthetic training data that achieve state-of-the-art performance on three challenging intent detection datasets under few-shot settings (1.28% absolute improvement in 5-shot and 1.18% absolute in 10-shot, on average) and perform on par with the state-of-the-art in full-shot settings (within 0.01% absolute, on average).
△ Less
Submitted 10 February, 2023;
originally announced February 2023.
-
Using In-Context Learning to Improve Dialogue Safety
Authors:
Nicholas Meade,
Spandana Gella,
Devamanyu Hazarika,
Prakhar Gupta,
Di **,
Siva Reddy,
Yang Liu,
Dilek Hakkani-Tür
Abstract:
While large neural-based conversational models have become increasingly proficient dialogue agents, recent work has highlighted safety issues with these systems. For example, these systems can be goaded into generating toxic content, which often perpetuates social biases or stereotypes. We investigate a retrieval-based method for reducing bias and toxicity in responses from chatbots. It uses in-co…
▽ More
While large neural-based conversational models have become increasingly proficient dialogue agents, recent work has highlighted safety issues with these systems. For example, these systems can be goaded into generating toxic content, which often perpetuates social biases or stereotypes. We investigate a retrieval-based method for reducing bias and toxicity in responses from chatbots. It uses in-context learning to steer a model towards safer generations. Concretely, to generate a response to an unsafe dialogue context, we retrieve demonstrations of safe responses to similar dialogue contexts. We find our method performs competitively with strong baselines without requiring training. For instance, using automatic evaluation, we find our best fine-tuned baseline only generates safe responses to unsafe dialogue contexts from DiaSafety 4.04% more than our approach. Finally, we also propose a re-ranking procedure which can further improve response safeness.
△ Less
Submitted 22 October, 2023; v1 submitted 1 February, 2023;
originally announced February 2023.
-
Inducer-tuning: Connecting Prefix-tuning and Adapter-tuning
Authors:
Yifan Chen,
Devamanyu Hazarika,
Mahdi Namazifar,
Yang Liu,
Di **,
Dilek Hakkani-Tur
Abstract:
Prefix-tuning, or more generally continuous prompt tuning, has become an essential paradigm of parameter-efficient transfer learning. Using a large pre-trained language model (PLM), prefix-tuning can obtain strong performance by training only a small portion of parameters. In this paper, we propose to understand and further develop prefix-tuning through the kernel lens. Specifically, we make an an…
▽ More
Prefix-tuning, or more generally continuous prompt tuning, has become an essential paradigm of parameter-efficient transfer learning. Using a large pre-trained language model (PLM), prefix-tuning can obtain strong performance by training only a small portion of parameters. In this paper, we propose to understand and further develop prefix-tuning through the kernel lens. Specifically, we make an analogy between \textit{prefixes} and \textit{inducing variables} in kernel methods and hypothesize that \textit{prefixes} serving as \textit{inducing variables} would improve their overall mechanism. From the kernel estimator perspective, we suggest a new variant of prefix-tuning -- \textit{inducer-tuning}, which shares the exact mechanism as prefix-tuning while leveraging the residual form found in adapter-tuning. This mitigates the initialization issue in prefix-tuning. Through comprehensive empirical experiments on natural language understanding and generation tasks, we demonstrate that inducer-tuning can close the performance gap between prefix-tuning and fine-tuning.
△ Less
Submitted 26 October, 2022;
originally announced October 2022.
-
Analyzing Modality Robustness in Multimodal Sentiment Analysis
Authors:
Devamanyu Hazarika,
Yingting Li,
Bo Cheng,
Shuai Zhao,
Roger Zimmermann,
Soujanya Poria
Abstract:
Building robust multimodal models are crucial for achieving reliable deployment in the wild. Despite its importance, less attention has been paid to identifying and improving the robustness of Multimodal Sentiment Analysis (MSA) models. In this work, we hope to address that by (i) Proposing simple diagnostic checks for modality robustness in a trained multimodal model. Using these checks, we find…
▽ More
Building robust multimodal models are crucial for achieving reliable deployment in the wild. Despite its importance, less attention has been paid to identifying and improving the robustness of Multimodal Sentiment Analysis (MSA) models. In this work, we hope to address that by (i) Proposing simple diagnostic checks for modality robustness in a trained multimodal model. Using these checks, we find MSA models to be highly sensitive to a single modality, which creates issues in their robustness; (ii) We analyze well-known robust training strategies to alleviate the issues. Critically, we observe that robustness can be achieved without compromising on the original performance. We hope our extensive study-performed across five models and two benchmark datasets-and proposed procedures would make robustness an integral component in MSA research. Our diagnostic checks and robust training solutions are simple to implement and available at https://github. com/declare-lab/MSA-Robustness.
△ Less
Submitted 30 May, 2022;
originally announced May 2022.
-
So Different Yet So Alike! Constrained Unsupervised Text Style Transfer
Authors:
Abhinav Ramesh Kashyap,
Devamanyu Hazarika,
Min-Yen Kan,
Roger Zimmermann,
Soujanya Poria
Abstract:
Automatic transfer of text between domains has become popular in recent times. One of its aims is to preserve the semantic content of text being translated from source to target domain. However, it does not explicitly maintain other attributes between the source and translated text, for e.g., text length and descriptiveness. Maintaining constraints in transfer has several downstream applications,…
▽ More
Automatic transfer of text between domains has become popular in recent times. One of its aims is to preserve the semantic content of text being translated from source to target domain. However, it does not explicitly maintain other attributes between the source and translated text, for e.g., text length and descriptiveness. Maintaining constraints in transfer has several downstream applications, including data augmentation and de-biasing. We introduce a method for such constrained unsupervised text style transfer by introducing two complementary losses to the generative adversarial network (GAN) family of models. Unlike the competing losses used in GANs, we introduce cooperative losses where the discriminator and the generator cooperate and reduce the same loss. The first is a contrastive loss and the second is a classification loss, aiming to regularize the latent space further and bring similar sentences across domains closer together. We demonstrate that such training retains lexical, syntactic, and domain-specific constraints between domains for multiple benchmark datasets, including ones where more than one attribute change. We show that the complementary cooperative losses improve text quality, according to both automated and human evaluation measures.
△ Less
Submitted 9 May, 2022;
originally announced May 2022.
-
Empowering parameter-efficient transfer learning by recognizing the kernel structure in self-attention
Authors:
Yifan Chen,
Devamanyu Hazarika,
Mahdi Namazifar,
Yang Liu,
Di **,
Dilek Hakkani-Tur
Abstract:
The massive amount of trainable parameters in the pre-trained language models (PLMs) makes them hard to be deployed to multiple downstream tasks. To address this issue, parameter-efficient transfer learning methods have been proposed to tune only a few parameters during fine-tuning while freezing the rest. This paper looks at existing methods along this line through the \textit{kernel lens}. Motiv…
▽ More
The massive amount of trainable parameters in the pre-trained language models (PLMs) makes them hard to be deployed to multiple downstream tasks. To address this issue, parameter-efficient transfer learning methods have been proposed to tune only a few parameters during fine-tuning while freezing the rest. This paper looks at existing methods along this line through the \textit{kernel lens}. Motivated by the connection between self-attention in transformer-based PLMs and kernel learning, we propose \textit{kernel-wise adapters}, namely \textit{Kernel-mix}, that utilize the kernel structure in self-attention to guide the assignment of the tunable parameters. These adapters use guidelines found in classical kernel learning and enable separate parameter tuning for each attention head. Our empirical results, over a diverse set of natural language generation and understanding tasks, show that our proposed adapters can attain or improve the strong performance of existing baselines.
△ Less
Submitted 26 October, 2022; v1 submitted 7 May, 2022;
originally announced May 2022.
-
Exemplars-guided Empathetic Response Generation Controlled by the Elements of Human Communication
Authors:
Navonil Majumder,
Deepanway Ghosal,
Devamanyu Hazarika,
Alexander Gelbukh,
Rada Mihalcea,
Soujanya Poria
Abstract:
The majority of existing methods for empathetic response generation rely on the emotion of the context to generate empathetic responses. However, empathy is much more than generating responses with an appropriate emotion. It also often entails subtle expressions of understanding and personal resonance with the situation of the other interlocutor. Unfortunately, such qualities are difficult to quan…
▽ More
The majority of existing methods for empathetic response generation rely on the emotion of the context to generate empathetic responses. However, empathy is much more than generating responses with an appropriate emotion. It also often entails subtle expressions of understanding and personal resonance with the situation of the other interlocutor. Unfortunately, such qualities are difficult to quantify and the datasets lack the relevant annotations. To address this issue, in this paper we propose an approach that relies on exemplars to cue the generative model on fine stylistic properties that signal empathy to the interlocutor. To this end, we employ dense passage retrieval to extract relevant exemplary responses from the training set. Three elements of human communication -- emotional presence, interpretation, and exploration, and sentiment are additionally introduced using synthetic labels to guide the generation towards empathy. The human evaluation is also extended by these elements of human communication. We empirically show that these approaches yield significant improvements in empathetic response quality in terms of both automated and human-evaluated metrics. The implementation is available at https://github.com/declare-lab/exemplary-empathy.
△ Less
Submitted 4 August, 2021; v1 submitted 22 June, 2021;
originally announced June 2021.
-
Zero-Shot Controlled Generation with Encoder-Decoder Transformers
Authors:
Devamanyu Hazarika,
Mahdi Namazifar,
Dilek Hakkani-Tür
Abstract:
Controlling neural network-based models for natural language generation (NLG) has broad applications in numerous areas such as machine translation, document summarization, and dialog systems. Approaches that enable such control in a zero-shot manner would be of great importance as, among other reasons, they remove the need for additional annotated data and training. In this work, we propose novel…
▽ More
Controlling neural network-based models for natural language generation (NLG) has broad applications in numerous areas such as machine translation, document summarization, and dialog systems. Approaches that enable such control in a zero-shot manner would be of great importance as, among other reasons, they remove the need for additional annotated data and training. In this work, we propose novel approaches for controlling encoder-decoder transformer-based NLG models in zero-shot. This is done by introducing three control knobs, namely, attention biasing, decoder mixing, and context augmentation, that are applied to these models at generation time. These knobs control the generation process by directly manipulating trained NLG models (e.g., biasing cross-attention layers) to realize the desired attributes in the generated outputs. We show that not only are these NLG models robust to such manipulations, but also their behavior could be controlled without an impact on their generation performance. These results, to the best of our knowledge, are the first of their kind. Through these control knobs, we also investigate the role of transformer decoder's self-attention module and show strong evidence that its primary role is maintaining fluency of sentences generated by these models. Based on this hypothesis, we show that alternative architectures for transformer decoders could be viable options. We also study how this hypothesis could lead to more efficient ways for training encoder-decoder transformer models.
△ Less
Submitted 6 April, 2022; v1 submitted 11 June, 2021;
originally announced June 2021.
-
On $I^K$-Convergence in a Topological space via semi-open sets
Authors:
Ankur Sharmah,
Debajit Hazarika
Abstract:
In this article, we consider $\mathcal{I}^\mathcal{K}$-convergence to define a new concept of convergence namely, $\mathcal{S}$-$\mathcal{I}^\mathcal{K}$-convergence which generalizes the notion of $\mathcal{S}$-$\mathcal{I}$-convergence introduced by Guevara et al. \cite{GSR20} recently. Some properties of $\mathcal{S}$-$\mathcal{I}^\mathcal{K}$-convergence of sequences and its relation with comp…
▽ More
In this article, we consider $\mathcal{I}^\mathcal{K}$-convergence to define a new concept of convergence namely, $\mathcal{S}$-$\mathcal{I}^\mathcal{K}$-convergence which generalizes the notion of $\mathcal{S}$-$\mathcal{I}$-convergence introduced by Guevara et al. \cite{GSR20} recently. Some properties of $\mathcal{S}$-$\mathcal{I}^\mathcal{K}$-convergence of sequences and its relation with compact sets are discussed. In particular, we investigate the relation between semi-compactness and semi-Lindeloffness by introducing the notion of $\mathcal{S}$-$\mathcal{I}^\mathcal{K}$-cluster point of a sequence. The "Equivalence between semi-dense and dense sets" is utilized to characterize the set of $\mathcal{S}$-$\mathcal{I}^\mathcal{K}$-cluster points of a sequence as semi-closed subsets of a topological space. Moreover, in product space, we obtain some results for $\mathcal{I}^\mathcal{K}$-convergence which also holds for $\mathcal{S}$-$\mathcal{I}^\mathcal{K}$-convergence.
△ Less
Submitted 6 April, 2021; v1 submitted 27 March, 2021;
originally announced March 2021.
-
Further aspects of $\mathcal{I}^{\mathcal{K}}$-convergence in Topological Spaces
Authors:
Ankur Sharmah,
Debajit Hazarika
Abstract:
In this paper, we obtain some results on the relationships between different ideal \linebreak convergence modes namely, $\mathcal{I}^\mathcal{K}$, $\mathcal{I}^{\mathcal{K}^*}$, $\mathcal{I}$, $\mathcal{K}$, $\mathcal{I} \cup \mathcal{K}$ and $(\mathcal{I} \cup \mathcal{K})^*$. We introduce a topological space namely $\mathcal{I}^\mathcal{K}$-sequential space and show that the class of…
▽ More
In this paper, we obtain some results on the relationships between different ideal \linebreak convergence modes namely, $\mathcal{I}^\mathcal{K}$, $\mathcal{I}^{\mathcal{K}^*}$, $\mathcal{I}$, $\mathcal{K}$, $\mathcal{I} \cup \mathcal{K}$ and $(\mathcal{I} \cup \mathcal{K})^*$. We introduce a topological space namely $\mathcal{I}^\mathcal{K}$-sequential space and show that the class of $\mathcal{I}^\mathcal{K}$-sequential spaces contain the sequential spaces. Further $\mathcal{I}^\mathcal{K}$-notions of cluster points and limit points of a function are also introduced here. For a given sequence in a topological space $X$, we characterize the set of $\mathcal{I}^\mathcal{K}$-cluster points of the sequence as closed subsets of $X$.
△ Less
Submitted 3 March, 2021; v1 submitted 22 December, 2020;
originally announced December 2020.
-
Recognizing Emotion Cause in Conversations
Authors:
Soujanya Poria,
Navonil Majumder,
Devamanyu Hazarika,
Deepanway Ghosal,
Rishabh Bhardwaj,
Samson Yu Bai Jian,
Pengfei Hong,
Romila Ghosh,
Abhinaba Roy,
Niyati Chhaya,
Alexander Gelbukh,
Rada Mihalcea
Abstract:
We address the problem of recognizing emotion cause in conversations, define two novel sub-tasks of this problem, and provide a corresponding dialogue-level dataset, along with strong Transformer-based baselines. The dataset is available at https://github.com/declare-lab/RECCON.
Introduction: Recognizing the cause behind emotions in text is a fundamental yet under-explored area of research in NL…
▽ More
We address the problem of recognizing emotion cause in conversations, define two novel sub-tasks of this problem, and provide a corresponding dialogue-level dataset, along with strong Transformer-based baselines. The dataset is available at https://github.com/declare-lab/RECCON.
Introduction: Recognizing the cause behind emotions in text is a fundamental yet under-explored area of research in NLP. Advances in this area hold the potential to improve interpretability and performance in affect-based models. Identifying emotion causes at the utterance level in conversations is particularly challenging due to the intermingling dynamics among the interlocutors.
Method: We introduce the task of Recognizing Emotion Cause in CONversations with an accompanying dataset named RECCON, containing over 1,000 dialogues and 10,000 utterance cause-effect pairs. Furthermore, we define different cause types based on the source of the causes, and establish strong Transformer-based baselines to address two different sub-tasks on this dataset: causal span extraction and causal emotion entailment.
Result: Our Transformer-based baselines, which leverage contextual pre-trained embeddings, such as RoBERTa, outperform the state-of-the-art emotion cause extraction approaches
Conclusion: We introduce a new task highly relevant for (explainable) emotion-aware artificial intelligence: recognizing emotion cause in conversations, provide a new highly challenging publicly available dialogue-level dataset for this task, and give strong baseline results on this dataset.
△ Less
Submitted 28 July, 2021; v1 submitted 21 December, 2020;
originally announced December 2020.
-
Domain Divergences: a Survey and Empirical Analysis
Authors:
Abhinav Ramesh Kashyap,
Devamanyu Hazarika,
Min-Yen Kan,
Roger Zimmermann
Abstract:
Domain divergence plays a significant role in estimating the performance of a model in new domains. While there is a significant literature on divergence measures, researchers find it hard to choose an appropriate divergence for a given NLP application. We address this shortcoming by both surveying the literature and through an empirical study. We develop a taxonomy of divergence measures consisti…
▽ More
Domain divergence plays a significant role in estimating the performance of a model in new domains. While there is a significant literature on divergence measures, researchers find it hard to choose an appropriate divergence for a given NLP application. We address this shortcoming by both surveying the literature and through an empirical study. We develop a taxonomy of divergence measures consisting of three classes -- Information-theoretic, Geometric, and Higher-order measures and identify the relationships between them. Further, to understand the common use-cases of these measures, we recognise three novel applications -- 1) Data Selection, 2) Learning Representation, and 3) Decisions in the Wild -- and use it to organise our literature. From this, we identify that Information-theoretic measures are prevalent for 1) and 3), and Higher-order measures are more common for 2). To further help researchers choose appropriate measures to predict drop in performance -- an important aspect of Decisions in the Wild, we perform correlation analysis spanning 130 domain adaptation scenarios, 3 varied NLP tasks and 12 divergence measures identified from our survey. To calculate these divergences, we consider the current contextual word representations (CWR) and contrast with the older distributed representations. We find that traditional measures over word distributions still serve as strong baselines, while higher-order measures with CWR are effective.
△ Less
Submitted 19 April, 2021; v1 submitted 23 October, 2020;
originally announced October 2020.
-
Multimodal Research in Vision and Language: A Review of Current and Emerging Trends
Authors:
Shagun Uppal,
Sarthak Bhagat,
Devamanyu Hazarika,
Navonil Majumdar,
Soujanya Poria,
Roger Zimmermann,
Amir Zadeh
Abstract:
Deep Learning and its applications have cascaded impactful research and development with a diverse range of modalities present in the real-world data. More recently, this has enhanced research interests in the intersection of the Vision and Language arena with its numerous applications and fast-paced growth. In this paper, we present a detailed overview of the latest trends in research pertaining…
▽ More
Deep Learning and its applications have cascaded impactful research and development with a diverse range of modalities present in the real-world data. More recently, this has enhanced research interests in the intersection of the Vision and Language arena with its numerous applications and fast-paced growth. In this paper, we present a detailed overview of the latest trends in research pertaining to visual and language modalities. We look at its applications in their task formulations and how to solve various problems related to semantic perception and content generation. We also address task-specific trends, along with their evaluation strategies and upcoming challenges. Moreover, we shed some light on multi-disciplinary patterns and insights that have emerged in the recent past, directing this field towards more modular and transparent intelligent systems. This survey identifies key trends gravitating recent literature in VisLang research and attempts to unearth directions that the field is heading towards.
△ Less
Submitted 21 December, 2020; v1 submitted 19 October, 2020;
originally announced October 2020.
-
MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis
Authors:
Devamanyu Hazarika,
Roger Zimmermann,
Soujanya Poria
Abstract:
Multimodal Sentiment Analysis is an active area of research that leverages multimodal signals for affective understanding of user-generated videos. The predominant approach, addressing this task, has been to develop sophisticated fusion techniques. However, the heterogeneous nature of the signals creates distributional modality gaps that pose significant challenges. In this paper, we aim to learn…
▽ More
Multimodal Sentiment Analysis is an active area of research that leverages multimodal signals for affective understanding of user-generated videos. The predominant approach, addressing this task, has been to develop sophisticated fusion techniques. However, the heterogeneous nature of the signals creates distributional modality gaps that pose significant challenges. In this paper, we aim to learn effective modality representations to aid the process of fusion. We propose a novel framework, MISA, which projects each modality to two distinct subspaces. The first subspace is modality-invariant, where the representations across modalities learn their commonalities and reduce the modality gap. The second subspace is modality-specific, which is private to each modality and captures their characteristic features. These representations provide a holistic view of the multimodal data, which is used for fusion that leads to task predictions. Our experiments on popular sentiment analysis benchmarks, MOSI and MOSEI, demonstrate significant gains over state-of-the-art models. We also consider the task of Multimodal Humor Detection and experiment on the recently proposed UR_FUNNY dataset. Here too, our model fares better than strong baselines, establishing MISA as a useful multimodal framework.
△ Less
Submitted 19 October, 2020; v1 submitted 7 May, 2020;
originally announced May 2020.
-
KinGDOM: Knowledge-Guided DOMain adaptation for sentiment analysis
Authors:
Deepanway Ghosal,
Devamanyu Hazarika,
Abhinaba Roy,
Navonil Majumder,
Rada Mihalcea,
Soujanya Poria
Abstract:
Cross-domain sentiment analysis has received significant attention in recent years, prompted by the need to combat the domain gap between different applications that make use of sentiment analysis. In this paper, we take a novel perspective on this task by exploring the role of external commonsense knowledge. We introduce a new framework, KinGDOM, which utilizes the ConceptNet knowledge graph to e…
▽ More
Cross-domain sentiment analysis has received significant attention in recent years, prompted by the need to combat the domain gap between different applications that make use of sentiment analysis. In this paper, we take a novel perspective on this task by exploring the role of external commonsense knowledge. We introduce a new framework, KinGDOM, which utilizes the ConceptNet knowledge graph to enrich the semantics of a document by providing both domain-specific and domain-general background concepts. These concepts are learned by training a graph convolutional autoencoder that leverages inter-domain concepts in a domain-invariant manner. Conditioning a popular domain-adversarial baseline method with these learned concepts helps improve its performance over state-of-the-art approaches, demonstrating the efficacy of our proposed framework.
△ Less
Submitted 11 May, 2020; v1 submitted 2 May, 2020;
originally announced May 2020.
-
Beneath the Tip of the Iceberg: Current Challenges and New Directions in Sentiment Analysis Research
Authors:
Soujanya Poria,
Devamanyu Hazarika,
Navonil Majumder,
Rada Mihalcea
Abstract:
Sentiment analysis as a field has come a long way since it was first introduced as a task nearly 20 years ago. It has widespread commercial applications in various domains like marketing, risk management, market research, and politics, to name a few. Given its saturation in specific subtasks -- such as sentiment polarity classification -- and datasets, there is an underlying perception that this f…
▽ More
Sentiment analysis as a field has come a long way since it was first introduced as a task nearly 20 years ago. It has widespread commercial applications in various domains like marketing, risk management, market research, and politics, to name a few. Given its saturation in specific subtasks -- such as sentiment polarity classification -- and datasets, there is an underlying perception that this field has reached its maturity. In this article, we discuss this perception by pointing out the shortcomings and under-explored, yet key aspects of this field that are necessary to attain true sentiment understanding. We analyze the significant leaps responsible for its current relevance. Further, we attempt to chart a possible course for this field that covers many overlooked and unanswered questions.
△ Less
Submitted 16 November, 2020; v1 submitted 1 May, 2020;
originally announced May 2020.
-
Binary star detection in the Open Cluster King 1 field
Authors:
Parvej Reja Saleh,
Debasish Hazarika,
Ajaz Ahmad Dar,
Padmakar Singh Parihar,
Eeshankur Saikia
Abstract:
A rarely studied open cluster, King 1 is observed using the 1.3m telescope equipped with 2k x 4k CCD at the Vainu Bappu Observatory, India. We analyse the photometric data obtained from the CCD observations in both B and V bands. Out of 132 detected stars in the open cluster King 1 field, we have identified 4 stellar variables and 2 among them are reported as newly detected binary systems, in this…
▽ More
A rarely studied open cluster, King 1 is observed using the 1.3m telescope equipped with 2k x 4k CCD at the Vainu Bappu Observatory, India. We analyse the photometric data obtained from the CCD observations in both B and V bands. Out of 132 detected stars in the open cluster King 1 field, we have identified 4 stellar variables and 2 among them are reported as newly detected binary systems, in this paper. The parallax values from GAIA DR2 suggest that the open cluster King 1 is at the background of these two detected binary systems, falling along the same line of sight, giving rise to different parallax values. The periodogram analysis was carried out using Phase Dispersion Minimization (PDM) and Lomb Scargle (LS) method for all the detected variables. PHOEBE (PHysics Of Eclipsing BinariEs) is extensively used to model various stellar parameters of both the detected binary systems. Based on the modeling results obtained from this work, one of the binary systems is reported for the first time as an Eclipsing Detached (ED) and the other as an Eclipsing Contact (EC) binary of W-type W UMa.
△ Less
Submitted 24 November, 2019;
originally announced November 2019.
-
Conversational Transfer Learning for Emotion Recognition
Authors:
Devamanyu Hazarika,
Soujanya Poria,
Roger Zimmermann,
Rada Mihalcea
Abstract:
Recognizing emotions in conversations is a challenging task due to the presence of contextual dependencies governed by self- and inter-personal influences. Recent approaches have focused on modeling these dependencies primarily via supervised learning. However, purely supervised strategies demand large amounts of annotated data, which is lacking in most of the available corpora in this task. To ta…
▽ More
Recognizing emotions in conversations is a challenging task due to the presence of contextual dependencies governed by self- and inter-personal influences. Recent approaches have focused on modeling these dependencies primarily via supervised learning. However, purely supervised strategies demand large amounts of annotated data, which is lacking in most of the available corpora in this task. To tackle this challenge, we look at transfer learning approaches as a viable alternative. Given the large amount of available conversational data, we investigate whether generative conversational models can be leveraged to transfer affective knowledge for detecting emotions in context. We propose an approach, TL-ERC, where we pre-train a hierarchical dialogue model on multi-turn conversations (source) and then transfer its parameters to a conversational emotion classifier (target). In addition to the popular practice of using pre-trained sentence encoders, our approach also incorporates recurrent parameters that model inter-sentential context across the whole conversation. Based on this idea, we perform several experiments across multiple datasets and find improvement in performance and robustness against limited training data. TL-ERC also achieves better validation performances in significantly fewer epochs. Overall, we infer that knowledge acquired from dialogue generators can indeed help recognize emotions in conversations.
△ Less
Submitted 19 May, 2020; v1 submitted 11 October, 2019;
originally announced October 2019.
-
Towards Multimodal Sarcasm Detection (An _Obviously_ Perfect Paper)
Authors:
Santiago Castro,
Devamanyu Hazarika,
Verónica Pérez-Rosas,
Roger Zimmermann,
Rada Mihalcea,
Soujanya Poria
Abstract:
Sarcasm is often expressed through several verbal and non-verbal cues, e.g., a change of tone, overemphasis in a word, a drawn-out syllable, or a straight looking face. Most of the recent work in sarcasm detection has been carried out on textual data. In this paper, we argue that incorporating multimodal cues can improve the automatic classification of sarcasm. As a first step towards enabling the…
▽ More
Sarcasm is often expressed through several verbal and non-verbal cues, e.g., a change of tone, overemphasis in a word, a drawn-out syllable, or a straight looking face. Most of the recent work in sarcasm detection has been carried out on textual data. In this paper, we argue that incorporating multimodal cues can improve the automatic classification of sarcasm. As a first step towards enabling the development of multimodal approaches for sarcasm detection, we propose a new sarcasm dataset, Multimodal Sarcasm Detection Dataset (MUStARD), compiled from popular TV shows. MUStARD consists of audiovisual utterances annotated with sarcasm labels. Each utterance is accompanied by its context of historical utterances in the dialogue, which provides additional information on the scenario where the utterance occurs. Our initial results show that the use of multimodal information can reduce the relative error rate of sarcasm detection by up to 12.9% in F-score when compared to the use of individual modalities. The full dataset is publicly available for use at https://github.com/soujanyaporia/MUStARD
△ Less
Submitted 5 June, 2019;
originally announced June 2019.
-
Aspect-Sentiment Embeddings for Company Profiling and Employee Opinion Mining
Authors:
Rajiv Bajpai,
Devamanyu Hazarika,
Kunal Singh,
Sruthi Gorantla,
Erik Cambria,
Roger Zimmerman
Abstract:
With the multitude of companies and organizations abound today, ranking them and choosing one out of the many is a difficult and cumbersome task. Although there are many available metrics that rank companies, there is an inherent need for a generalized metric that takes into account the different aspects that constitute employee opinions of the companies. In this work, we aim to overcome the afore…
▽ More
With the multitude of companies and organizations abound today, ranking them and choosing one out of the many is a difficult and cumbersome task. Although there are many available metrics that rank companies, there is an inherent need for a generalized metric that takes into account the different aspects that constitute employee opinions of the companies. In this work, we aim to overcome the aforementioned problem by generating aspect-sentiment based embedding for the companies by looking into reliable employee reviews of them. We created a comprehensive dataset of company reviews from the famous website Glassdoor.com and employed a novel ensemble approach to perform aspect-level sentiment analysis. Although a relevant amount of work has been done on reviews centered on subjects like movies, music, etc., this work is the first of its kind. We also provide several insights from the collated embeddings, thus hel** users gain a better understanding of their options as well as select companies using customized preferences.
△ Less
Submitted 21 February, 2019;
originally announced February 2019.
-
DialogueRNN: An Attentive RNN for Emotion Detection in Conversations
Authors:
Navonil Majumder,
Soujanya Poria,
Devamanyu Hazarika,
Rada Mihalcea,
Alexander Gelbukh,
Erik Cambria
Abstract:
Emotion detection in conversations is a necessary step for a number of applications, including opinion mining over chat history, social media threads, debates, argumentation mining, understanding consumer feedback in live conversations, etc. Currently, systems do not treat the parties in the conversation individually by adapting to the speaker of each utterance. In this paper, we describe a new me…
▽ More
Emotion detection in conversations is a necessary step for a number of applications, including opinion mining over chat history, social media threads, debates, argumentation mining, understanding consumer feedback in live conversations, etc. Currently, systems do not treat the parties in the conversation individually by adapting to the speaker of each utterance. In this paper, we describe a new method based on recurrent neural networks that keeps track of the individual party states throughout the conversation and uses this information for emotion classification. Our model outperforms the state of the art by a significant margin on two different datasets.
△ Less
Submitted 25 May, 2019; v1 submitted 1 November, 2018;
originally announced November 2018.
-
MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversations
Authors:
Soujanya Poria,
Devamanyu Hazarika,
Navonil Majumder,
Gautam Naik,
Erik Cambria,
Rada Mihalcea
Abstract:
Emotion recognition in conversations is a challenging task that has recently gained popularity due to its potential applications. Until now, however, a large-scale multimodal multi-party emotional conversational database containing more than two speakers per dialogue was missing. Thus, we propose the Multimodal EmotionLines Dataset (MELD), an extension and enhancement of EmotionLines. MELD contain…
▽ More
Emotion recognition in conversations is a challenging task that has recently gained popularity due to its potential applications. Until now, however, a large-scale multimodal multi-party emotional conversational database containing more than two speakers per dialogue was missing. Thus, we propose the Multimodal EmotionLines Dataset (MELD), an extension and enhancement of EmotionLines. MELD contains about 13,000 utterances from 1,433 dialogues from the TV-series Friends. Each utterance is annotated with emotion and sentiment labels, and encompasses audio, visual and textual modalities. We propose several strong multimodal baselines and show the importance of contextual and multimodal information for emotion recognition in conversations. The full dataset is available for use at http:// affective-meld.github.io.
△ Less
Submitted 4 June, 2019; v1 submitted 4 October, 2018;
originally announced October 2018.
-
Multimodal Sentiment Analysis using Hierarchical Fusion with Context Modeling
Authors:
N. Majumder,
D. Hazarika,
A. Gelbukh,
E. Cambria,
S. Poria
Abstract:
Multimodal sentiment analysis is a very actively growing field of research. A promising area of opportunity in this field is to improve the multimodal fusion mechanism. We present a novel feature fusion strategy that proceeds in a hierarchical fashion, first fusing the modalities two in two and only then fusing all three modalities. On multimodal sentiment analysis of individual utterances, our st…
▽ More
Multimodal sentiment analysis is a very actively growing field of research. A promising area of opportunity in this field is to improve the multimodal fusion mechanism. We present a novel feature fusion strategy that proceeds in a hierarchical fashion, first fusing the modalities two in two and only then fusing all three modalities. On multimodal sentiment analysis of individual utterances, our strategy outperforms conventional concatenation of features by 1%, which amounts to 5% reduction in error rate. On utterance-level multimodal sentiment analysis of multi-utterance video clips, for which current state-of-the-art techniques incorporate contextual information from other utterances of the same clip, our hierarchical fusion gives up to 2.4% (almost 10% error rate reduction) over currently used concatenation. The implementation of our method is publicly available in the form of open-source code.
△ Less
Submitted 16 June, 2018;
originally announced June 2018.
-
CASCADE: Contextual Sarcasm Detection in Online Discussion Forums
Authors:
Devamanyu Hazarika,
Soujanya Poria,
Sruthi Gorantla,
Erik Cambria,
Roger Zimmermann,
Rada Mihalcea
Abstract:
The literature in automated sarcasm detection has mainly focused on lexical, syntactic and semantic-level analysis of text. However, a sarcastic sentence can be expressed with contextual presumptions, background and commonsense knowledge. In this paper, we propose CASCADE (a ContextuAl SarCasm DEtector) that adopts a hybrid approach of both content and context-driven modeling for sarcasm detection…
▽ More
The literature in automated sarcasm detection has mainly focused on lexical, syntactic and semantic-level analysis of text. However, a sarcastic sentence can be expressed with contextual presumptions, background and commonsense knowledge. In this paper, we propose CASCADE (a ContextuAl SarCasm DEtector) that adopts a hybrid approach of both content and context-driven modeling for sarcasm detection in online social media discussions. For the latter, CASCADE aims at extracting contextual information from the discourse of a discussion thread. Also, since the sarcastic nature and form of expression can vary from person to person, CASCADE utilizes user embeddings that encode stylometric and personality features of the users. When used along with content-based feature extractors such as Convolutional Neural Networks (CNNs), we see a significant boost in the classification performance on a large Reddit corpus.
△ Less
Submitted 16 May, 2018;
originally announced May 2018.
-
Multimodal Sentiment Analysis: Addressing Key Issues and Setting up the Baselines
Authors:
Soujanya Poria,
Navonil Majumder,
Devamanyu Hazarika,
Erik Cambria,
Alexander Gelbukh,
Amir Hussain
Abstract:
We compile baselines, along with dataset split, for multimodal sentiment analysis. In this paper, we explore three different deep-learning based architectures for multimodal sentiment classification, each improving upon the previous. Further, we evaluate these architectures with multiple datasets with fixed train/test partition. We also discuss some major issues, frequently ignored in multimodal s…
▽ More
We compile baselines, along with dataset split, for multimodal sentiment analysis. In this paper, we explore three different deep-learning based architectures for multimodal sentiment classification, each improving upon the previous. Further, we evaluate these architectures with multiple datasets with fixed train/test partition. We also discuss some major issues, frequently ignored in multimodal sentiment analysis research, e.g., role of speaker-exclusive models, importance of different modalities, and generalizability. This framework illustrates the different facets of analysis to be considered while performing multimodal sentiment analysis and, hence, serves as a new benchmark for future research in this emerging field.
△ Less
Submitted 11 February, 2019; v1 submitted 18 March, 2018;
originally announced March 2018.
-
Texture and Structure Incorporated ScatterNet Hybrid Deep Learning Network (TS-SHDL) For Brain Matter Segmentation
Authors:
Amarjot Singh,
Devamanyu Hazarika,
Aniruddha Bhattacharya
Abstract:
Automation of brain matter segmentation from MR images is a challenging task due to the irregular boundaries between the grey and white matter regions. In addition, the presence of intensity inhomogeneity in the MR images further complicates the problem. In this paper, we propose a texture and vesselness incorporated version of the ScatterNet Hybrid Deep Learning Network (TS-SHDL) that extracts hi…
▽ More
Automation of brain matter segmentation from MR images is a challenging task due to the irregular boundaries between the grey and white matter regions. In addition, the presence of intensity inhomogeneity in the MR images further complicates the problem. In this paper, we propose a texture and vesselness incorporated version of the ScatterNet Hybrid Deep Learning Network (TS-SHDL) that extracts hierarchical invariant mid-level features, used by fisher vector encoding and a conditional random field (CRF) to perform the desired segmentation. The performance of the proposed network is evaluated by extensive experimentation and comparison with the state-of-the-art methods on several 2D MRI scans taken from the synthetic McGill Brain Web as well as on the MRBrainS dataset of real 3D MRI scans. The advantages of the TS-SHDL network over supervised deep learning networks is also presented in addition to its superior performance over the state-of-the-art.
△ Less
Submitted 30 August, 2017;
originally announced August 2017.
-
Recent Trends in Deep Learning Based Natural Language Processing
Authors:
Tom Young,
Devamanyu Hazarika,
Soujanya Poria,
Erik Cambria
Abstract:
Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art results in many domains. Recently, a variety of model designs and methods have blossomed in the context of natural language processing (NLP). In this paper, we review significant deep learning related models and methods that have been employed for numerous NLP ta…
▽ More
Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art results in many domains. Recently, a variety of model designs and methods have blossomed in the context of natural language processing (NLP). In this paper, we review significant deep learning related models and methods that have been employed for numerous NLP tasks and provide a walk-through of their evolution. We also summarize, compare and contrast the various models and put forward a detailed understanding of the past, present and future of deep learning in NLP.
△ Less
Submitted 24 November, 2018; v1 submitted 9 August, 2017;
originally announced August 2017.
-
Benchmarking Multimodal Sentiment Analysis
Authors:
Erik Cambria,
Devamanyu Hazarika,
Soujanya Poria,
Amir Hussain,
R. B. V. Subramaanyam
Abstract:
We propose a framework for multimodal sentiment analysis and emotion recognition using convolutional neural network-based feature extraction from text and visual modalities. We obtain a performance improvement of 10% over the state of the art by combining visual, text and audio features. We also discuss some major issues frequently ignored in multimodal sentiment analysis research: the role of spe…
▽ More
We propose a framework for multimodal sentiment analysis and emotion recognition using convolutional neural network-based feature extraction from text and visual modalities. We obtain a performance improvement of 10% over the state of the art by combining visual, text and audio features. We also discuss some major issues frequently ignored in multimodal sentiment analysis research: the role of speaker-independent models, importance of the modalities and generalizability. The paper thus serve as a new benchmark for further research in multimodal sentiment analysis and also demonstrates the different facets of analysis to be considered while performing such tasks.
△ Less
Submitted 29 July, 2017;
originally announced July 2017.
-
A Deeper Look into Sarcastic Tweets Using Deep Convolutional Neural Networks
Authors:
Soujanya Poria,
Erik Cambria,
Devamanyu Hazarika,
Prateek Vij
Abstract:
Sarcasm detection is a key task for many natural language processing tasks. In sentiment analysis, for example, sarcasm can flip the polarity of an "apparently positive" sentence and, hence, negatively affect polarity detection performance. To date, most approaches to sarcasm detection have treated the task primarily as a text categorization problem. Sarcasm, however, can be expressed in very subt…
▽ More
Sarcasm detection is a key task for many natural language processing tasks. In sentiment analysis, for example, sarcasm can flip the polarity of an "apparently positive" sentence and, hence, negatively affect polarity detection performance. To date, most approaches to sarcasm detection have treated the task primarily as a text categorization problem. Sarcasm, however, can be expressed in very subtle ways and requires a deeper understanding of natural language that standard text categorization techniques cannot grasp. In this work, we develop models based on a pre-trained convolutional neural network for extracting sentiment, emotion and personality features for sarcasm detection. Such features, along with the network's baseline features, allow the proposed models to outperform the state of the art on benchmark datasets. We also address the often ignored generalizability issue of classifying data that have not been seen by the models at learning phase.
△ Less
Submitted 26 July, 2017; v1 submitted 27 October, 2016;
originally announced October 2016.
