-
What Makes Digital Support Effective? How Therapeutic Skills Affect Clinical Well-Being
Authors:
Anna Fang,
Wenjie Yang,
Raj Sanjay Shah,
Yash Mathur,
Diyi Yang,
Haiyi Zhu,
Robert Kraut
Abstract:
Online mental health support communities have grown in recent years for providing accessible mental and emotional health support through volunteer counselors. Despite millions of people participating in chat support on these platforms, the clinical effectiveness of these communities on mental health symptoms remains unknown. Furthermore, although volunteers receive some training based on establish…
▽ More
Online mental health support communities have grown in recent years for providing accessible mental and emotional health support through volunteer counselors. Despite millions of people participating in chat support on these platforms, the clinical effectiveness of these communities on mental health symptoms remains unknown. Furthermore, although volunteers receive some training based on established therapeutic skills studied in face-to-face environments such as active listening and motivational interviewing, it remains understudied how the usage of these skills in this online context affects people's mental health status. In our work, we collaborate with one of the largest online peer support platforms and use both natural language processing and machine learning techniques to measure how one-on-one support chats affect depression and anxiety symptoms. We measure how the techniques and characteristics of support providers, such as using affirmation, empathy, and past experience on the platform, affect support-seekers' mental health changes. We find that online peer support chats improve both depression and anxiety symptoms with a statistically significant but relatively small effect size. Additionally, support providers' techniques such as emphasizing the autonomy of the client lead to better mental health outcomes. However, we also found that some behaviors (e.g. persuading) are actually harmful to depression and anxiety outcomes. Our work provides key understanding for mental health care in the online setting and designing training systems for online support providers.
△ Less
Submitted 17 December, 2023;
originally announced December 2023.
-
Program-Aided Reasoners (better) Know What They Know
Authors:
Anubha Kabra,
Sanketh Rangreji,
Yash Mathur,
Aman Madaan,
Emmy Liu,
Graham Neubig
Abstract:
Prior work shows that program-aided reasoning, in which large language models (LLMs) are combined with programs written in programming languages such as Python, can significantly improve accuracy on various reasoning tasks. However, while accuracy is essential, it is also important for such reasoners to "know what they know", which can be quantified through the calibration of the model. In this pa…
▽ More
Prior work shows that program-aided reasoning, in which large language models (LLMs) are combined with programs written in programming languages such as Python, can significantly improve accuracy on various reasoning tasks. However, while accuracy is essential, it is also important for such reasoners to "know what they know", which can be quantified through the calibration of the model. In this paper, we compare the calibration of Program Aided Language Models (PAL) and text-based Chain-of-thought (COT) prompting techniques over 5 datasets and 2 model types: LLaMA models and OpenAI models. Our results indicate that PAL leads to improved calibration in 75% of the instances. Our analysis uncovers that prompting styles that produce lesser diversity in generations also have more calibrated results, and thus we also experiment with inducing lower generation diversity using temperature scaling and find that for certain temperatures, PAL is not only more accurate but is also more calibrated than COT. Overall, we demonstrate that, in the majority of cases, program-aided reasoners better know what they know than text-based counterparts.
△ Less
Submitted 15 November, 2023;
originally announced November 2023.
-
SummQA at MEDIQA-Chat 2023:In-Context Learning with GPT-4 for Medical Summarization
Authors:
Yash Mathur,
Sanketh Rangreji,
Raghav Kapoor,
Medha Palavalli,
Amanda Bertsch,
Matthew R. Gormley
Abstract:
Medical dialogue summarization is challenging due to the unstructured nature of medical conversations, the use of medical terminology in gold summaries, and the need to identify key information across multiple symptom sets. We present a novel system for the Dialogue2Note Medical Summarization tasks in the MEDIQA 2023 Shared Task. Our approach for section-wise summarization (Task A) is a two-stage…
▽ More
Medical dialogue summarization is challenging due to the unstructured nature of medical conversations, the use of medical terminology in gold summaries, and the need to identify key information across multiple symptom sets. We present a novel system for the Dialogue2Note Medical Summarization tasks in the MEDIQA 2023 Shared Task. Our approach for section-wise summarization (Task A) is a two-stage process of selecting semantically similar dialogues and using the top-k similar dialogues as in-context examples for GPT-4. For full-note summarization (Task B), we use a similar solution with k=1. We achieved 3rd place in Task A (2nd among all teams), 4th place in Task B Division Wise Summarization (2nd among all teams), 15th place in Task A Section Header Classification (9th among all teams), and 8th place among all teams in Task B. Our results highlight the effectiveness of few-shot prompting for this task, though we also identify several weaknesses of prompting-based approaches. We compare GPT-4 performance with several finetuned baselines. We find that GPT-4 summaries are more abstractive and shorter. We make our code publicly available.
△ Less
Submitted 29 June, 2023;
originally announced June 2023.
-
Digital Image Forensics using Deep Learning
Authors:
Akash Nagaraj,
Mukund Sood,
Vivek Kapoor,
Yash Mathur,
Bishesh Sinha
Abstract:
During the investigation of criminal activity when evidence is available, the issue at hand is determining the credibility of the video and ascertaining that the video is real. Today, one way to authenticate the footage is to identify the camera that was used to capture the image or video in question. While a very common way to do this is by using image meta-data, this data can easily be falsified…
▽ More
During the investigation of criminal activity when evidence is available, the issue at hand is determining the credibility of the video and ascertaining that the video is real. Today, one way to authenticate the footage is to identify the camera that was used to capture the image or video in question. While a very common way to do this is by using image meta-data, this data can easily be falsified by changing the video content or even splicing together content from two different cameras. Given the multitude of solutions proposed to this problem, it is yet to be sufficiently solved. The aim of our project is to build an algorithm that identifies which camera was used to capture an image using traces of information left intrinsically in the image, using filters, followed by a deep neural network on these filters. Solving this problem would have a big impact on the verification of evidence used in criminal and civil trials and even news reporting.
△ Less
Submitted 13 October, 2022;
originally announced October 2022.
-
Learning Algorithms in Static Analysis of Web Applications
Authors:
Akash Nagaraj,
Bishesh Sinha,
Mukund Sood,
Yash Mathur,
Sanchika Gupta,
Dinkar Sitaram
Abstract:
Web applications are distributed applications, they are programs that run on more than one computer and communicate through a network or server. This very distributed nature of web applications, combined with the scale and sheer complexity of modern software systems complicate manual security auditing, while also creating a huge attack surface of potential hackers. These factors are making automat…
▽ More
Web applications are distributed applications, they are programs that run on more than one computer and communicate through a network or server. This very distributed nature of web applications, combined with the scale and sheer complexity of modern software systems complicate manual security auditing, while also creating a huge attack surface of potential hackers. These factors are making automated analysis a necessity. Static Application Security Testing (SAST) is a method devised to automatically analyze application source code of large code bases without compiling it, and design conditions that are indicative of security vulnerabilities. However, the problem lies in the fact that the most widely used Static Application Security Testing Tools often yield unreliable results, owing to the false positive classification of vulnerabilities grossly outnumbering the classification of true positive vulnerabilities. This is one of the biggest hindrances to the proliferation of SAST testing, which leaves the user to review hundreds, if not thousands, of potential warnings, and classify them as either actionable or spurious. We try to minimize the problem of false positives by introducing a technique to filter the output of SAST tools. The aim of the project is to apply learning algorithms to the output by analyzing the true and false positives classified by OWASP Benchmark, and eliminate, or reduce the number of false positives presented to the user of the SAST Tool.
△ Less
Submitted 13 October, 2022;
originally announced October 2022.
-
COVID-19 Outbreak Prediction and Analysis using Self Reported Symptoms
Authors:
Rohan Sukumaran,
Parth Patwa,
T V Sethuraman,
Sheshank Shankar,
Rishank Kanaparti,
Joseph Bae,
Yash Mathur,
Abhishek Singh,
Ayush Chopra,
Myungsun Kang,
Priya Ramaswamy,
Ramesh Raskar
Abstract:
It is crucial for policymakers to understand the community prevalence of COVID-19 so combative resources can be effectively allocated and prioritized during the COVID-19 pandemic. Traditionally, community prevalence has been assessed through diagnostic and antibody testing data. However, despite the increasing availability of COVID-19 testing, the required level has not been met in most parts of t…
▽ More
It is crucial for policymakers to understand the community prevalence of COVID-19 so combative resources can be effectively allocated and prioritized during the COVID-19 pandemic. Traditionally, community prevalence has been assessed through diagnostic and antibody testing data. However, despite the increasing availability of COVID-19 testing, the required level has not been met in most parts of the globe, introducing a need for an alternative method for communities to determine disease prevalence. This is further complicated by the observation that COVID-19 prevalence and spread varies across different spatial, temporal, and demographics. In this study, we understand trends in the spread of COVID-19 by utilizing the results of self-reported COVID-19 symptoms surveys as an alternative to COVID-19 testing reports. This allows us to assess community disease prevalence, even in areas with low COVID-19 testing ability. Using individually reported symptom data from various populations, our method predicts the likely percentage of the population that tested positive for COVID-19. We do so with a Mean Absolute Error (MAE) of 1.14 and Mean Relative Error (MRE) of 60.40\% with 95\% confidence interval as (60.12, 60.67). This implies that our model predicts +/- 1140 cases than the original in a population of 1 million. In addition, we forecast the location-wise percentage of the population testing positive for the next 30 days using self-reported symptoms data from previous days. The MAE for this method is as low as 0.15 (MRE of 23.61\% with 95\% confidence interval as (23.6, 13.7)) for New York. We present an analysis of these results, exposing various clinical attributes of interest across different demographics. Lastly, we qualitatively analyze how various policy enactments (testing, curfew) affect the prevalence of COVID-19 in a community.
△ Less
Submitted 19 June, 2021; v1 submitted 20 December, 2020;
originally announced January 2021.
-
A Comparative Study of Two Models of QGP-Fireball Formation
Authors:
R. Ramanathan,
Y. K. Mathur,
K. K. Gupta,
Agam K. Jha,
S. S. Singh
Abstract:
A Comparative study of the strengths and weakness of the models of fireball formation namely the statistical model of Ramanathan et.al (Physical Review C 70, 027903, 2004) and the approximation schemes of Kapusta et. al (Physical Review D 46, 1379, 1992) and its subsequent improved variants is made. The way to complement the various approximation schemes, in order to enhance their utility in the…
▽ More
A Comparative study of the strengths and weakness of the models of fireball formation namely the statistical model of Ramanathan et.al (Physical Review C 70, 027903, 2004) and the approximation schemes of Kapusta et. al (Physical Review D 46, 1379, 1992) and its subsequent improved variants is made. The way to complement the various approximation schemes, in order to enhance their utility in the phenomenological analysis of QGP data that are expected from ongoing URHIC experiments, is suggested. The calculations demonstrate a striking QCD behaviour of the surface tension of the QGP droplet resulting in its increase with temperature, which is due to the confining nature of QCD forces at the surface and the interface surface tension varies as the cube of the transition temperature which is in conformity with the results of Lattice QCD simulations.
△ Less
Submitted 5 March, 2005; v1 submitted 4 February, 2005;
originally announced February 2005.
-
A Simple Statistical Model for Analysis of QGP-droplet (Fireball) Formation
Authors:
R. Ramanathan,
Y. K. Mathur,
K. K. Gupta,
Agam K. Jha
Abstract:
We construct the density of states for quarks and gluons using the `Thomas - Fermi model' for atoms and the `Bethe model' for nucleons as templates. With parameters to take care of the plasma (hydrodynamical) features of the QGP with a thermal potential for the interaction, we find a window in the parametric space of the model where observable QGP droplets of $ \sim $ 5 fm radius can occur with…
▽ More
We construct the density of states for quarks and gluons using the `Thomas - Fermi model' for atoms and the `Bethe model' for nucleons as templates. With parameters to take care of the plasma (hydrodynamical) features of the QGP with a thermal potential for the interaction, we find a window in the parametric space of the model where observable QGP droplets of $ \sim $ 5 fm radius can occur with transition temperature in the range 140 MeV to 250 MeV. By matching with the expectations of Lattice Gauge estimates of the QGP-hadron transitions, we can further narrow the window, thereby restricting the allowed values of the flow-parameters of the model.
△ Less
Submitted 8 June, 2004;
originally announced June 2004.
-
A Simple Statistical Model for QGP Phenomenology
Authors:
R. Ramanathan,
Y. K. Mathur,
K. K. Gupta,
Agam K. Jha
Abstract:
We propose a simple statistical model for the density of states for quarks and gluons in a QGP droplet, making the Thomas-Fermi model of the atom and the Bethe-model for the nucleons as templates for constructing the density of states for the quarks and gluons with due modifications for the `hot' relativistic QGP state as against the `cold' non-relativistic atom and nucleons, which were the subj…
▽ More
We propose a simple statistical model for the density of states for quarks and gluons in a QGP droplet, making the Thomas-Fermi model of the atom and the Bethe-model for the nucleons as templates for constructing the density of states for the quarks and gluons with due modifications for the `hot' relativistic QGP state as against the `cold' non-relativistic atom and nucleons, which were the subject of the earlier `forebears' of the present proposal.We introduce `flow-parameters' $γ_{q,g}$ for the quarks and the gluons to take care of the hydrodynamical (plasma) flows in the QGP system as was done earlier by Peshier in his thermal potential for the QGP. By varying $γ_{g}$ about the `Peshier-Value' of $γ_{q} = 1/6$, we find that the model allows a window in the parametric space in the range $8γ_{q} \leq γ_{g} \leq 12γ_{q}$, with $γ_{q} =1/6$ (Peshier-Value), when stable QGP droplets of radii $\sim$ $6 fm$ appear at transition temperatures $100 MeV \leq T \leq 250 MeV$. The smooth cut at the phase boundary of the Free energy vs. droplet radius suggests a First - Order phase transition .On the whole the model offers a robust tool for studying QGP phenomenology as and when data from various ongoing experiments are available .
△ Less
Submitted 26 February, 2004;
originally announced February 2004.
