ALBA: Adaptive Language-based Assessments for Mental Health
Authors:
Vasudha Varadarajan,
Sverker Sikström,
Oscar N. E. Kjell,
H. Andrew Schwartz
Abstract:
Mental health issues differ widely among individuals, with varied signs and symptoms. Recently, language-based assessments have shown promise in capturing this diversity, but they require a substantial sample of words per person for accuracy. This work introduces the task of Adaptive Language-Based Assessment ALBA, which involves adaptively ordering questions while also scoring an individual's lat…
▽ More
Mental health issues differ widely among individuals, with varied signs and symptoms. Recently, language-based assessments have shown promise in capturing this diversity, but they require a substantial sample of words per person for accuracy. This work introduces the task of Adaptive Language-Based Assessment ALBA, which involves adaptively ordering questions while also scoring an individual's latent psychological trait using limited language responses to previous questions. To this end, we develop adaptive testing methods under two psychometric measurement theories: Classical Test Theory and Item Response Theory. We empirically evaluate ordering and scoring strategies, organizing into two new methods: a semi-supervised item response theory-based method ALIRT and a supervised Actor-Critic model. While we found both methods to improve over non-adaptive baselines, We found ALIRT to be the most accurate and scalable, achieving the highest accuracy with fewer questions (e.g., Pearson r ~ 0.93 after only 3 questions as compared to typically needing at least 7 questions). In general, adaptive language-based assessments of depression and anxiety were able to utilize a smaller sample of language without compromising validity or large computational costs.
△ Less
Submitted 16 May, 2024; v1 submitted 10 November, 2023;
originally announced November 2023.
On the importance of AI research beyond disciplines
Authors:
Virginia Dignum,
Donal Casey,
Teresa Cerratto-Pargman,
Frank Dignum,
Valentina Fantasia,
Bodil Formark,
Björn Hammarfelt,
Gunnar Holmberg,
André Holzapfel,
Stefan Larsson,
Amanda Lagerkvist,
Nicolette Lakemond,
Helena Lindgren,
Fabian Lorig,
Ana Marusic,
Lina Rahm,
Yulia Razmetaeva,
Sverker Sikström,
Kıvanç Tatar,
Jason Tucker
Abstract:
As the impact of AI on various scientific fields is increasing, it is crucial to embrace interdisciplinary knowledge to understand the impact of technology on society. The goal is to foster a research environment beyond disciplines that values diversity and creates, critiques and develops new conceptual and theoretical frameworks. Even though research beyond disciplines is essential for understand…
▽ More
As the impact of AI on various scientific fields is increasing, it is crucial to embrace interdisciplinary knowledge to understand the impact of technology on society. The goal is to foster a research environment beyond disciplines that values diversity and creates, critiques and develops new conceptual and theoretical frameworks. Even though research beyond disciplines is essential for understanding complex societal issues and creating positive impact it is notoriously difficult to evaluate and is often not recognized by current academic career progression. The motivation for this paper is to engage in broad discussion across disciplines and identify guiding principles fir AI research beyond disciplines in a structured and inclusive way, revealing new perspectives and contributing to societal and human wellbeing and sustainability.
△ Less
Submitted 13 February, 2023;
originally announced February 2023.
