-
FAIIR: Building Toward A Conversational AI Agent Assistant for Youth Mental Health Service Provision
Authors:
Stephen Obadinma,
Alia Lachana,
Maia Norman,
Jocelyn Rankin,
Joanna Yu,
Xiaodan Zhu,
Darren Mastropaolo,
Deval Pandya,
Roxana Sultan,
Elham Dolatabadi
Abstract:
The world's healthcare systems and mental health agencies face both a growing demand for youth mental health services, alongside a simultaneous challenge of limited resources. Here, we focus on frontline crisis support, where Crisis Responders (CRs) engage in conversations for youth mental health support and assign an issue tag to each conversation. In this study, we develop FAIIR (Frontline Assis…
▽ More
The world's healthcare systems and mental health agencies face both a growing demand for youth mental health services, alongside a simultaneous challenge of limited resources. Here, we focus on frontline crisis support, where Crisis Responders (CRs) engage in conversations for youth mental health support and assign an issue tag to each conversation. In this study, we develop FAIIR (Frontline Assistant: Issue Identification and Recommendation), an advanced tool leveraging an ensemble of domain-adapted and fine-tuned transformer models trained on a large conversational dataset comprising 780,000 conversations. The primary aim is to reduce the cognitive burden on CRs, enhance the accuracy of issue identification, and streamline post-conversation administrative tasks. We evaluate FAIIR on both retrospective and prospective conversations, emphasizing human-in-the-loop design with active CR engagement for model refinement, consensus-building, and overall assessment. Our results indicate that FAIIR achieves an average AUCROC of 94%, a sample average F1-score of 64%, and a sample average recall score of 81% on the retrospective test set. We also demonstrate the robustness and generalizability of the FAIIR tool during the silent testing phase, with less than a 2% drop in all performance metrics. Notably, CRs' responses exhibited an overall agreement of 90.9% with FAIIR's predictions. Furthermore, expert agreement with FAIIR surpassed their agreement with the original labels. To conclude, our findings indicate that assisting with the identification of issues of relevance helps reduce the burden on CRs, ensuring that appropriate resources can be provided and that active rescues and mandatory reporting can take place in critical situations requiring immediate de-escalation.
△ Less
Submitted 25 June, 2024; v1 submitted 28 May, 2024;
originally announced May 2024.
-
Unified Pandemic Tracking System Based on Open Geospatial Consortium SensorThings API
Authors:
Robinson Paniagua,
Rdawa Sultan,
Ahmed Refaey
Abstract:
With the current nations struggling to track the pandemic's trajectories. There has been a lack of transparency or real-live data streaming for pandemic cases and symptoms. This phenomenon has led to a rapid and uncontrolled spread of these deadly pandemics. One of the main issues in creating a global pandemic tracking system is the lack of standardization of communications protocols and the deplo…
▽ More
With the current nations struggling to track the pandemic's trajectories. There has been a lack of transparency or real-live data streaming for pandemic cases and symptoms. This phenomenon has led to a rapid and uncontrolled spread of these deadly pandemics. One of the main issues in creating a global pandemic tracking system is the lack of standardization of communications protocols and the deployment of Internet-of-Things (IoT) device sensors. The Open Geospatial Consortium (OGC) has developed several sensor web Enablement standards that allow the expeditious deployment of communications protocols within IoT devices and other sensor devices like the OGC SensorThings application programming interface (API). In this paper, to address this issue, we outline the interoperability challenge and provide a qualitative and quantitative study of the OGC SensorThings API's deployment and its respective server. The OGC SensorThings API is developed to provide data exchange services between sensors and their observations. The OGC SensorThings API would play a primary and essential role in creating an automated pandemic tracking system. This API would reduce the deployment of any set of sensors and provide real-time data tracking. Accordingly, global health organizations would react expeditiously and concentrate their efforts on high infection rates.
△ Less
Submitted 18 December, 2023;
originally announced January 2024.
-
FedDRO: Federated Compositional Optimization for Distributionally Robust Learning
Authors:
Prashant Khanduri,
Chengyin Li,
Rafi Ibn Sultan,
Yao Qiang,
Joerg Kliewer,
Dongxiao Zhu
Abstract:
Recently, compositional optimization (CO) has gained popularity because of its applications in distributionally robust optimization (DRO) and many other machine learning problems. Large-scale and distributed availability of data demands the development of efficient federated learning (FL) algorithms for solving CO problems. Develo** FL algorithms for CO is particularly challenging because of the…
▽ More
Recently, compositional optimization (CO) has gained popularity because of its applications in distributionally robust optimization (DRO) and many other machine learning problems. Large-scale and distributed availability of data demands the development of efficient federated learning (FL) algorithms for solving CO problems. Develo** FL algorithms for CO is particularly challenging because of the compositional nature of the objective. Moreover, current state-of-the-art methods to solve such problems rely on large batch gradients (depending on the solution accuracy) not feasible for most practical settings. To address these challenges, in this work, we propose efficient FedAvg-type algorithms for solving non-convex CO in the FL setting. We first establish that vanilla FedAvg is not suitable to solve distributed CO problems because of the data heterogeneity in the compositional objective at each client which leads to the amplification of bias in the local compositional gradient estimates. To this end, we propose a novel FL framework FedDRO that utilizes the DRO problem structure to design a communication strategy that allows FedAvg to control the bias in the estimation of the compositional gradient. A key novelty of our work is to develop solution accuracy-independent algorithms that do not require large batch gradients (and function evaluations) for solving federated CO problems. We establish $\mathcal{O}(ε^{-2})$ sample and $\mathcal{O}(ε^{-3/2})$ communication complexity in the FL setting while achieving linear speedup with the number of clients. We corroborate our theoretical findings with empirical studies on large-scale DRO problems.
△ Less
Submitted 21 November, 2023;
originally announced November 2023.
-
GeoSAM: Fine-tuning SAM with Sparse and Dense Visual Prompting for Automated Segmentation of Mobility Infrastructure
Authors:
Rafi Ibn Sultan,
Chengyin Li,
Hui Zhu,
Prashant Khanduri,
Marco Brocanelli,
Dongxiao Zhu
Abstract:
The Segment Anything Model (SAM) has shown impressive performance when applied to natural image segmentation. However, it struggles with geographical images like aerial and satellite imagery, especially when segmenting mobility infrastructure including roads, sidewalks, and crosswalks. This inferior performance stems from the narrow features of these objects, their textures blending into the surro…
▽ More
The Segment Anything Model (SAM) has shown impressive performance when applied to natural image segmentation. However, it struggles with geographical images like aerial and satellite imagery, especially when segmenting mobility infrastructure including roads, sidewalks, and crosswalks. This inferior performance stems from the narrow features of these objects, their textures blending into the surroundings, and interference from objects like trees, buildings, vehicles, and pedestrians - all of which can disorient the model to produce inaccurate segmentation maps. To address these challenges, we propose Geographical SAM (GeoSAM), a novel SAM-based framework that implements a fine-tuning strategy using the dense visual prompt from zero-shot learning, and the sparse visual prompt from a pre-trained CNN segmentation model. The proposed GeoSAM outperforms existing approaches for geographical image segmentation, specifically by 26%, 7%, and 17% for road infrastructure, pedestrian infrastructure, and on average, respectively, representing a momentous leap in leveraging foundation models to segment mobility infrastructure including both road and pedestrian infrastructure in geographical images. The source code can be found on this GitHub repository: https://github.com/rafiibnsultan/GeoSAM/tree/main.
△ Less
Submitted 30 January, 2024; v1 submitted 19 November, 2023;
originally announced November 2023.
-
AutoProSAM: Automated Prompting SAM for 3D Multi-Organ Segmentation
Authors:
Chengyin Li,
Prashant Khanduri,
Yao Qiang,
Rafi Ibn Sultan,
Indrin Chetty,
Dongxiao Zhu
Abstract:
Segment Anything Model (SAM) is one of the pioneering prompt-based foundation models for image segmentation and has been rapidly adopted for various medical imaging applications. However, in clinical settings, creating effective prompts is notably challenging and time-consuming, requiring the expertise of domain specialists such as physicians. This requirement significantly diminishes SAM's primar…
▽ More
Segment Anything Model (SAM) is one of the pioneering prompt-based foundation models for image segmentation and has been rapidly adopted for various medical imaging applications. However, in clinical settings, creating effective prompts is notably challenging and time-consuming, requiring the expertise of domain specialists such as physicians. This requirement significantly diminishes SAM's primary advantage - its interactive capability with end users - in medical applications. Moreover, recent studies have indicated that SAM, originally designed for 2D natural images, performs sub optimally on 3D medical image segmentation tasks. This subpar performance is attributed to the domain gaps between natural and medical images and the disparities in spatial arrangements between 2D and 3D images, particularly in multi-organ segmentation applications. To overcome these challenges, we present a novel technique termed AutoProSAM. This method automates 3D multi-organ CT-based segmentation by leveraging SAM's foundational model capabilities without relying on domain experts for prompts. The approach utilizes parameter-efficient adaptation techniques to adapt SAM for 3D medical imagery and incorporates an effective automatic prompt learning paradigm specific to this domain. By eliminating the need for manual prompts, it enhances SAM's capabilities for 3D medical image segmentation and achieves state-of-the-art (SOTA) performance in CT-based multi-organ segmentation tasks.
△ Less
Submitted 26 June, 2024; v1 submitted 28 August, 2023;
originally announced August 2023.
-
FocalUNETR: A Focal Transformer for Boundary-aware Segmentation of CT Images
Authors:
Chengyin Li,
Yao Qiang,
Rafi Ibn Sultan,
Hassan Bagher-Ebadian,
Prashant Khanduri,
Indrin J. Chetty,
Dongxiao Zhu
Abstract:
Computed Tomography (CT) based precise prostate segmentation for treatment planning is challenging due to (1) the unclear boundary of the prostate derived from CT's poor soft tissue contrast and (2) the limitation of convolutional neural network-based models in capturing long-range global context. Here we propose a novel focal transformer-based image segmentation architecture to effectively and ef…
▽ More
Computed Tomography (CT) based precise prostate segmentation for treatment planning is challenging due to (1) the unclear boundary of the prostate derived from CT's poor soft tissue contrast and (2) the limitation of convolutional neural network-based models in capturing long-range global context. Here we propose a novel focal transformer-based image segmentation architecture to effectively and efficiently extract local visual features and global context from CT images. Additionally, we design an auxiliary boundary-induced label regression task coupled with the main prostate segmentation task to address the unclear boundary issue in CT images. We demonstrate that this design significantly improves the quality of the CT-based prostate segmentation task over other competing methods, resulting in substantially improved performance, i.e., higher Dice Similarity Coefficient, lower Hausdorff Distance, and Average Symmetric Surface Distance, on both private and public CT image datasets. Our code is available at this \href{https://github.com/ChengyinLee/FocalUNETR.git}{link}.
△ Less
Submitted 18 July, 2023; v1 submitted 6 October, 2022;
originally announced October 2022.
-
Sparse Reconstruction-based Detection of Spatial Dimension Holes in Cognitive Radio Networks
Authors:
Yahya H. Ezzeldin,
Radwa A. Sultan,
Karim G. Seddik
Abstract:
In this paper, we investigate a spectrum sensing algorithm for detecting spatial dimension holes in Multiple Inputs Multiple Outputs (MIMO) transmissions for OFDM systems using Compressive Sensing (CS) tools. This extends the energy detector to allow for detecting transmission opportunities even if the band is already energy filled. We show that the task described above is not performed efficientl…
▽ More
In this paper, we investigate a spectrum sensing algorithm for detecting spatial dimension holes in Multiple Inputs Multiple Outputs (MIMO) transmissions for OFDM systems using Compressive Sensing (CS) tools. This extends the energy detector to allow for detecting transmission opportunities even if the band is already energy filled. We show that the task described above is not performed efficiently by regular MIMO decoders (such as MMSE decoder) due to possible sparsity in the transmit signal. Since CS reconstruction tools take into account the sparsity order of the signal, they are more efficient in detecting the activity of the users. Building on successful activity detection by the CS detector, we show that the use of a CS-aided MMSE decoders yields better performance rather than using either CS-based or MMSE decoders separately. Simulations are conducted to verify the gains from using CS detector for Primary user activity detection and the performance gain in using CS-aided MMSE decoders for decoding the PU information for future relaying.
△ Less
Submitted 23 July, 2013;
originally announced July 2013.