-
Electron Confinement-Induced Plasmonic Breakdown in Metals
Authors:
Prasanna Das,
Sourav Rudra,
Dheemahi Rao,
Souvik Banerjee,
Ashalatha Indiradevi Kamalasanan Pillai,
Magnus Garbrecht,
Alexandra Boltasseva,
Igor V. Bondarev,
Vladimir M. Shalaev,
Bivas Saha
Abstract:
Plasmon resonance in metals represents the collective oscillation of the free electron gas density and enables enhanced light-matter interactions in nanoscale dimensions. Traditionally, the classical Drude model describes the plasmonic excitation, wherein the plasma frequency exhibits no spatial dispersion. Here, we show conclusive experimental evidence of the breakdown of the plasmon resonance an…
▽ More
Plasmon resonance in metals represents the collective oscillation of the free electron gas density and enables enhanced light-matter interactions in nanoscale dimensions. Traditionally, the classical Drude model describes the plasmonic excitation, wherein the plasma frequency exhibits no spatial dispersion. Here, we show conclusive experimental evidence of the breakdown of the plasmon resonance and a consequent photonic metal-insulator transition in an ultrathin archetypal refractory plasmonic material, hafnium nitride (HfN). Epitaxial HfN thick films exhibit a low-loss and high-quality Drude-like plasmon resonance in the visible spectral range. However, as the film thickness is reduced to nanoscale dimensions, the Coulomb interaction among electrons increases due to the electron confinement, leading to the spatial dispersion of the plasma frequency. Importantly, with the further decrease in thickness, electrons lose their ability to shield the incident electric field, turning the medium into a dielectric. The breakdown of the plasmon resonance in epitaxial ultrathin metals could be useful for fundamental physics studies in transdimensional regimes and novel photonic device applications.
△ Less
Submitted 5 June, 2024;
originally announced June 2024.
-
Ethics Pathways: A Design Activity for Reflecting on Ethics Engagement in HCI Research
Authors:
Inha Cha,
Ajit G. Pillai,
Richmond Y. Wong
Abstract:
This paper introduces Ethics Pathways, a design activity aimed at understanding HCI and design researchers' ethics engagements and flows during their research process. Despite a strong ethical commitment in these fields, challenges persist in gras** the complexity of researchers' engagement with ethics -- practices conducted to operationalize ethics -- in situated institutional contexts. Ethics…
▽ More
This paper introduces Ethics Pathways, a design activity aimed at understanding HCI and design researchers' ethics engagements and flows during their research process. Despite a strong ethical commitment in these fields, challenges persist in gras** the complexity of researchers' engagement with ethics -- practices conducted to operationalize ethics -- in situated institutional contexts. Ethics Pathways, developed through six playtesting sessions, offers a design approach to understanding the complexities of researchers' past ethics engagements in their work. This activity involves four main tasks: recalling ethical incidents; describing stakeholders involved in the situation; recounting their actions or speculative alternatives; and reflection and emotion walk-through. The paper reflects on the role of design decisions and facilitation strategies in achieving these goals. The design activity contributes to the discourse on ethical HCI research by conceptualizing ethics engagement as a part of ongoing research processing, highlighting connections between individual affective experiences, social interactions across power differences, and institutional goals.
△ Less
Submitted 26 May, 2024;
originally announced May 2024.
-
Contextual AI Journaling: Integrating LLM and Time Series Behavioral Sensing Technology to Promote Self-Reflection and Well-being using the MindScape App
Authors:
Subigya Nepal,
Arvind Pillai,
William Campbell,
Talie Massachi,
Eunsol Soul Choi,
Orson Xu,
Joanna Kuc,
Jeremy Huckins,
Jason Holden,
Colin Depp,
Nicholas Jacobson,
Mary Czerwinski,
Eric Granholm,
Andrew T. Campbell
Abstract:
MindScape aims to study the benefits of integrating time series behavioral patterns (e.g., conversational engagement, sleep, location) with Large Language Models (LLMs) to create a new form of contextual AI journaling, promoting self-reflection and well-being. We argue that integrating behavioral sensing in LLMs will likely lead to a new frontier in AI. In this Late-Breaking Work paper, we discuss…
▽ More
MindScape aims to study the benefits of integrating time series behavioral patterns (e.g., conversational engagement, sleep, location) with Large Language Models (LLMs) to create a new form of contextual AI journaling, promoting self-reflection and well-being. We argue that integrating behavioral sensing in LLMs will likely lead to a new frontier in AI. In this Late-Breaking Work paper, we discuss the MindScape contextual journal App design that uses LLMs and behavioral sensing to generate contextual and personalized journaling prompts crafted to encourage self-reflection and emotional development. We also discuss the MindScape study of college students based on a preliminary user study and our upcoming study to assess the effectiveness of contextual AI journaling in promoting better well-being on college campuses. MindScape represents a new application class that embeds behavioral intelligence in AI.
△ Less
Submitted 30 March, 2024;
originally announced April 2024.
-
Crypto Technology -- Impact on Global Economy
Authors:
Arunkumar Velayudhan Pillai
Abstract:
The last decade has been marked by the evolution of cryptocurrencies, which have captured the interest of the public through the offered opportunities and the feeling of freedom, resulting from decentralization and lack of authority to oversee how cryptocurrency transactions are conducted. The innovation in crypto space is often compared to the impact internet had on human life. There is a new ter…
▽ More
The last decade has been marked by the evolution of cryptocurrencies, which have captured the interest of the public through the offered opportunities and the feeling of freedom, resulting from decentralization and lack of authority to oversee how cryptocurrency transactions are conducted. The innovation in crypto space is often compared to the impact internet had on human life. There is a new term called Web 3.0 for denoting all new computing innovations arising due to the blockchain technologies. Blockchain has emerged as one of the most important inventions of the last decade with crypto currencies or financial use case as one of the domains which progressed most in the last 10 years. It is very important to research about Web 3 technologies, how it is connected to crypto economy and what to expect in this field for the next several decades.
△ Less
Submitted 27 February, 2024;
originally announced March 2024.
-
MoodCapture: Depression Detection Using In-the-Wild Smartphone Images
Authors:
Subigya Nepal,
Arvind Pillai,
Weichen Wang,
Tess Griffin,
Amanda C. Collins,
Michael Heinz,
Damien Lekkas,
Shayan Mirjafari,
Matthew Nemesure,
George Price,
Nicholas C. Jacobson,
Andrew T. Campbell
Abstract:
MoodCapture presents a novel approach that assesses depression based on images automatically captured from the front-facing camera of smartphones as people go about their daily lives. We collect over 125,000 photos in the wild from N=177 participants diagnosed with major depressive disorder for 90 days. Images are captured naturalistically while participants respond to the PHQ-8 depression survey…
▽ More
MoodCapture presents a novel approach that assesses depression based on images automatically captured from the front-facing camera of smartphones as people go about their daily lives. We collect over 125,000 photos in the wild from N=177 participants diagnosed with major depressive disorder for 90 days. Images are captured naturalistically while participants respond to the PHQ-8 depression survey question: \textit{``I have felt down, depressed, or hopeless''}. Our analysis explores important image attributes, such as angle, dominant colors, location, objects, and lighting. We show that a random forest trained with face landmarks can classify samples as depressed or non-depressed and predict raw PHQ-8 scores effectively. Our post-hoc analysis provides several insights through an ablation study, feature importance analysis, and bias assessment. Importantly, we evaluate user concerns about using MoodCapture to detect depression based on sharing photos, providing critical insights into privacy concerns that inform the future design of in-the-wild image-based mental health assessment tools.
△ Less
Submitted 25 February, 2024;
originally announced February 2024.
-
Roadmap on Nanoscale Magnetic Resonance Imaging
Authors:
Raffi Budakian,
Amit Finkler,
Alexander Eichler,
Martino Poggio,
Christian L. Degen,
Sahand Tabatabaei,
Inhee Lee,
P. Chris Hammel,
Eugene S. Polzik,
Tim H. Taminiau,
Ronald L. Walsworth,
Paz London,
Ania Bleszynski Jayich,
Ashok Ajoy,
Arjun Pillai,
Jörg Wrachtrup,
Fedor Jelezko,
Yujeong Bae,
Andreas J. Heinrich,
Christian R. Ast,
Patrice Bertet,
Paola Cappellaro,
Cristian Bonato,
Yoann Altmann,
Erik Gauger
Abstract:
The field of nanoscale magnetic resonance imaging (NanoMRI) was started 30 years ago. It was motivated by the desire to image single molecules and molecular assemblies, such as proteins and virus particles, with near-atomic spatial resolution and on a length scale of 100 nm. Over the years, the NanoMRI field has also expanded to include the goal of useful high-resolution nuclear magnetic resonance…
▽ More
The field of nanoscale magnetic resonance imaging (NanoMRI) was started 30 years ago. It was motivated by the desire to image single molecules and molecular assemblies, such as proteins and virus particles, with near-atomic spatial resolution and on a length scale of 100 nm. Over the years, the NanoMRI field has also expanded to include the goal of useful high-resolution nuclear magnetic resonance (NMR) spectroscopy of molecules under ambient conditions, including samples up to the micron-scale. The realization of these goals requires the development of spin detection techniques that are many orders of magnitude more sensitive than conventional NMR and MRI, capable of detecting and controlling nanoscale ensembles of spins. Over the years, a number of different technical approaches to NanoMRI have emerged, each possessing a distinct set of capabilities for basic and applied areas of science. The goal of this roadmap article is to report the current state of the art in NanoMRI technologies, outline the areas where they are poised to have impact, identify the challenges that lie ahead, and propose methods to meet these challenges. This roadmap also shows how developments in NanoMRI techniques can lead to breakthroughs in emerging quantum science and technology applications.
△ Less
Submitted 14 December, 2023;
originally announced December 2023.
-
Evaluation of flamelet-based models for liquid ammonia combustion in a temporally evolving mixing layer
Authors:
Zhenhua An,
Jiangkuan Xing,
Abhishek Lakshman Pillai,
Ryoichi Kurose
Abstract:
Liquid ammonia combustion can be enhanced by co-firing with small molecular fuels such as methane, and liquid ammonia will undergo flash evaporation due to its relatively low saturation pressure. These characteristics, involving the presence of multiple fuel streams, a rapid phase change process, and strong heat loss, pose challenges for flamelet modeling of liquid ammonia combustion. To address t…
▽ More
Liquid ammonia combustion can be enhanced by co-firing with small molecular fuels such as methane, and liquid ammonia will undergo flash evaporation due to its relatively low saturation pressure. These characteristics, involving the presence of multiple fuel streams, a rapid phase change process, and strong heat loss, pose challenges for flamelet modeling of liquid ammonia combustion. To address these issues, this study aims to evaluate the effectiveness of flamelet-based models for liquid ammonia combustion in a turbulent mixing layer. Specifically, the extended flamelet/progress variable (E-FPV), extended flamelet-generated manifolds (E-FGM), and extended hybrid (E-Hybrid) models are developed and assessed. Firstly, a three-dimensional Point-Particle Direct Numerical Simulation (PP-DNS) with detailed chemistry is performed, where the turbulent flow is fully resolved, and the ammonia droplets are described by the Lagrangian method, to investigate the combustion characteristics of a liquid ammonia/methane co-fired flame and to provide state-of-the-art validation data for flamelet modeling. The PP-DNS results reveal distinct stages in the liquid ammonia/methane co-fired flame. The phase change process introduces significant heat loss due to the high latent heat of liquid ammonia. Subsequently, flamelet-based models are developed to account for the complex fuel streams, rapid phase change process, and strong local heat loss. The performance of these models is evaluated through a priori analysis by comparing the predictions with the PP-DNS results. The a priori results show that the E-FGM model outperforms the E-FPV and E-Hybrid models. This superior performance can be attributed to the rapid flash evaporation and sufficient mixing of the superheated ammonia, resulting in the dominance of the premixed combustion mode in liquid ammonia combustion.
△ Less
Submitted 4 December, 2023;
originally announced December 2023.
-
Social Isolation and Serious Mental Illness: The Role of Context-Aware Mobile Interventions
Authors:
Subigya Nepal,
Arvind Pillai,
Emma M. Parrish,
Jason Holden,
Colin Depp,
Andrew T. Campbell,
Eric Granholm
Abstract:
Social isolation is a common problem faced by individuals with serious mental illness (SMI), and current intervention approaches have limited effectiveness. This paper presents a blended intervention approach, called mobile Social Interaction Therapy by Exposure (mSITE), to address social isolation in individuals with serious mental illness. The approach combines brief in-person cognitive-behavior…
▽ More
Social isolation is a common problem faced by individuals with serious mental illness (SMI), and current intervention approaches have limited effectiveness. This paper presents a blended intervention approach, called mobile Social Interaction Therapy by Exposure (mSITE), to address social isolation in individuals with serious mental illness. The approach combines brief in-person cognitive-behavioral therapy (CBT) with context-triggered mobile CBT interventions that are personalized using mobile sensing data. Our approach targets social behavior and is the first context-aware intervention for improving social outcomes in serious mental illness.
△ Less
Submitted 16 November, 2023;
originally announced November 2023.
-
Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkers
Authors:
Yuxia Wang,
Revanth Gangi Reddy,
Zain Muhammad Mujahid,
Arnav Arora,
Aleksandr Rubashevskii,
Jiahui Geng,
Osama Mohammed Afzal,
Liangming Pan,
Nadav Borenstein,
Aditya Pillai,
Isabelle Augenstein,
Iryna Gurevych,
Preslav Nakov
Abstract:
The increased use of large language models (LLMs) across a variety of real-world applications calls for mechanisms to verify the factual accuracy of their outputs. In this work, we present a holistic end-to-end solution for annotating the factuality of LLM-generated responses, which encompasses a multi-stage annotation scheme designed to yield detailed labels concerning the verifiability and factu…
▽ More
The increased use of large language models (LLMs) across a variety of real-world applications calls for mechanisms to verify the factual accuracy of their outputs. In this work, we present a holistic end-to-end solution for annotating the factuality of LLM-generated responses, which encompasses a multi-stage annotation scheme designed to yield detailed labels concerning the verifiability and factual inconsistencies found in LLM outputs. We further construct an open-domain document-level factuality benchmark in three-level granularity: claim, sentence and document, aiming to facilitate the evaluation of automatic fact-checking systems. Preliminary experiments show that FacTool, FactScore and Perplexity.ai are struggling to identify false claims, with the best F1=0.63 by this annotation solution based on GPT-4. Annotation tool, benchmark and code are available at https://github.com/yuxiaw/Factcheck-GPT.
△ Less
Submitted 16 April, 2024; v1 submitted 15 November, 2023;
originally announced November 2023.
-
Nanoscale engineering and dynamical stabilization of mesoscopic spin textures
Authors:
Kieren Harkins,
Christoph Fleckenstein,
Noella D'Souza,
Paul M. Schindler,
David Marchiori,
Claudia Artiaco,
Quentin Reynard-Feytis,
Ushoshi Basumallick,
William Beatrez,
Arjun Pillai,
Matthias Hagn,
Aniruddha Nayak,
Samantha Breuer,
Xudong Lv,
Maxwell McAllister,
Paul Reshetikhin,
Emanuel Druga,
Marin Bukov,
Ashok Ajoy
Abstract:
Thermalization phenomena, while ubiquitous in quantum systems, have traditionally been viewed as obstacles to be mitigated. In this study, we demonstrate the ability, instead, to harness thermalization to dynamically engineer and stabilize structured quantum states in a mesoscopically large ensemble of spins. Specifically, we showcase the capacity to generate, control, stabilize, and read out 'she…
▽ More
Thermalization phenomena, while ubiquitous in quantum systems, have traditionally been viewed as obstacles to be mitigated. In this study, we demonstrate the ability, instead, to harness thermalization to dynamically engineer and stabilize structured quantum states in a mesoscopically large ensemble of spins. Specifically, we showcase the capacity to generate, control, stabilize, and read out 'shell-like' spin texture with interacting $ {}^{ 13}\mathrm{C}$ nuclear spins in diamond, wherein spins are polarized oppositely on either side of a critical radius. The texture spans several nanometers and encompasses many hundred spins. We capitalize on the thermalization process to impose a quasi-equilibrium upon the generated texture; as a result, it is highly stable, immune to spin diffusion, and endures over multiple-minute long periods -- over a million times longer than the intrinsic interaction scale of the spins. Additionally, the texture is created and interrogated without locally controlling or probing the nuclear spins. These features are accomplished using an electron spin as a nanoscale injector of spin polarization, and employing it as a source of spatially varying dissipation, allowing for serial readout of the emergent spin texture. Long-time stabilization is achieved via prethermalization to a Floquet-induced Hamiltonian under the electronic gradient field. Our work presents a new approach to robust nanoscale spin state engineering and paves the way for new applications in quantum simulation, quantum information science, and nanoscale imaging.
△ Less
Submitted 9 October, 2023;
originally announced October 2023.
-
An Empirical Study on the Use of Static Analysis Tools in Open Source Embedded Software
Authors:
Mingjie Shen,
Akul Pillai,
Brian A. Yuan,
James C. Davis,
Aravind Machiry
Abstract:
This paper performs the first study to understand the prevalence, challenges, and effectiveness of using Static Application Security Testing (SAST) tools on Open-Source Embedded Software (EMBOSS) repositories. We collect a corpus of 258 of the most popular EMBOSS projects, representing 13 distinct categories such as real-time operating systems, network stacks, and applications. To understand the c…
▽ More
This paper performs the first study to understand the prevalence, challenges, and effectiveness of using Static Application Security Testing (SAST) tools on Open-Source Embedded Software (EMBOSS) repositories. We collect a corpus of 258 of the most popular EMBOSS projects, representing 13 distinct categories such as real-time operating systems, network stacks, and applications. To understand the current use of SAST tools on EMBOSS, we measured this corpus and surveyed developers. To understand the challenges and effectiveness of using SAST tools on EMBOSS projects, we applied these tools to the projects in our corpus. We report that almost none of these projects (just 3%) use SAST tools beyond those baked into the compiler, and developers give rationales such as ineffectiveness and false positives. In applying SAST tools ourselves, we show that minimal engineering effort and project expertise are needed to apply many tools to a given EMBOSS project. GitHub's CodeQL was the most effective SAST tool -- using its built-in security checks we found a total of 540 defects (with a false positive rate of 23%) across the 258 projects, with 399 (74%) likely security vulnerabilities, including in projects maintained by Microsoft, Amazon, and the Apache Foundation. EMBOSS engineers have confirmed 273 (51%) of these defects, mainly by accepting our pull requests. Two CVEs were issued. In summary, we urge EMBOSS engineers to adopt the current generation of SAST tools, which offer low false positive rates and are effective at finding security-relevant defects.
△ Less
Submitted 29 September, 2023;
originally announced October 2023.
-
Linear Programming based Reductions for Multiple Visit TSP and Vehicle Routing Problems
Authors:
Aditya Pillai,
Mohit Singh
Abstract:
Multiple TSP ($\mathrm{mTSP}$) is a important variant of $\mathrm{TSP}$ where a set of $k$ salesperson together visit a set of $n$ cities. The $\mathrm{mTSP}$ problem has applications to many real life applications such as vehicle routing. Rothkopf introduced another variant of $\mathrm{TSP}$ called many-visits TSP ($\mathrm{MV\mbox{-}TSP}$) where a request $r(v)\in \mathbb{Z}_+$ is given for each…
▽ More
Multiple TSP ($\mathrm{mTSP}$) is a important variant of $\mathrm{TSP}$ where a set of $k$ salesperson together visit a set of $n$ cities. The $\mathrm{mTSP}$ problem has applications to many real life applications such as vehicle routing. Rothkopf introduced another variant of $\mathrm{TSP}$ called many-visits TSP ($\mathrm{MV\mbox{-}TSP}$) where a request $r(v)\in \mathbb{Z}_+$ is given for each city $v$ and a single salesperson needs to visit each city $r(v)$ times and return back to his starting point. A combination of $\mathrm{mTSP}$ and $\mathrm{MV\mbox{-}TSP}$ called many-visits multiple TSP $(\mathrm{MV\mbox{-}mTSP})$ was studied by Bérczi, Mnich, and Vincze where the authors give approximation algorithms for various variants of $\mathrm{MV\mbox{-}mTSP}$.
In this work, we show a simple linear programming (LP) based reduction that converts a $\mathrm{mTSP}$ LP-based algorithm to a LP-based algorithm for $\mathrm{MV\mbox{-}mTSP}$ with the same approximation factor. We apply this reduction to improve or match the current best approximation factors of several variants of the $\mathrm{MV\mbox{-}mTSP}$. Our reduction shows that the addition of visit requests $r(v)$ to $\mathrm{mTSP}$ does $\textit{not}$ make the problem harder to approximate even when $r(v)$ is exponential in number of vertices.
To apply our reduction, we either use existing LP-based algorithms for $\mathrm{mTSP}$ variants or show that several existing combinatorial algorithms for $\mathrm{mTSP}$ variants can be interpreted as LP-based algorithms. This allows us to apply our reduction to these combinatorial algorithms as well achieving the improved guarantees.
△ Less
Submitted 22 August, 2023;
originally announced August 2023.
-
An Improved Approximation Algorithm for the Max-$3$-Section Problem
Authors:
Dor Katzelnick,
Aditya Pillai,
Roy Schwartz,
Mohit Singh
Abstract:
We consider the Max-$3$-Section problem, where we are given an undirected graph $ G=(V,E)$ equipped with non-negative edge weights $w :E\rightarrow \mathbb{R}_+$ and the goal is to find a partition of $V$ into three equisized parts while maximizing the total weight of edges crossing between different parts. Max-$3$-Section is closely related to other well-studied graph partitioning problems, e.g.,…
▽ More
We consider the Max-$3$-Section problem, where we are given an undirected graph $ G=(V,E)$ equipped with non-negative edge weights $w :E\rightarrow \mathbb{R}_+$ and the goal is to find a partition of $V$ into three equisized parts while maximizing the total weight of edges crossing between different parts. Max-$3$-Section is closely related to other well-studied graph partitioning problems, e.g., Max-$k$-Cut, Max-$3$-Cut, and Max-Bisection. We present a polynomial time algorithm achieving an approximation of $ 0.795$, that improves upon the previous best known approximation of $ 0.673$. The requirement of multiple parts that have equal sizes renders Max-$3$-Section much harder to cope with compared to, e.g., Max-Bisection. We show a new algorithm that combines the existing approach of Lassere hierarchy along with a random cut strategy that suffices to give our result.
△ Less
Submitted 7 August, 2023;
originally announced August 2023.
-
Agent-based modeling of the COVID-19 pandemic in Florida
Authors:
Alexander N. Pillai,
Kok Ben Toh,
Dianela Perdomo,
Sanjana Bhargava,
Arlin Stoltzfus,
Ira M. Longini Jr.,
Carl A. B. Pearson,
Thomas J. Hladish
Abstract:
The onset of the COVID-19 pandemic drove a widespread, often uncoordinated effort by research groups to develop mathematical models of SARS-CoV-2 to study its spread and inform control efforts. The urgent demand for insight at the outset of the pandemic meant early models were typically either simple or repurposed from existing research agendas. Our group predominantly uses agent-based models (ABM…
▽ More
The onset of the COVID-19 pandemic drove a widespread, often uncoordinated effort by research groups to develop mathematical models of SARS-CoV-2 to study its spread and inform control efforts. The urgent demand for insight at the outset of the pandemic meant early models were typically either simple or repurposed from existing research agendas. Our group predominantly uses agent-based models (ABMs) to study fine-scale intervention scenarios. These high-resolution models are large, complex, require extensive empirical data, and are often more detailed than strictly necessary for answering qualitative questions like "Should we lockdown?" During the early stages of an extraordinary infectious disease crisis, particularly before clear empirical evidence is available, simpler models are more appropriate. As more detailed empirical evidence becomes available, however, and policy decisions become more nuanced and complex, fine-scale approaches like ours become more useful.
In this manuscript, we discuss how our group navigated this transition as we modeled the pandemic. The role of modelers often included nearly real-time analysis, and the massive undertaking of adapting our tools quickly. We were often playing catch up with a firehose of evidence, while simultaneously struggling to do both academic research and real-time decision support, under conditions conducive to neither. By reflecting on our experiences of responding to the pandemic and what we learned from these challenges, we can better prepare for future demands.
△ Less
Submitted 19 June, 2023;
originally announced June 2023.
-
Rare Life Event Detection via Mobile Sensing Using Multi-Task Learning
Authors:
Arvind Pillai,
Subigya Nepal,
Andrew Campbell
Abstract:
Rare life events significantly impact mental health, and their detection in behavioral studies is a crucial step towards health-based interventions. We envision that mobile sensing data can be used to detect these anomalies. However, the human-centered nature of the problem, combined with the infrequency and uniqueness of these events makes it challenging for unsupervised machine learning methods.…
▽ More
Rare life events significantly impact mental health, and their detection in behavioral studies is a crucial step towards health-based interventions. We envision that mobile sensing data can be used to detect these anomalies. However, the human-centered nature of the problem, combined with the infrequency and uniqueness of these events makes it challenging for unsupervised machine learning methods. In this paper, we first investigate granger-causality between life events and human behavior using sensing data. Next, we propose a multi-task framework with an unsupervised autoencoder to capture irregular behavior, and an auxiliary sequence predictor that identifies transitions in workplace performance to contextualize events. We perform experiments using data from a mobile sensing study comprising N=126 information workers from multiple industries, spanning 10106 days with 198 rare events (<2%). Through personalized inference, we detect the exact day of a rare event with an F1 of 0.34, demonstrating that our method outperforms several baselines. Finally, we discuss the implications of our work from the context of real-world deployment.
△ Less
Submitted 31 May, 2023;
originally announced May 2023.
-
Detecting Fake Job Postings Using Bidirectional LSTM
Authors:
Aravind Sasidharan Pillai
Abstract:
Fake job postings have become prevalent in the online job market, posing significant challenges to job seekers and employers. Despite the growing need to address this problem, there is limited research that leverages deep learning techniques for the detection of fraudulent job advertisements. This study aims to fill the gap by employing a Bidirectional Long Short-Term Memory (Bi-LSTM) model to ide…
▽ More
Fake job postings have become prevalent in the online job market, posing significant challenges to job seekers and employers. Despite the growing need to address this problem, there is limited research that leverages deep learning techniques for the detection of fraudulent job advertisements. This study aims to fill the gap by employing a Bidirectional Long Short-Term Memory (Bi-LSTM) model to identify fake job advertisements. Our approach considers both numeric and text features, effectively capturing the underlying patterns and relationships within the data. The proposed model demonstrates a superior performance, achieving a 0.91 ROC AUC score and a 98.71% accuracy rate, indicating its potential for practical applications in the online job market. The findings of this research contribute to the development of robust, automated tools that can help combat the proliferation of fake job postings and improve the overall integrity of the job search process. Moreover, we discuss challenges, future research directions, and ethical considerations related to our approach, aiming to inspire further exploration and development of practical solutions to combat online job fraud.
△ Less
Submitted 3 April, 2023;
originally announced April 2023.
-
Multi-Label Chest X-Ray Classification via Deep Learning
Authors:
Aravind Sasidharan Pillai
Abstract:
In this era of pandemic, the future of healthcare industry has never been more exciting. Artificial intelligence and machine learning (AI & ML) present opportunities to develop solutions that cater for very specific needs within the industry. Deep learning in healthcare had become incredibly powerful for supporting clinics and in transforming patient care in general. Deep learning is increasingly…
▽ More
In this era of pandemic, the future of healthcare industry has never been more exciting. Artificial intelligence and machine learning (AI & ML) present opportunities to develop solutions that cater for very specific needs within the industry. Deep learning in healthcare had become incredibly powerful for supporting clinics and in transforming patient care in general. Deep learning is increasingly being applied for the detection of clinically important features in the images beyond what can be perceived by the naked human eye. Chest X-ray images are one of the most common clinical method for diagnosing a number of diseases such as pneumonia, lung cancer and many other abnormalities like lesions and fractures. Proper diagnosis of a disease from X-ray images is often challenging task for even expert radiologists and there is a growing need for computerized support systems due to the large amount of information encoded in X-Ray images. The goal of this paper is to develop a lightweight solution to detect 14 different chest conditions from an X ray image. Given an X-ray image as input, our classifier outputs a label vector indicating which of 14 disease classes does the image fall into. Along with the image features, we are also going to use non-image features available in the data such as X-ray view type, age, gender etc. The original study conducted Stanford ML Group is our base line. Original study focuses on predicting 5 diseases. Our aim is to improve upon previous work, expand prediction to 14 diseases and provide insight for future chest radiography research.
△ Less
Submitted 27 November, 2022;
originally announced November 2022.
-
Cornucopia: A Framework for Feedback Guided Generation of Binaries
Authors:
Vidush Singhal,
Akul Abhilash Pillai,
Charitha Saumya,
Milind Kulkarni,
Aravind Machiry
Abstract:
Binary analysis is an important capability required for many security and software engineering applications. Consequently, there are many binary analysis techniques and tools with varied capabilities. However, testing these tools requires a large, varied binary dataset with corresponding source-level information. In this paper, we present Cornucopia, an architecture agnostic automated framework th…
▽ More
Binary analysis is an important capability required for many security and software engineering applications. Consequently, there are many binary analysis techniques and tools with varied capabilities. However, testing these tools requires a large, varied binary dataset with corresponding source-level information. In this paper, we present Cornucopia, an architecture agnostic automated framework that can generate a plethora of binaries from corresponding program source by exploiting compiler optimizations and feedback-guided learning. Our evaluation shows that Cornucopia was able to generate 309K binaries across four architectures (x86, x64, ARM, MIPS) with an average of 403 binaries for each program and outperforms Bintuner, a similar technique. Our experiments revealed issues with the LLVM optimization scheduler resulting in compiler crashes ($\sim$300). Our evaluation of four popular binary analysis tools Angr, Ghidra, Idapro, and Radare, using Cornucopia generated binaries, revealed various issues with these tools. Specifically, we found 263 crashes in Angr and one memory corruption issue in Idapro. Our differential testing on the analysis results revealed various semantic bugs in these tools. We also tested machine learning tools, Asmvec, Safe, and Debin, that claim to capture binary semantics and show that they perform poorly (For instance, Debin F1 score dropped to 12.9% from reported 63.1%) on Cornucopia generated binaries. In summary, our exhaustive evaluation shows that Cornucopia is an effective mechanism to generate binaries for testing binary analysis techniques effectively.
△ Less
Submitted 14 September, 2022;
originally announced September 2022.
-
Electron induced nanoscale nuclear spin relaxation probed by hyperpolarization injection
Authors:
William Beatrez,
Arjun Pillai,
Otto Janes,
Dieter Suter,
Ashok Ajoy
Abstract:
We report on experiments that quantify the role of a central electronic spin as a relaxation source for nuclear spins in its nanoscale environment. Our strategy exploits hyperpolarization injection from the electron as a means to controllably probe an increasing number of nuclear spins in the bath, and subsequently interrogate them with high fidelity. Our experiments are focused on a model system…
▽ More
We report on experiments that quantify the role of a central electronic spin as a relaxation source for nuclear spins in its nanoscale environment. Our strategy exploits hyperpolarization injection from the electron as a means to controllably probe an increasing number of nuclear spins in the bath, and subsequently interrogate them with high fidelity. Our experiments are focused on a model system of a nitrogen vacancy (NV) center electronic spin surrounded by several hundred 13C nuclear spins. We observe that the 13C transverse spin relaxation times vary significantly with the extent of hyperpolarization injection, allowing the ability to measure the influence of electron mediated relaxation extending over several nanometers. These results suggest interesting new means to spatially discriminate nuclear spins in a nanoscale environment, and have direct relevance to dynamic nuclear polarization and quantum sensors and memories constructed from hyperpolarized nuclei.
△ Less
Submitted 15 July, 2022; v1 submitted 6 July, 2022;
originally announced July 2022.
-
Continuously tracked, stable, large excursion trajectories of dipolar coupled nuclear spins
Authors:
Ozgur Sahin,
Hawraa Al Asadi,
Paul Schindler,
Arjun Pillai,
Erica Sanchez,
Matthew Markham,
Mark Elo,
Maxwell McAllister,
Emanuel Druga,
Christoph Fleckenstein,
Marin Bukov,
Ashok Ajoy
Abstract:
We report an experimental approach to excite, stabilize, and continuously track Bloch sphere orbits of dipolar-coupled nuclear spins in a solid. We demonstrate these results on a model system of hyperpolarized 13C nuclear spins in diamond. Without quantum control, inter-spin coupling leads to rapid spin decay in T2*=1.5ms. We elucidate a method to preserve trajectories for over T2'>27s at excursio…
▽ More
We report an experimental approach to excite, stabilize, and continuously track Bloch sphere orbits of dipolar-coupled nuclear spins in a solid. We demonstrate these results on a model system of hyperpolarized 13C nuclear spins in diamond. Without quantum control, inter-spin coupling leads to rapid spin decay in T2*=1.5ms. We elucidate a method to preserve trajectories for over T2'>27s at excursion solid angles up to 16 degrees, even in the presence of strong inter-spin coupling. This exploits a novel spin driving strategy that thermalizes the spins to a long-lived dipolar many-body state, while driving them in highly stable orbits. We show that motion of the spins can be quasi-continuously tracked for over 35s in three dimensions on the Bloch sphere. In this time the spins complete >68,000 closed precession orbits, demonstrating high stability and robustness against error. We experimentally probe the transient approach to such rigid motion, and thereby show the ability to engineer highly stable "designer" spin trajectories. Our results suggest new ways to stabilize and interrogate strongly-coupled quantum systems through periodic driving and portend powerful applications of rigid spin orbits in quantum sensing.
△ Less
Submitted 13 July, 2022; v1 submitted 29 June, 2022;
originally announced June 2022.
-
Grounding Explainability Within the Context of Global South in XAI
Authors:
Deepa Singh,
Michal Slupczynski,
Ajit G. Pillai,
Vinoth Pandian Sermuga Pandian
Abstract:
In this position paper, we propose building a broader and deeper understanding around Explainability in AI by 'grounding' it in social contexts, the socio-technical systems operate in. We situate our understanding of grounded explainability in the 'Global South' in general and India in particular and express the need for more research within the global south context when it comes to explainability…
▽ More
In this position paper, we propose building a broader and deeper understanding around Explainability in AI by 'grounding' it in social contexts, the socio-technical systems operate in. We situate our understanding of grounded explainability in the 'Global South' in general and India in particular and express the need for more research within the global south context when it comes to explainability and AI.
△ Less
Submitted 13 May, 2022;
originally announced May 2022.
-
Secondary Phase Limited Metal-Insulator Phase Transition in Chromium Nitride Thin Films
Authors:
Bidesh Biswas,
Sourjyadeep Chakraborty,
Anjana Joseph,
Shashidhara Acharya,
Ashalatha Indiradevi Kamalasanan Pillai,
Chandrabhas Narayana,
Vijay Bhatia,
Magnus Garbrecht,
Bivas Saha
Abstract:
Chromium nitride (CrN) is a well-known hard coating material that has found applications in abrasion and wear-resistant cutting tools, bearings, and tribology applications due to its high hardness, high-temperature stability, and corrosion-resistant properties. In recent years, CrN has also attracted significant interest due to its high thermoelectric power factor, and for its unique and intriguin…
▽ More
Chromium nitride (CrN) is a well-known hard coating material that has found applications in abrasion and wear-resistant cutting tools, bearings, and tribology applications due to its high hardness, high-temperature stability, and corrosion-resistant properties. In recent years, CrN has also attracted significant interest due to its high thermoelectric power factor, and for its unique and intriguing metal-insulator phase transition. While CrN bulk single-crystals exhibit the characteristic metal-insulator transition accompanied with structural (orthorhombic-to-rocksalt) and magnetic (antiferromagnetic-to-paramagnetic) transition at ~260-280K, observation of such phase transition in thin-film CrN has been scarce and highly debated. In this work, the formation of the secondary metallic Cr2N phase during the growth is demonstrated to inhibit the observation of metal-insulator phase transition in CrN thin films. When the Cr-flux during deposition is reduced below a critical limit, epitaxial and stoichiometric CrN thin film is obtained that reproducibly exhibits the phase transition. Annealing of the mixed-phase film inside reducing NH3 environment converts the Cr2N into CrN, and a discontinuity in the electrical resistivity at ~ 277 K appears which supports the underlying hypothesis. A clear demonstration of the origin behind the controversy of the metal-insulator transition in CrN thin films marks significant progress and would enable its nanoscale device realization.
△ Less
Submitted 19 January, 2022;
originally announced January 2022.
-
A Survey of Passive Sensing in the Workplace
Authors:
Subigya Nepal,
Gonzalo J. Martinez,
Arvind Pillai,
Koustuv Saha,
Shayan Mirjafari,
Vedant Das Swain,
Xuhai Xu,
Pino G. Audia,
Munmun De Choudhury,
Anind K. Dey,
Aaron Striegel,
Andrew T. Campbell
Abstract:
As emerging technologies increasingly integrate into all facets of our lives, the workplace stands at the forefront of potential transformative changes. A notable development in this realm is the advent of passive sensing technology, designed to enhance both cognitive and physical capabilities by monitoring human behavior. This paper reviews current research on the application of passive sensing t…
▽ More
As emerging technologies increasingly integrate into all facets of our lives, the workplace stands at the forefront of potential transformative changes. A notable development in this realm is the advent of passive sensing technology, designed to enhance both cognitive and physical capabilities by monitoring human behavior. This paper reviews current research on the application of passive sensing technology in the workplace, focusing on its impact on employee wellbeing and productivity. Additionally, we explore unresolved issues and outline prospective pathways for the incorporation of passive sensing in future workplaces.
△ Less
Submitted 30 March, 2024; v1 submitted 9 January, 2022;
originally announced January 2022.
-
Observation of a critical prethermal discrete time crystal created by two-frequency driving
Authors:
William Beatrez,
Christoph Fleckenstein,
Arjun Pillai,
Erica Sanchez,
Amala Akkiraju,
Jesus Alcala,
Sophie Conti,
Paul Reshetikhin,
Emanuel Druga,
Marin Bukov,
Ashok Ajoy
Abstract:
We report the observation of long-lived Floquet prethermal discrete time crystalline (PDTC) order in a three-dimensional position-disordered lattice of interacting dipolar-coupled 13C nuclei in diamond at room temperature. We demonstrate a novel strategy of "two-frequency" driving, involving an interleaved application of slow and fast drives that simultaneously prethermalize the spins with an emer…
▽ More
We report the observation of long-lived Floquet prethermal discrete time crystalline (PDTC) order in a three-dimensional position-disordered lattice of interacting dipolar-coupled 13C nuclei in diamond at room temperature. We demonstrate a novel strategy of "two-frequency" driving, involving an interleaved application of slow and fast drives that simultaneously prethermalize the spins with an emergent quasi-conserved magnetization along the x-axis, while enabling continuous and highly resolved observation of their dynamic evolution when periodically kicked away from x. The PDTC order manifests itself in a robust period doubling response of this drive-induced quasi-conserved spin magnetization interchanging between x and -x; our experiments allow a unique means to study the formation and melting of PDTC order. We obtain movies of the time-crystalline response with a clarity and throughput orders of magnitude greater than previous experiments. Parametric control over the drive frequencies allows us to reach PDTC lifetimes up to 396 Floquet cycles which we measure in a single-shot experiment. Such rapid measurement enables detailed characterization of the entire PDTC phase diagram, rigidity and lifetime, informing on the role of prethermalization towards stabilizing the DTC response. The two-frequency drive approach represents the simplest generalization of DTCs to multi-frequency drives; it expands the toolkit for realizing and investigating long-lived non-equilibrium phases of matter stabilized by emergent quasi-conservation laws.
△ Less
Submitted 18 August, 2022; v1 submitted 6 January, 2022;
originally announced January 2022.
-
Rapidly enhanced spin polarization injection in an optically pumped spin ratchet
Authors:
Adrisha Sarkar,
Brian Blankenship,
Emanuel Druga,
Arjun Pillai,
Ruhee Nirodi,
Siddharth Singh,
Alexander Oddo,
Paul Reshetikhin,
Ashok Ajoy
Abstract:
Rapid injection of spin polarization into an ensemble of nuclear spins is a problem of broad interest, spanning dynamic nuclear polarization (DNP) to quantum information science. We report on a strategy to boost the spin injection rate by exploiting electrons that can be rapidly polarized via high-power optical pum**. We demonstrate this in a model system of Nitrogen Vacancy center electrons inj…
▽ More
Rapid injection of spin polarization into an ensemble of nuclear spins is a problem of broad interest, spanning dynamic nuclear polarization (DNP) to quantum information science. We report on a strategy to boost the spin injection rate by exploiting electrons that can be rapidly polarized via high-power optical pum**. We demonstrate this in a model system of Nitrogen Vacancy center electrons injecting polarization into a bath of 13C nuclei in diamond. We deliver >20W of continuous, nearly isotropic, optical power to the sample, constituting a substantially higher power than in previous experiments. Through a spin-ratchet polarization transfer mechanism, we show boosts in spin injection rates by over two orders of magnitude. Our experiments elucidate bottlenecks in the DNP process caused by rates of electron polarization, polarization transfer to proximal nuclei, and spin diffusion. This work demonstrates opportunities for rapid spin injection employing non-thermally generated electron polarization, and has relevance to a broad class of experimental systems including in DNP, quantum sensing, and spin-based MASERs.
△ Less
Submitted 18 August, 2022; v1 submitted 14 December, 2021;
originally announced December 2021.
-
Electron-to-nuclear spectral map** via "Galton board" dynamic nuclear polarization
Authors:
Arjun Pillai,
Moniish Elanchezhian,
Teemu Virtanen,
Sophie Conti,
Ashok Ajoy
Abstract:
We report on a strategy to indirectly readout the spectrum of an electronic spin via polarization transfer to nuclear spins in its local environment. The nuclear spins are far more abundant and have longer lifetimes, allowing repeated polarization accumulation in them. Subsequent nuclear interrogation can reveal information about the electronic spectral density of states. We experimentally demonst…
▽ More
We report on a strategy to indirectly readout the spectrum of an electronic spin via polarization transfer to nuclear spins in its local environment. The nuclear spins are far more abundant and have longer lifetimes, allowing repeated polarization accumulation in them. Subsequent nuclear interrogation can reveal information about the electronic spectral density of states. We experimentally demonstrate the method for reading out the ESR spectrum of Nitrogen Vacancy center electrons in diamond via readout of lattice 13C nuclei. Spin-lock control on the 13C nuclei yields significantly enhanced signal-to-noise for the nuclear readout. Spectrally mapped readout presents operational advantages in being background-free and immune to crystal orientation and optical scattering. We harness these advantages to demonstrate applications in underwater magnetometry. The physical basis for the "one-to-many" spectral map is itself intriguing. To uncover its origin, we develop a theoretical model that maps the system dynamics, involving traversal of a cascaded structure of Landau-Zener anti-crossings, to the operation of a tilted "Galton board". This work points to new opportunities for "ESR-via-NMR" in dilute electronic systems, and in hybrid electron-nuclear quantum memories and sensors.
△ Less
Submitted 17 October, 2021; v1 submitted 13 October, 2021;
originally announced October 2021.
-
"Galton board" nuclear hyperpolarization
Authors:
Moniish Elanchezhian,
Arjun Pillai,
Teemu Virtanen,
Ashok Ajoy
Abstract:
We consider the problem of determining the spectrum of an electronic spin via polarization transfer to coupled nuclear spins and their subsequent readout. This suggests applications for employing dynamic nuclear polarization (DNP) for "ESR-via-NMR". In this paper, we describe the theoretical basis for this process by develo** a model for the evolution dynamics of the coupled electron-nuclear sys…
▽ More
We consider the problem of determining the spectrum of an electronic spin via polarization transfer to coupled nuclear spins and their subsequent readout. This suggests applications for employing dynamic nuclear polarization (DNP) for "ESR-via-NMR". In this paper, we describe the theoretical basis for this process by develo** a model for the evolution dynamics of the coupled electron-nuclear system through a cascade of Landau-Zener anti-crossings (LZ-LACs). We develop a method to map these traversals to the operation of an equivalent "Galton board". Here, LZ-LAC points serve as analogues to Galton board "pegs", upon interacting with which the nuclear populations redistribute. The developed hyperpolarization then tracks the local electronic density of states. We show that this approach yields an intuitive and analytically tractable solution of the polarization transfer dynamics, including when DNP is carried out at the wing of a homogeneously broadened electronic spectral line. We apply this approach to a model system comprised of a Nitrogen Vacancy (NV) center electron in diamond, hyperfine coupled to N neighboring 13C nuclear spins, and discuss applications for nuclear-spin interrogated NV center magnetometry. More broadly, the methodology of "one-to-many" electron-to-nuclear spectral map** developed here suggests interesting applications in quantum memories and sensing, as well as wider applications in modeling DNP processes in the multiple nuclear spin limit.
△ Less
Submitted 17 October, 2021; v1 submitted 12 October, 2021;
originally announced October 2021.
-
Floquet prethermalization with lifetime exceeding 90s in a bulk hyperpolarized solid
Authors:
William Beatrez,
Otto Janes,
Amala Akkiraju,
Arjun Pillai,
Alexander Oddo,
Paul Reshetikhin,
Emanuel Druga,
Maxwell McAllister,
Mark Elo,
Benjamin Gilbert,
Dieter Suter,
Ashok Ajoy
Abstract:
We report the observation of long-lived Floquet prethermal states in a bulk solid composed of dipolar-coupled $^{13}$C nuclei in diamond at room temperature. For precessing nuclear spins prepared in an initial transverse state, we demonstrate pulsed spin-lock Floquet control that prevents their decay over multiple-minute long periods. We observe Floquet prethermal lifetimes $T_2'\approx$90.9s, ext…
▽ More
We report the observation of long-lived Floquet prethermal states in a bulk solid composed of dipolar-coupled $^{13}$C nuclei in diamond at room temperature. For precessing nuclear spins prepared in an initial transverse state, we demonstrate pulsed spin-lock Floquet control that prevents their decay over multiple-minute long periods. We observe Floquet prethermal lifetimes $T_2'\approx$90.9s, extended >60,000-fold over the nuclear free induction decay times. The spins themselves are continuously interrogated for $\sim$10min, corresponding to the application of $\approx$5.8M control pulses. The $^{13}$C nuclei are optically hyperpolarized by lattice Nitrogen Vacancy (NV) centers; the combination of hyperpolarization and continuous spin readout yields significant signal-to-noise in the measurements. This allows probing the Floquet thermalization dynamics with unprecedented clarity. We identify four characteristic regimes of the thermalization process, discerning short-time transient processes leading to the prethermal plateau, and long-time system heating towards infinite temperature. This work points to new opportunities possible via Floquet control in networks of dilute, randomly distributed, low-sensitivity nuclei. In particular, the combination of minutes-long prethermal lifetimes and continuous spin interrogation opens avenues for quantum sensors constructed from hyperpolarized Floquet prethermal nuclei.
△ Less
Submitted 24 May, 2021; v1 submitted 5 April, 2021;
originally announced April 2021.
-
Personalized Step Counting Using Wearable Sensors: A Domain Adapted LSTM Network Approach
Authors:
Arvind Pillai,
Halsey Lea,
Faisal Khan,
Glynn Dennis
Abstract:
Activity monitors are widely used to measure various physical activities (PA) as an indicator of mobility, fitness and general health. Similarly, real-time monitoring of longitudinal trends in step count has significant clinical potential as a personalized measure of disease related changes in daily activity. However, inconsistent step count accuracy across vendors, body locations, and individual…
▽ More
Activity monitors are widely used to measure various physical activities (PA) as an indicator of mobility, fitness and general health. Similarly, real-time monitoring of longitudinal trends in step count has significant clinical potential as a personalized measure of disease related changes in daily activity. However, inconsistent step count accuracy across vendors, body locations, and individual gait differences limits clinical utility. The tri-axial accelerometer inside PA monitors can be exploited to improve step count accuracy across devices and individuals. In this study, we hypothesize: (1) raw tri-axial sensor data can be modeled to create reliable and accurate step count, and (2) a generalized step count model can then be efficiently adapted to each unique gait pattern using very little new data. Firstly, open-source raw sensor data was used to construct a long short term memory (LSTM) deep neural network to model step count. Then we generated a new, fully independent data set using a different device and different subjects. Finally, a small amount of subject-specific data was domain adapted to produce personalized models with high individualized step count accuracy. These results suggest models trained using large freely available datasets can be adapted to patient populations where large historical data sets are rare.
△ Less
Submitted 11 December, 2020;
originally announced December 2020.
-
Receptivity of an AI Cognitive Assistant by the Radiology Community: A Report on Data Collected at RSNA
Authors:
Karina Kanjaria,
Anup Pillai,
Chaitanya Shivade,
Marina Bendersky,
Ashutosh Jadhav,
Vandana Mukherjee,
Tanveer Syeda-Mahmood
Abstract:
Due to advances in machine learning and artificial intelligence (AI), a new role is emerging for machines as intelligent assistants to radiologists in their clinical workflows. But what systematic clinical thought processes are these machines using? Are they similar enough to those of radiologists to be trusted as assistants? A live demonstration of such a technology was conducted at the 2016 Scie…
▽ More
Due to advances in machine learning and artificial intelligence (AI), a new role is emerging for machines as intelligent assistants to radiologists in their clinical workflows. But what systematic clinical thought processes are these machines using? Are they similar enough to those of radiologists to be trusted as assistants? A live demonstration of such a technology was conducted at the 2016 Scientific Assembly and Annual Meeting of the Radiological Society of North America (RSNA). The demonstration was presented in the form of a question-answering system that took a radiology multiple choice question and a medical image as inputs. The AI system then demonstrated a cognitive workflow, involving text analysis, image analysis, and reasoning, to process the question and generate the most probable answer. A post demonstration survey was made available to the participants who experienced the demo and tested the question answering system. Of the reported 54,037 meeting registrants, 2,927 visited the demonstration booth, 1,991 experienced the demo, and 1,025 completed a post-demonstration survey. In this paper, the methodology of the survey is shown and a summary of its results are presented. The results of the survey show a very high level of receptiveness to cognitive computing technology and artificial intelligence among radiologists.
△ Less
Submitted 13 September, 2020;
originally announced September 2020.
-
Chest X-ray Report Generation through Fine-Grained Label Learning
Authors:
Tanveer Syeda-Mahmood,
Ken C. L. Wong,
Yaniv Gur,
Joy T. Wu,
Ashutosh Jadhav,
Satyananda Kashyap,
Alexandros Karargyris,
Anup Pillai,
Arjun Sharma,
Ali Bin Syed,
Orest Boyko,
Mehdi Moradi
Abstract:
Obtaining automated preliminary read reports for common exams such as chest X-rays will expedite clinical workflows and improve operational efficiencies in hospitals. However, the quality of reports generated by current automated approaches is not yet clinically acceptable as they cannot ensure the correct detection of a broad spectrum of radiographic findings nor describe them accurately in terms…
▽ More
Obtaining automated preliminary read reports for common exams such as chest X-rays will expedite clinical workflows and improve operational efficiencies in hospitals. However, the quality of reports generated by current automated approaches is not yet clinically acceptable as they cannot ensure the correct detection of a broad spectrum of radiographic findings nor describe them accurately in terms of laterality, anatomical location, severity, etc. In this work, we present a domain-aware automatic chest X-ray radiology report generation algorithm that learns fine-grained description of findings from images and uses their pattern of occurrences to retrieve and customize similar reports from a large report database. We also develop an automatic labeling algorithm for assigning such descriptors to images and build a novel deep learning network that recognizes both coarse and fine-grained descriptions of findings. The resulting report generation algorithm significantly outperforms the state of the art using established score metrics.
△ Less
Submitted 27 July, 2020;
originally announced July 2020.
-
A robust network architecture to detect normal chest X-ray radiographs
Authors:
Ken C. L. Wong,
Mehdi Moradi,
Joy Wu,
Anup Pillai,
Arjun Sharma,
Yaniv Gur,
Hassan Ahmad,
Minnekanti Sunil Chowdary,
Chiranjeevi J,
Kiran Kumar Reddy Polaka,
Venkateswar Wunnava,
DC Reddy,
Tanveer Syeda-Mahmood
Abstract:
We propose a novel deep neural network architecture for normalcy detection in chest X-ray images. This architecture treats the problem as fine-grained binary classification in which the normal cases are well-defined as a class while leaving all other cases in the broad class of abnormal. It employs several components that allow generalization and prevent overfitting across demographics. The model…
▽ More
We propose a novel deep neural network architecture for normalcy detection in chest X-ray images. This architecture treats the problem as fine-grained binary classification in which the normal cases are well-defined as a class while leaving all other cases in the broad class of abnormal. It employs several components that allow generalization and prevent overfitting across demographics. The model is trained and validated on a large public dataset of frontal chest X-ray images. It is then tested independently on images from a clinical institution of differing patient demographics using a three radiologist consensus for ground truth labeling. The model provides an area under ROC curve of 0.96 when tested on 1271 images. We can automatically remove nearly a third of disease-free chest X-ray screening images from the workflow, without introducing any false negatives (100% sensitivity to disease) thus raising the potential of expediting radiology workflows in hospitals in future.
△ Less
Submitted 13 April, 2020;
originally announced April 2020.
-
Building a Benchmark Dataset and Classifiers for Sentence-Level Findings in AP Chest X-rays
Authors:
Tanveer Syeda-Mahmood,
Hassan M. Ahmad,
Nadeem Ansari,
Yaniv Gur,
Satyananda Kashyap,
Alexandros Karargyris,
Mehdi Moradi,
Anup Pillai,
Karthik Sheshadri,
Weiting Wang,
Ken C. L. Wong,
Joy T. Wu
Abstract:
Chest X-rays are the most common diagnostic exams in emergency rooms and hospitals. There has been a surge of work on automatic interpretation of chest X-rays using deep learning approaches after the availability of large open source chest X-ray dataset from NIH. However, the labels are not sufficiently rich and descriptive for training classification tools. Further, it does not adequately address…
▽ More
Chest X-rays are the most common diagnostic exams in emergency rooms and hospitals. There has been a surge of work on automatic interpretation of chest X-rays using deep learning approaches after the availability of large open source chest X-ray dataset from NIH. However, the labels are not sufficiently rich and descriptive for training classification tools. Further, it does not adequately address the findings seen in Chest X-rays taken in anterior-posterior (AP) view which also depict the placement of devices such as central vascular lines and tubes. In this paper, we present a new chest X-ray benchmark database of 73 rich sentence-level descriptors of findings seen in AP chest X-rays. We describe our method of obtaining these findings through a semi-automated ground truth generation process from crowdsourcing of clinician annotations. We also present results of building classifiers for these findings that show that such higher granularity labels can also be learned through the framework of deep learning classifiers.
△ Less
Submitted 21 June, 2019;
originally announced June 2019.
-
Map** the Human Body at Cellular Resolution -- The NIH Common Fund Human BioMolecular Atlas Program
Authors:
Michael P Snyder,
Shin Lin,
Amanda Posgai,
Mark Atkinson,
Aviv Regev,
Jennifer Rood,
Orit Rosen,
Leslie Gaffney,
Anna Hupalowska,
Rahul Satija,
Nils Gehlenborg,
Jay Shendure,
Julia Laskin,
Pehr Harbury,
Nicholas A Nystrom,
Ziv Bar-Joseph,
Kun Zhang,
Katy Börner,
Yiing Lin,
Richard Conroy,
Dena Procaccini,
Ananda L Roy,
Ajay Pillai,
Marishka Brown,
Zorina S Galis
Abstract:
Transformative technologies are enabling the construction of three dimensional (3D) maps of tissues with unprecedented spatial and molecular resolution. Over the next seven years, the NIH Common Fund Human Biomolecular Atlas Program (HuBMAP) intends to develop a widely accessible framework for comprehensively map** the human body at single-cell resolution by supporting technology development, da…
▽ More
Transformative technologies are enabling the construction of three dimensional (3D) maps of tissues with unprecedented spatial and molecular resolution. Over the next seven years, the NIH Common Fund Human Biomolecular Atlas Program (HuBMAP) intends to develop a widely accessible framework for comprehensively map** the human body at single-cell resolution by supporting technology development, data acquisition, and detailed spatial map**. HuBMAP will integrate its efforts with other funding agencies, programs, consortia, and the biomedical research community at large towards the shared vision of a comprehensive, accessible 3D molecular and cellular atlas of the human body, in health and various disease settings.
△ Less
Submitted 7 June, 2019; v1 submitted 17 March, 2019;
originally announced March 2019.