-
Training and Validating a Treatment Recommender with Partial Verification Evidence
Authors:
Vishnu Unnikrishnan,
Clara Puga,
Miro Schleicher,
Uli Niemann,
Berthod Langguth,
Stefan Schoisswohl,
Birgit Mazurek,
Rilana Cima,
Jose Antonio Lopez-Escamez,
Dimitris Kikidis,
Eleftheria Vellidou,
Ruediger Pryss,
Winfried Schlee,
Myra Spiliopoulou
Abstract:
Current clinical decision support systems (DSS) are trained and validated on observational data from the target clinic. This is problematic for treatments validated in a randomized clinical trial (RCT), but not yet introduced in any clinic. In this work, we report on a method for training and validating the DSS using the RCT data. The key challenges we address are of missingness -- missing rationa…
▽ More
Current clinical decision support systems (DSS) are trained and validated on observational data from the target clinic. This is problematic for treatments validated in a randomized clinical trial (RCT), but not yet introduced in any clinic. In this work, we report on a method for training and validating the DSS using the RCT data. The key challenges we address are of missingness -- missing rationale for treatment assignment (the assignment is at random), and missing verification evidence, since the effectiveness of a treatment for a patient can only be verified (ground truth) for treatments what were actually assigned to a patient. We use data from a multi-armed RCT that investigated the effectiveness of single- and combination- treatments for 240+ tinnitus patients recruited and treated in 5 clinical centers.
To deal with the 'missing rationale' challenge, we re-model the target variable (outcome) in order to suppress the effect of the randomly-assigned treatment, and control on the effect of treatment in general. Our methods are also robust to missing values in features and with a small number of patients per RCT arm. We deal with 'missing verification evidence' by using counterfactual treatment verification, which compares the effectiveness of the DSS recommendations to the effectiveness of the RCT assignments when they are aligned v/s not aligned.
We demonstrate that our approach leverages the RCT data for learning and verification, by showing that the DSS suggests treatments that improve the outcome. The results are limited through the small number of patients per treatment; while our ensemble is designed to mitigate this effect, the predictive performance of the methods is affected by the smallness of the data. We provide a basis for the establishment of decision supporting routines on treatments that have been tested in RCTs but have not yet been deployed clinically.
△ Less
Submitted 10 June, 2024;
originally announced June 2024.
-
Social Media App Usage in Relation with PHQ-9 Depression Scores during the COVID-19 Pandemic
Authors:
Lena Mulansky,
Rüdiger Pryss,
Caroline Cohrdes,
Harald Baumeister,
Felix Beierle
Abstract:
With about 300 million affected people, major depressive disorder (MDD) is one of the most common diseases worldwide. During the COVID-19 pandemic, the number of cases increased even further, by 28%. Many factors may be correlated with MDD, including the excessive use of social media apps. In this paper, we investigated the relationship between the use of social media and communication apps and de…
▽ More
With about 300 million affected people, major depressive disorder (MDD) is one of the most common diseases worldwide. During the COVID-19 pandemic, the number of cases increased even further, by 28%. Many factors may be correlated with MDD, including the excessive use of social media apps. In this paper, we investigated the relationship between the use of social media and communication apps and depressive symptoms during the COVID-19 pandemic. The pandemic and social distancing like lockdowns probably changed smartphone usage times and usage patterns. While previous studies have shown an association between depression and social media usage, we report about the situation during these special circumstances.We employed a log-linear regression to examine the association of social media and communication app usage and depression. To quantify the usage, we applied the total usage time in hours of social media apps (e.g., WhatsApp, Facebook) as well as communication apps (Phone and Messaging) within one week. To measure depressive symptoms, we used the PHQ-9 score. We discovered a significant association between the usage time and the PHQ-9 score (beta=0.0084, p-value=0.010). We conclude that social media usage is a robust marker for depression severity and future research should focus on a better understanding of the underlying causality and potential counter-measures.
△ Less
Submitted 17 October, 2022;
originally announced October 2022.
-
Defining Gaze Patterns for Process Model Literacy -- Exploring Visual Routines in Process Models with Diverse Map**s
Authors:
Michael Winter,
Heiko Neumann,
Rüdiger Pryss,
Thomas Probst,
Manfred Reichert
Abstract:
Process models depict crucial artifacts for organizations regarding documentation, communication, and collaboration. The proper comprehension of such models is essential for an effective application. An important aspect in process model literacy constitutes the question how the information presented in process models is extracted and processed by the human visual system? For such visuospatial task…
▽ More
Process models depict crucial artifacts for organizations regarding documentation, communication, and collaboration. The proper comprehension of such models is essential for an effective application. An important aspect in process model literacy constitutes the question how the information presented in process models is extracted and processed by the human visual system? For such visuospatial tasks, the visual system deploys a set of elemental operations, from whose compositions different visual routines are produced. This paper provides insights from an exploratory eye tracking study, in which visual routines during process model comprehension were contemplated. More specifically, n = 29 participants were asked to comprehend n = 18 process models expressed in the Business Process Model and Notation 2.0 reflecting diverse map**s (i.e., straight, upward, downward) and complexity levels. The performance measures indicated that even less complex process models pose a challenge regarding their comprehension. The upward map** confronted participants' attention with more challenges, whereas the downward map** was comprehended more effectively. Based on recorded eye movements, three gaze patterns applied during model comprehension were derived. Thereupon, we defined a general model which identifies visual routines and corresponding elemental operations during process model comprehension. Finally, implications for practice as well as research and directions for future work are discussed in this paper.
△ Less
Submitted 30 November, 2021; v1 submitted 4 November, 2021;
originally announced November 2021.
-
UNITI Mobile -- EMI-Apps for a Large-Scale European Study on Tinnitus
Authors:
Carsten Vogel,
Johannes Schobel,
Winfried Schlee,
Milena Engelke,
Rüdiger Pryss
Abstract:
More and more observational studies exploit the achievements of mobile technology to ease the overall implementation procedure. Many strategies like digital phenoty**, ecological momentary assessments or mobile crowdsensing are used in this context. Recently, an increasing number of intervention studies makes use of mobile technology as well. For the chronic disorder tinnitus, only few long-runn…
▽ More
More and more observational studies exploit the achievements of mobile technology to ease the overall implementation procedure. Many strategies like digital phenoty**, ecological momentary assessments or mobile crowdsensing are used in this context. Recently, an increasing number of intervention studies makes use of mobile technology as well. For the chronic disorder tinnitus, only few long-running intervention studies exist, which use mobile technology in a larger setting. Tinnitus is characterized by its heterogeneous patient's symptom profiles, which complicates the development of general treatments. In the UNITI project, researchers from different European countries try to unify existing treatments and interventions to cope with this heterogeneity. One study arm (UNITI Mobile) exploits mobile technology to investigate newly implemented interventions types, especially within the pan-European setting. The goals are to learn more about the validity and usefulness of mobile technology in this context. Furthermore, differences among the countries shall be investigated. Practically, two native intervention apps have been developed for UNITI and the mobile study arm, which pose features not presented so far in other apps of the authors. Along the implementation procedure, it is discussed whether these features might leverage similar types of studies in future. Since instruments like the mHealth evidence reporting and assessment checklist (mERA), developed by the WHO mHealth technical evidence review group, indicate that aspects shown for UNITI Mobile are important in the context of health interventions using mobile phones, our findings may be of a more general interest and are therefore being discussed in the work at hand.
△ Less
Submitted 22 July, 2021;
originally announced July 2021.
-
Are Non-Experts Able to Comprehend Business Process Models -- Study Insights Involving Novices and Experts
Authors:
Michael Winter,
Rüdiger Pryss,
Thomas Probst,
Winfried Schlee,
Miles Tallon,
Ulrich Frick,
Manfred Reichert
Abstract:
The comprehension of business process models is crucial for enterprises. Prior research has shown that children as well as adolescents perceive and interpret graphical representations in a different manner compared to grown-ups. To evaluate this, observations in the context of business process models are presented in this paper obtained from a study on visual literacy in cultural education. We dem…
▽ More
The comprehension of business process models is crucial for enterprises. Prior research has shown that children as well as adolescents perceive and interpret graphical representations in a different manner compared to grown-ups. To evaluate this, observations in the context of business process models are presented in this paper obtained from a study on visual literacy in cultural education. We demonstrate that adolescents without expertise in process model comprehension are able to correctly interpret business process models expressed in terms of BPMN 2.0. In a comprehensive study, n = 205 learners (i.e., pupils at the age of 15) needed to answer questions related to process models they were confronted with, reflecting different levels of complexity. In addition, process models were created with varying styles of element labels. Study results indicate that an abstract description (i.e., using only alphabetic letters) of process models is understood more easily compared to concrete or pseudo} descriptions. As benchmark, results are compared with the ones of modeling experts (n = 40). Amongst others, study findings suggest using abstract descriptions in order to introduce novices to process modeling notations. With the obtained insights, we highlight that process models can be properly comprehended by novices.
△ Less
Submitted 6 July, 2021; v1 submitted 2 July, 2021;
originally announced July 2021.
-
Towards Measuring and Quantifying the Comprehensibility of Process Models -- The Process Model Comprehension Framework
Authors:
Michael Winter,
Rüdiger Pryss,
Matthias Fink,
Manfred Reichert
Abstract:
Process models constitute crucial artifacts in modern information systems and, hence, the proper comprehension of these models is of utmost importance in the utilization of such systems. Generally, process models are considered from two different perspectives: process modelers and readers. Both perspectives share similarities and differences in the comprehension of process models (e.g., diverse ex…
▽ More
Process models constitute crucial artifacts in modern information systems and, hence, the proper comprehension of these models is of utmost importance in the utilization of such systems. Generally, process models are considered from two different perspectives: process modelers and readers. Both perspectives share similarities and differences in the comprehension of process models (e.g., diverse experiences when working with process models). The literature proposed many rules and guidelines to ensure a proper comprehension of process models for both perspectives. As a novel contribution in this context, this paper introduces the Process Model Comprehension Framework (PMCF) as a first step towards the measurement and quantification of the perspectives of process modelers and readers as well as the interaction of both regarding the comprehension of process models. Therefore, the PMCF describes an Evaluation Theory Tree based on the Communication Theory as well as the Conceptual Modeling Quality Framework and considers a total of 96 quality metrics in order to quantify process model comprehension. Furthermore, the PMCF was evaluated in a survey with 131 participants and has been implemented as well as applied successfully in a practical case study including 33 participants. To conclude, the PMCF allows for the identification of pitfalls and provides related information about how to assist process modelers as well as readers in order to foster and enable a proper comprehension of process models.
△ Less
Submitted 24 June, 2021;
originally announced June 2021.
-
Corona Health -- A Study- and Sensor-based Mobile App Platform Exploring Aspects of the COVID-19 Pandemic
Authors:
Felix Beierle,
Johannes Schobel,
Carsten Vogel,
Johannes Allgaier,
Lena Mulansky,
Fabian Haug,
Julian Haug,
Winfried Schlee,
Marc Holfelder,
Michael Stach,
Marc Schickler,
Harald Baumeister,
Caroline Cohrdes,
Jürgen Deckert,
Lorenz Deserno,
Johanna-Sophie Edler,
Felizitas A. Eichner,
Helmut Greger,
Grit Hein,
Peter Heuschmann,
Dennis John,
Hans A. Kestler,
Dagmar Krefting,
Berthold Langguth,
Patrick Meybohm
, et al. (7 additional authors not shown)
Abstract:
Physical and mental well-being during the COVID-19 pandemic is typically assessed via surveys, which might make it difficult to conduct longitudinal studies and might lead to data suffering from recall bias. Ecological momentary assessment (EMA) driven smartphone apps can help alleviate such issues, allowing for in situ recordings. Implementing such an app is not trivial, necessitates strict regul…
▽ More
Physical and mental well-being during the COVID-19 pandemic is typically assessed via surveys, which might make it difficult to conduct longitudinal studies and might lead to data suffering from recall bias. Ecological momentary assessment (EMA) driven smartphone apps can help alleviate such issues, allowing for in situ recordings. Implementing such an app is not trivial, necessitates strict regulatory and legal requirements, and requires short development cycles to appropriately react to abrupt changes in the pandemic. Based on an existing app framework, we developed Corona Health, an app that serves as a platform for deploying questionnaire-based studies in combination with recordings of mobile sensors. In this paper, we present the technical details of Corona Health and provide first insights into the collected data. Through collaborative efforts from experts from public health, medicine, psychology, and computer science, we released Corona Health publicly on Google Play and the Apple App Store (in July, 2020) in 8 languages and attracted 7,290 installations so far. Currently, five studies related to physical and mental well-being are deployed and 17,241 questionnaires have been filled out. Corona Health proves to be a viable tool for conducting research related to the COVID-19 pandemic and can serve as a blueprint for future EMA-based studies. The data we collected will substantially improve our knowledge on mental and physical health states, traits and trajectories as well as its risk and protective factors over the course of the COVID-19 pandemic and its diverse prevention measures.
△ Less
Submitted 6 July, 2021; v1 submitted 7 June, 2021;
originally announced June 2021.
-
Medical device regulation efforts for mHealth apps -- An experience report of Corona Check and Corona Health
Authors:
Marc Holfelder,
Lena Mulansky,
Winfried Schlee,
Harald Baumeister,
Johannes Schobel,
Helmut Greger,
Andreas Hoff,
Rüdiger Pryss
Abstract:
Within the healthcare environment, mobile health (mHealth) applications (apps) are more and more important. The number of new mHealth apps has risen steadily in the last years. Especially the Covid-19 pandemic has led to an enormous amount of app releases. Notably, in most countries, mHealth applications have to be already compliant with several regulatory aspects in order to be declared to be a '…
▽ More
Within the healthcare environment, mobile health (mHealth) applications (apps) are more and more important. The number of new mHealth apps has risen steadily in the last years. Especially the Covid-19 pandemic has led to an enormous amount of app releases. Notably, in most countries, mHealth applications have to be already compliant with several regulatory aspects in order to be declared to be a 'medical app'. However, the latest applicable medical device regulation (MDR) does not comment in more detail on the topic of the requirements for mHealth applications. When develo** a medical app, it is essential that all contributors in an interdisciplinary team - especially the software engineers - are aware of the specific regulatory requirements beforehand. The development process, however, should not be stalled too long due to the integration of the MDR. Therefore, a develo** framework, which includes these aspects, is required, to enable a smooth development process. The paper at hand introduces the creation of such a framework on the basis of the Corona Health and Corona Check apps. The relevant regulatory guidelines are listed and summarized to a guidance for medical app developments. In particular, the important stages and faced challenges emerged during the entire development process are highlighted.
△ Less
Submitted 28 April, 2021;
originally announced April 2021.
-
Public Perception of the German COVID-19 Contact-Tracing App Corona-Warn-App
Authors:
Felix Beierle,
Uttam Dhakal,
Caroline Cohrdes,
Sophie Eicher,
Rüdiger Pryss
Abstract:
Several governments introduced or promoted the use of contact-tracing apps during the ongoing COVID-19 pandemic. In Germany, the related app is called Corona-Warn-App, and by end of 2020, it had 22.8 million downloads. Contact tracing is a promising approach for containing the spread of the novel coronavirus. It is only effective if there is a large user base, which brings new challenges like app…
▽ More
Several governments introduced or promoted the use of contact-tracing apps during the ongoing COVID-19 pandemic. In Germany, the related app is called Corona-Warn-App, and by end of 2020, it had 22.8 million downloads. Contact tracing is a promising approach for containing the spread of the novel coronavirus. It is only effective if there is a large user base, which brings new challenges like app users unfamiliar with using smartphones or apps. As Corona-Warn-App is voluntary to use, reaching many users and gaining a positive public perception is crucial for its effectiveness. Based on app reviews and tweets, we are analyzing the public perception of Corona-Warn-App. We collected and analyzed all 78,963 app reviews for the Android and iOS versions from release (June 2020) to beginning of February 2021, as well as all original tweets until February 2021 containing #CoronaWarnApp (43,082). For the reviews, the most common words and n-grams point towards technical issues, but it remains unclear, to what extent this is due to the app itself, the used Exposure Notification Framework, system settings on the user's phone, or the user's misinterpretations of app content. For Twitter data, overall, based on tweet content, frequent hashtags, and interactions with tweets, we conclude that the German Twitter-sphere widely reports adopting the app and promotes its use.
△ Less
Submitted 21 April, 2021;
originally announced April 2021.
-
Develo** Apps for Researching the COVID-19 Pandemic with the TrackYourHealth Platform
Authors:
Carsten Vogel,
Rüdiger Pryss,
Johannes Schobel,
Winfried Schlee,
Felix Beierle
Abstract:
Through lockdowns and other severe changes to daily life, almost everyone is affected by the COVID-19 pandemic. Scientists and medical doctors are - among others - mainly interested in researching, monitoring, and improving physical and mental health of the general population. Mobile health apps (mHealth), and apps conducting ecological momentary assessments (EMA) respectively, can help in this co…
▽ More
Through lockdowns and other severe changes to daily life, almost everyone is affected by the COVID-19 pandemic. Scientists and medical doctors are - among others - mainly interested in researching, monitoring, and improving physical and mental health of the general population. Mobile health apps (mHealth), and apps conducting ecological momentary assessments (EMA) respectively, can help in this context. However, develo** such mobile applications poses many challenges like costly software development efforts, strict privacy rules, compliance with ethical guidelines, local laws, and regulations. In this paper, we present TrackYourHealth (TYH), a highly configurable, generic, and modular mobile data collection and EMA platform, which enabled us to develop and release two mobile multi-platform applications related to COVID-19 in just a few weeks. We present TYH and highlight specific challenges researchers and developers of similar apps may also face, especially when develo** apps related to the medical field.
△ Less
Submitted 25 March, 2021;
originally announced March 2021.
-
Detecting Production Phases Based on Sensor Values using 1D-CNNs
Authors:
Burkhard Hoppenstedt,
Manfred Reichert,
Ghada El-Khawaga,
Klaus Kammerer,
Karl-Michael Winter,
Rüdiger Pryss
Abstract:
In the context of Industry 4.0, the knowledge extraction from sensor information plays an important role. Often, information gathered from sensor values reveals meaningful insights for production levels, such as anomalies or machine states. In our use case, we identify production phases through the inspection of sensor values with the help of convolutional neural networks. The data set stems from…
▽ More
In the context of Industry 4.0, the knowledge extraction from sensor information plays an important role. Often, information gathered from sensor values reveals meaningful insights for production levels, such as anomalies or machine states. In our use case, we identify production phases through the inspection of sensor values with the help of convolutional neural networks. The data set stems from a tempering furnace used for metal heat treating. Our supervised learning approach unveils a promising accuracy for the chosen neural network that was used for the detection of production phases. We consider solutions like shown in this work as salient pillars in the field of predictive maintenance.
△ Less
Submitted 23 April, 2020;
originally announced April 2020.
-
Context Data Categories and Privacy Model for Mobile Data Collection Apps
Authors:
Felix Beierle,
Vinh Thuy Tran,
Mathias Allemand,
Patrick Neff,
Winfried Schlee,
Thomas Probst,
Rüdiger Pryss,
Johannes Zimmermann
Abstract:
Context-aware applications stemming from diverse fields like mobile health, recommender systems, and mobile commerce potentially benefit from knowing aspects of the user's personality. As filling out personality questionnaires is tedious, we propose the prediction of the user's personality from smartphone sensor and usage data. In order to collect data for researching the relationship between smar…
▽ More
Context-aware applications stemming from diverse fields like mobile health, recommender systems, and mobile commerce potentially benefit from knowing aspects of the user's personality. As filling out personality questionnaires is tedious, we propose the prediction of the user's personality from smartphone sensor and usage data. In order to collect data for researching the relationship between smartphone data and personality, we developed the Android app TYDR (Track Your Daily Routine) which tracks smartphone data and utilizes psychometric personality questionnaires. With TYDR, we track a larger variety of smartphone data than similar existing apps, including metadata on notifications, photos taken, and music played back by the user. For the development of TYDR, we introduce a general context data model consisting of four categories that focus on the user's different types of interactions with the smartphone: physical conditions and activity, device status and usage, core functions usage, and app usage. On top of this, we develop the privacy model PM-MoDaC specifically for apps related to the collection of mobile data, consisting of nine proposed privacy measures. We present the implementation of all of those measures in TYDR. Although the utilization of the user's personality based on the usage of his or her smartphone is a challenging endeavor, it seems to be a promising approach for various types of context-aware mobile applications.
△ Less
Submitted 4 July, 2018;
originally announced July 2018.
-
TYDR - Track Your Daily Routine. Android App for Tracking Smartphone Sensor and Usage Data
Authors:
Felix Beierle,
Vinh Thuy Tran,
Mathias Allemand,
Patrick Neff,
Winfried Schlee,
Thomas Probst,
Rüdiger Pryss,
Johannes Zimmermann
Abstract:
We present the Android app TYDR (Track Your Daily Routine) which tracks smartphone sensor and usage data and utilizes standardized psychometric personality questionnaires. With the app, we aim at collecting data for researching correlations between the tracked smartphone data and the user's personality in order to predict personality from smartphone data. In this paper, we highlight our approaches…
▽ More
We present the Android app TYDR (Track Your Daily Routine) which tracks smartphone sensor and usage data and utilizes standardized psychometric personality questionnaires. With the app, we aim at collecting data for researching correlations between the tracked smartphone data and the user's personality in order to predict personality from smartphone data. In this paper, we highlight our approaches in addressing the challenges in develo** such an app. We optimize the tracking of sensor data by assessing the trade-off of size of data and battery consumption and granularity of the stored information. Our user interface is designed to incentivize users to install the app and fill out questionnaires. TYDR processes and visualizes the tracked sensor and usage data as well as the results of the personality questionnaires. When develo** an app that will be used in psychological studies, requirements posed by ethics commissions / institutional review boards and data protection officials have to be met. We detail our approaches concerning those requirements regarding the anonymized storing of user data, informing the users about the data collection, and enabling an opt-out option. We present our process for anonymized data storing while still being able to identify individual users who successfully completed a psychological study with the app.
△ Less
Submitted 18 March, 2018;
originally announced March 2018.
