Showing 1–13 of 13 results for author: Rucker, M

Personalized State Anxiety Detection: An Empirical Study with Linguistic Biomarkers and A Machine Learning Pipeline

Authors: Zhiyuan Wang, Mingyue Tang, Maria A. Larrazabal, Emma R. Toner, Mark Rucker, Congyu Wu, Bethany A. Teachman, Mehdi Boukhechba, Laura E. Barnes

Abstract: Individuals high in social anxiety symptoms often exhibit elevated state anxiety in social situations. Research has shown it is possible to detect state anxiety by leveraging digital biomarkers and machine learning techniques. However, most existing work trains models on an entire group of participants, failing to capture individual differences in their psychological and behavioral responses to so… ▽ More Individuals high in social anxiety symptoms often exhibit elevated state anxiety in social situations. Research has shown it is possible to detect state anxiety by leveraging digital biomarkers and machine learning techniques. However, most existing work trains models on an entire group of participants, failing to capture individual differences in their psychological and behavioral responses to social contexts. To address this concern, in Study 1, we collected linguistic data from N=35 high socially anxious participants in a variety of social contexts, finding that digital linguistic biomarkers significantly differ between evaluative vs. non-evaluative social contexts and between individuals having different trait psychological symptoms, suggesting the likely importance of personalized approaches to detect state anxiety. In Study 2, we used the same data and results from Study 1 to model a multilayer personalized machine learning pipeline to detect state anxiety that considers contextual and individual differences. This personalized model outperformed the baseline F1-score by 28.0%. Results suggest that state anxiety can be more accurately detected with personalized machine learning approaches, and that linguistic biomarkers hold promise for identifying periods of state anxiety in an unobtrusive way. △ Less

Submitted 19 April, 2023; originally announced April 2023.

Comments: IEEE EMBC 2023

Wearable Sensor-based Multimodal Physiological Responses of Socially Anxious Individuals across Social Contexts

Authors: Emma R. Toner, Mark Rucker, Zhiyuan Wang, Maria A. Larrazabal, Lihua Cai, Debajyoti Datta, Elizabeth Thompson, Haroon Lone, Mehdi Boukhechba, Bethany A. Teachman, Laura E. Barnes

Abstract: Correctly identifying an individual's social context from passively worn sensors holds promise for delivering just-in-time adaptive interventions (JITAIs) to treat social anxiety disorder. In this study, we present results using passively collected data from a within-subject experiment that assessed physiological response across different social contexts (i.e, alone vs. with others), social phases… ▽ More Correctly identifying an individual's social context from passively worn sensors holds promise for delivering just-in-time adaptive interventions (JITAIs) to treat social anxiety disorder. In this study, we present results using passively collected data from a within-subject experiment that assessed physiological response across different social contexts (i.e, alone vs. with others), social phases (i.e., pre- and post-interaction vs. during an interaction), social interaction sizes (i.e., dyadic vs. group interactions), and levels of social threat (i.e., implicit vs. explicit social evaluation). Participants in the study ($N=46$) reported moderate to severe social anxiety symptoms as assessed by the Social Interaction Anxiety Scale ($\geq$34 out of 80). Univariate paired difference tests, multivariate random forest models, and follow-up cluster analyses were used to explore physiological response patterns across different social and non-social contexts. Our results suggest that social context is more reliably distinguishable than social phase, group size, or level of social threat, but that there is considerable variability in physiological response patterns even among these distinguishable contexts. Implications for real-world context detection and deployment of JITAIs are discussed. △ Less

Submitted 3 April, 2023; originally announced April 2023.

Infinite Action Contextual Bandits with Reusable Data Exhaust

Authors: Mark Rucker, Yinglun Zhu, Paul Mineiro

Abstract: For infinite action contextual bandits, smoothed regret and reduction to regression results in state-of-the-art online performance with computational cost independent of the action set: unfortunately, the resulting data exhaust does not have well-defined importance-weights. This frustrates the execution of downstream data science processes such as offline model selection. In this paper we describe… ▽ More For infinite action contextual bandits, smoothed regret and reduction to regression results in state-of-the-art online performance with computational cost independent of the action set: unfortunately, the resulting data exhaust does not have well-defined importance-weights. This frustrates the execution of downstream data science processes such as offline model selection. In this paper we describe an online algorithm with an equivalent smoothed regret guarantee, but which generates well-defined importance weights: in exchange, the online computational cost increases, but only to order smoothness (i.e., still independent of the action set). This removes a key obstacle to adoption of smoothed regret in production scenarios. △ Less

Submitted 7 June, 2023; v1 submitted 16 February, 2023; originally announced February 2023.

Comments: Final version after responding to reviewers

Personalized Reward Learning with Interaction-Grounded Learning (IGL)

Authors: Jessica Maghakian, Paul Mineiro, Kishan Panaganti, Mark Rucker, Akanksha Saran, Cheng Tan

Abstract: In an era of countless content offerings, recommender systems alleviate information overload by providing users with personalized content suggestions. Due to the scarcity of explicit user feedback, modern recommender systems typically optimize for the same fixed combination of implicit feedback signals across all users. However, this approach disregards a growing body of work highlighting that (i)… ▽ More In an era of countless content offerings, recommender systems alleviate information overload by providing users with personalized content suggestions. Due to the scarcity of explicit user feedback, modern recommender systems typically optimize for the same fixed combination of implicit feedback signals across all users. However, this approach disregards a growing body of work highlighting that (i) implicit signals can be used by users in diverse ways, signaling anything from satisfaction to active dislike, and (ii) different users communicate preferences in different ways. We propose applying the recent Interaction Grounded Learning (IGL) paradigm to address the challenge of learning representations of diverse user communication modalities. Rather than requiring a fixed, human-designed reward function, IGL is able to learn personalized reward functions for different users and then optimize directly for the latent user satisfaction. We demonstrate the success of IGL with experiments using simulations as well as with real-world production traces. △ Less

Submitted 3 March, 2023; v1 submitted 28 November, 2022; originally announced November 2022.

Comments: ICLR 2023

Eigen Memory Trees

Authors: Mark Rucker, Jordan T. Ash, John Langford, Paul Mineiro, Ida Momennejad

Abstract: This work introduces the Eigen Memory Tree (EMT), a novel online memory model for sequential learning scenarios. EMTs store data at the leaves of a binary tree and route new samples through the structure using the principal components of previous experiences, facilitating efficient (logarithmic) access to relevant memories. We demonstrate that EMT outperforms existing online memory approaches, and… ▽ More This work introduces the Eigen Memory Tree (EMT), a novel online memory model for sequential learning scenarios. EMTs store data at the leaves of a binary tree and route new samples through the structure using the principal components of previous experiences, facilitating efficient (logarithmic) access to relevant memories. We demonstrate that EMT outperforms existing online memory approaches, and provide a hybridized EMT-parametric algorithm that enjoys drastically improved performance over purely parametric methods with nearly no downsides. Our findings are validated using 206 datasets from the OpenML repository in both bounded and infinite memory budget situations. △ Less

Submitted 31 October, 2022; v1 submitted 25 October, 2022; originally announced October 2022.

Comments: corrected an author name; corrected title plurality

A Quantitative Simulation-based Modeling Approach for College Counseling Centers

Authors: Sohom Chatterjee, Youssef Hebaish, Lewis Ntaimo, James Deegear, Miles Rucker, Hrayer Aprahamian

Abstract: College counseling centers in various universities have been tasked with the important responsibility of attending to the mental health needs of their students. Owing to the unprecedented recent surge of demand for such services, college counseling centers are facing several crippling resource-level challenges. This is leading to longer wait times which limits access to critical mental health serv… ▽ More College counseling centers in various universities have been tasked with the important responsibility of attending to the mental health needs of their students. Owing to the unprecedented recent surge of demand for such services, college counseling centers are facing several crippling resource-level challenges. This is leading to longer wait times which limits access to critical mental health services. To address these challenges, we construct a discrete-event simulation model that captures several intricate details of their operations and provides a data-driven framework to quantify the effect of different policy changes. In contrast to existing work on this matter, which are primarily based on qualitative assessments, the considered quantitative approach has the potential to lead to key observations that can assist counseling directors in constructing a system with desirable performance. To demonstrate the benefit of the considered simulation model, we use data specific to Texas A&M's Counseling & Psychological Services to run a series of numerical experiments. Our results demonstrate the predictive power of the simulation model, highlight a number of key observations, and identify policy changes that result in desirable system performance. △ Less

Submitted 3 June, 2022; originally announced June 2022.

Journal ref: SIMULATION. 2023;0(0)

Inverse Reinforcement Learning for Strategy Identification

Authors: Mark Rucker, Stephen Adams, Roy Hayes, Peter A. Beling

Abstract: In adversarial environments, one side could gain an advantage by identifying the opponent's strategy. For example, in combat games, if an opponents strategy is identified as overly aggressive, one could lay a trap that exploits the opponent's aggressive nature. However, an opponent's strategy is not always apparent and may need to be estimated from observations of their actions. This paper propose… ▽ More In adversarial environments, one side could gain an advantage by identifying the opponent's strategy. For example, in combat games, if an opponents strategy is identified as overly aggressive, one could lay a trap that exploits the opponent's aggressive nature. However, an opponent's strategy is not always apparent and may need to be estimated from observations of their actions. This paper proposes to use inverse reinforcement learning (IRL) to identify strategies in adversarial environments. Specifically, the contributions of this work are 1) the demonstration of this concept on gaming combat data generated from three pre-defined strategies and 2) the framework for using IRL to achieve strategy identification. The numerical experiments demonstrate that the recovered rewards can be identified using a variety of techniques. In this paper, the recovered reward are visually displayed, clustered using unsupervised learning, and classified using a supervised learner. △ Less

Submitted 31 July, 2021; originally announced August 2021.

Comments: The paper has been accepted as a regular paper in IEEE International Conference on Systems, Man, and Cybernetics (SMC), 2021

A Framework for Addressing the Risks and Opportunities In AI-Supported Virtual Health Coaches

Authors: Sonia Baee, Mark Rucker, Anna Baglione, Mawulolo K. Ameko, Laura Barnes

Abstract: Virtual coaching has rapidly evolved into a foundational component of modern clinical practice. At a time when healthcare professionals are in short supply and the demand for low-cost treatments is ever-increasing, virtual health coaches (VHCs) offer intervention-on-demand for those limited by finances or geographic access to care. More recently, AI-powered virtual coaches have become a viable com… ▽ More Virtual coaching has rapidly evolved into a foundational component of modern clinical practice. At a time when healthcare professionals are in short supply and the demand for low-cost treatments is ever-increasing, virtual health coaches (VHCs) offer intervention-on-demand for those limited by finances or geographic access to care. More recently, AI-powered virtual coaches have become a viable complement to human coaches. However, the push for AI-powered coaching systems raises several important issues for researchers, designers, clinicians, and patients. In this paper, we present a novel framework to guide the design and development of virtual coaching systems. This framework augments a traditional data science pipeline with four key guiding goals: reliability, fairness, engagement, and ethics. △ Less

Submitted 12 October, 2020; originally announced October 2020.

Comments: 4 pages

Reward Sha** for Human Learning via Inverse Reinforcement Learning

Authors: Mark A. Rucker, Layne T. Watson, Matthew S. Gerber, Laura E. Barnes

Abstract: Humans are spectacular reinforcement learners, constantly learning from and adjusting to experience and feedback. Unfortunately, this doesn't necessarily mean humans are fast learners. When tasks are challenging, learning can become unacceptably slow. Fortunately, humans do not have to learn tabula rasa, and learning speed can be greatly increased with learning aids. In this work we validate a new… ▽ More Humans are spectacular reinforcement learners, constantly learning from and adjusting to experience and feedback. Unfortunately, this doesn't necessarily mean humans are fast learners. When tasks are challenging, learning can become unacceptably slow. Fortunately, humans do not have to learn tabula rasa, and learning speed can be greatly increased with learning aids. In this work we validate a new type of learning aid -- reward sha** for humans via inverse reinforcement learning (IRL). The goal of this aid is to increase the speed with which humans can learn good policies for specific tasks. Furthermore this approach compliments alternative machine learning techniques such as safety features that try to prevent individuals from making poor decisions. To achieve our results we first extend a well known IRL algorithm via kernel methods. Afterwards we conduct two human subjects experiments using an online game where players have limited time to learn a good policy. We show with statistical significance that players who receive our learning aid are able to approach desired policies more quickly than the control group. △ Less

Submitted 15 December, 2022; v1 submitted 25 February, 2020; originally announced February 2020.

Comments: This paper has been modified considerably for resubmission to Journal of Machine Learning Research, for source code, see https://github.com/mrucker/kpirl-kla

Clamp cell with $in$ $situ$ pressure monitoring for low-temperature neutron scattering measurements

Authors: A. Podlesnyak, M. Loguillo, G. M. Rucker, B. Haberl, R. Boehler, G. Ehlers, L. L. Daemen, D. Armitage, M. D. Frontzek, M. Lumsden

Abstract: A clamp pressure cell for neutron scattering experiments at low temperatures and in external magnetic fields under pressure up to 2~GPa has been fabricated and tested. The cell provides optical access to the sample space that allows instantaneous pressure determination during sample loading, cooling and measuring using ruby and/or samarium doped strontium tetraborate fluorescence monitoring. A new… ▽ More A clamp pressure cell for neutron scattering experiments at low temperatures and in external magnetic fields under pressure up to 2~GPa has been fabricated and tested. The cell provides optical access to the sample space that allows instantaneous pressure determination during sample loading, cooling and measuring using ruby and/or samarium doped strontium tetraborate fluorescence monitoring. A new calibration curve of the pressure-induced shift of the $^7D_0 - ^5F_0$ (0-0) line in the fluorescent spectrum of SrB$_4$O$_7$:Sm$^{2+}$ for moderate pressures, $P\leqslant{2}$ GPa, is given. △ Less

Submitted 25 April, 2019; originally announced April 2019.

Comments: 11 pages, 6 figures

Journal ref: High Pressure Research, 38, 482 (2018)

Kepler-16: A Transiting Circumbinary Planet

Authors: Laurance R. Doyle, Joshua A. Carter, Daniel C. Fabrycky, Robert W. Slawson, Steve B. Howell, Joshua N. Winn, Jerome A. Orosz, Andrej Prsa, William F. Welsh, Samuel N. Quinn, David Latham, Guillermo Torres, Lars A. Buchhave, Geoffrey W. Marcy, Jonathan J. Fortney, Avi Shporer, Eric B. Ford, Jack J. Lissauer, Darin Ragozzine, Michael Rucker, Natalie Batalha, Jon M. Jenkins, William J. Borucki, David Koch, Christopher K. Middour , et al. (24 additional authors not shown)

Abstract: We report the detection of a planet whose orbit surrounds a pair of low-mass stars. Data from the Kepler spacecraft reveal transits of the planet across both stars, in addition to the mutual eclipses of the stars, giving precise constraints on the absolute dimensions of all three bodies. The planet is comparable to Saturn in mass and size, and is on a nearly circular 229-day orbit around its two p… ▽ More We report the detection of a planet whose orbit surrounds a pair of low-mass stars. Data from the Kepler spacecraft reveal transits of the planet across both stars, in addition to the mutual eclipses of the stars, giving precise constraints on the absolute dimensions of all three bodies. The planet is comparable to Saturn in mass and size, and is on a nearly circular 229-day orbit around its two parent stars. The eclipsing stars are 20% and 69% as massive as the sun, and have an eccentric 41-day orbit. The motions of all three bodies are confined to within 0.5 degree of a single plane, suggesting that the planet formed within a circumbinary disk. △ Less

Submitted 15 September, 2011; originally announced September 2011.

Comments: Science, in press; for supplemental material see http://www.sciencemag.org/content/suppl/2011/09/14/333.6049.1602.DC1/1210923.Doyle.SOM.pdf

Kepler Eclipsing Binary Stars. II. 2165 Eclipsing Binaries in the Second Data Release

Authors: Robert W. Slawson, Andrej Prsa, William F. Welsh, Jerome A. Orosz, Michael Rucker, Natalie M. Batalha, Laurance R. Doyle, Scott G. Engle, Kyle Conroy, Jared Coughlin, Trevor Ames Gregg, Tara Fetherolf, Donald R. Short, Gur Windmiller, Daniel C. Fabrycky, Steve B. Howell, Jon M. Jenkins, Kamal Uddin, Fergal Mullally, Shawn E. Seader, Susan E. Thompson, Dwight T. Sanderfer, William Borucki, David Koch

Abstract: The Kepler Mission provides nearly continuous monitoring of ~156 000 objects with unprecedented photometric precision. Coincident with the first data release, we presented a catalog of 1879 eclipsing binary systems identified within the 115 square degree Kepler FOV. Here, we provide an updated catalog augmented with the second Kepler data release which increases the baseline nearly 4-fold to 125 d… ▽ More The Kepler Mission provides nearly continuous monitoring of ~156 000 objects with unprecedented photometric precision. Coincident with the first data release, we presented a catalog of 1879 eclipsing binary systems identified within the 115 square degree Kepler FOV. Here, we provide an updated catalog augmented with the second Kepler data release which increases the baseline nearly 4-fold to 125 days. 386 new systems have been added, ephemerides and principle parameters have been recomputed. We have removed 42 previously cataloged systems that are now clearly recognized as short-period pulsating variables and another 58 blended systems where we have determined that the Kepler target object is not itself the eclipsing binary. A number of interesting objects are identified. We present several exemplary cases: 4 EBs that exhibit extra (tertiary) eclipse events; and 8 systems that show clear eclipse timing variations indicative of the presence of additional bodies bound in the system. We have updated the period and galactic latitude distribution diagrams. With these changes, the total number of identified eclipsing binary systems in the Kepler field-of-view has increased to 2165, 1.4% of the Kepler target stars. △ Less

Submitted 8 March, 2011; originally announced March 2011.

Comments: 29 pages, 12 figures. Submitted to the AJ. An online version of the catalog is maintained at http://keplerEBs.villanova.edu/

Kepler Eclipsing Binary Stars. I. Catalog and Principal Characterization of 1879 Eclipsing Binaries in the First Data Release

Authors: Andrej Prsa, Natalie M. Batalha, Robert W. Slawson, Laurance R. Doyle, William F. Welsh, Jerome A. Orosz, Sara Seager, Michael Rucker, Kimberly Mjaseth, Scott G. Engle, Kyle Conroy, Jon M. Jenkins, Douglas A. Caldwell, David G. Koch, William J. Borucki

Abstract: The Kepler space mission is devoted to finding Earth-size planets in habitable zones orbiting other stars. Its large, 105-deg field-of-view features over 156,000 stars that are observed continuously to detect and characterize planet transits. Yet this high-precision instrument holds great promise for other types of objects as well. Here we present a comprehensive catalog of eclipsing binary stars… ▽ More The Kepler space mission is devoted to finding Earth-size planets in habitable zones orbiting other stars. Its large, 105-deg field-of-view features over 156,000 stars that are observed continuously to detect and characterize planet transits. Yet this high-precision instrument holds great promise for other types of objects as well. Here we present a comprehensive catalog of eclipsing binary stars observed by Kepler in the first 44 days of operation, the data which are publicly available through MAST as of 6/15/2010. The catalog contains 1879 unique objects. For each object we provide its Kepler ID (KID), ephemeris (BJD0, P0), morphology type, physical parameters (Teff, log g, E(B-V), crowding), and principal parameters (T2/T1, q, fillout factor and sin i for overcontacts, and T2/T1, (R1+R2)/a, e sin(w), e cos(w), and sin i for detached binaries). We present statistics based on the determined periods and measure an average occurence rate of eclipsing binaries to be ~1.2% across the Kepler field. We further discuss the distribution of binaries as function of galactic latitude, and thoroughly explain the application of artificial intelligence to obtain principal parameters in a matter of seconds for the whole sample. The catalog was envisioned to serve as a bridge between the now public Kepler data and the scientific community interested in eclipsing binary stars. △ Less

Submitted 21 January, 2011; v1 submitted 14 June, 2010; originally announced June 2010.

Comments: 51 pages, in press (AJ). Online catalog: http://astro4.ast.villanova.edu/aprsa/kepler