-
Eyes on the Game: Deciphering Implicit Human Signals to Infer Human Proficiency, Trust, and Intent
Authors:
Nikhil Hulle,
Stéphane Aroca-Ouellette,
Anthony J. Ries,
Jake Brawer,
Katharina von der Wense,
Alessandro Roncone
Abstract:
Effective collaboration between humans and AIs hinges on transparent communication and alignment of mental models. However, explicit, verbal communication is not always feasible. Under such circumstances, human-human teams often depend on implicit, nonverbal cues to glean important information about their teammates such as intent and expertise, thereby bolstering team alignment and adaptability. A…
▽ More
Effective collaboration between humans and AIs hinges on transparent communication and alignment of mental models. However, explicit, verbal communication is not always feasible. Under such circumstances, human-human teams often depend on implicit, nonverbal cues to glean important information about their teammates such as intent and expertise, thereby bolstering team alignment and adaptability. Among these implicit cues, two of the most salient and fundamental are a human's actions in the environment and their visual attention. In this paper, we present a novel method to combine eye gaze data and behavioral data, and evaluate their respective predictive power for human proficiency, trust, and intent. We first collect a dataset of paired eye gaze and gameplay data in the fast-paced collaborative "Overcooked" environment. We then train models on this dataset to compare how the predictive powers differ between gaze data, gameplay data, and their combination. We additionally compare our method to prior works that aggregate eye gaze data and demonstrate how these aggregation methods can substantially reduce the predictive ability of eye gaze. Our results indicate that, while eye gaze data and gameplay data excel in different situations, a model that integrates both types consistently outperforms all baselines. This work paves the way for develo** intuitive and responsive agents that can efficiently adapt to new teammates.
△ Less
Submitted 3 July, 2024;
originally announced July 2024.
-
Improving image quality of sparse-view lung tumor CT images with U-Net
Authors:
Annika Ries,
Tina Dorosti,
Johannes Thalhammer,
Daniel Sasse,
Andreas Sauter,
Felix Meurer,
Ashley Benne,
Tobias Lasser,
Franz Pfeiffer,
Florian Schaff,
Daniela Pfeiffer
Abstract:
Background: We aimed at improving image quality (IQ) of sparse-view computed tomography (CT) images using a U-Net for lung metastasis detection and determining the best tradeoff between number of views, IQ, and diagnostic confidence.
Methods: CT images from 41 subjects aged 62.8 $\pm$ 10.6 years (mean $\pm$ standard deviation), 23 men, 34 with lung metastasis, 7 healthy, were retrospectively sel…
▽ More
Background: We aimed at improving image quality (IQ) of sparse-view computed tomography (CT) images using a U-Net for lung metastasis detection and determining the best tradeoff between number of views, IQ, and diagnostic confidence.
Methods: CT images from 41 subjects aged 62.8 $\pm$ 10.6 years (mean $\pm$ standard deviation), 23 men, 34 with lung metastasis, 7 healthy, were retrospectively selected (2016-2018) and forward projected onto 2,048-view sinograms. Six corresponding sparse-view CT data subsets at varying levels of undersampling were reconstructed from sinograms using filtered backprojection with 16, 32, 64, 128, 256, and 512 views. A dual-frame U-Net was trained and evaluated for each subsampling level on 8,658 images from 22 diseased subjects. A representative image per scan was selected from 19 subjects (12 diseased, 7 healthy) for a single-blinded multireader study. These slices, for all levels of subsampling, with and without U-Net postprocessing, were presented to three readers. IQ and diagnostic confidence were ranked using predefined scales. Subjective nodule segmentation was evaluated using sensitivity and Dice similarity coefficient (DSC); clustered Wilcoxon signed-rank test was used.
Results: The 64-projection sparse-view images resulted in 0.89 sensitivity and 0.81 DSC, while their counterparts, postprocessed with the U-Net, had improved metrics (0.94 sensitivity and 0.85 DSC) (p = 0.400). Fewer views led to insufficient IQ for diagnosis. For increased views, no substantial discrepancies were noted between sparse-view and postprocessed images.
Conclusions: Projection views can be reduced from 2,048 to 64 while maintaining IQ and the confidence of the radiologists on a satisfactory level.
△ Less
Submitted 14 February, 2024; v1 submitted 28 July, 2023;
originally announced July 2023.
-
Goldstone Apple Valley Radio Telescope Monitoring Flux Density of Jupiter's Synchrotron Radiation during the Juno Mission
Authors:
T. Velusamy,
V. Adumitroaie,
J. Arballo,
S. M. Levin,
P. A. Ries,
R. Dorcey,
N. Kreuser-Jenkins,
J. Leflang,
D. Jauncey,
S. Horiuchi
Abstract:
Goldstone Apple Valley Radio Telescope (GAVRT) is a science education partnership among NASA, the Jet Propulsion Laboratory (JPL), and the Lewis Center for Educational Research (LCER), offering unique opportunities for K -12 students and their teachers. As part of a long-term Jupiter synchrotron radiation (JSR) flux density monitoring program, LCER has been carrying out Jupiter observations with s…
▽ More
Goldstone Apple Valley Radio Telescope (GAVRT) is a science education partnership among NASA, the Jet Propulsion Laboratory (JPL), and the Lewis Center for Educational Research (LCER), offering unique opportunities for K -12 students and their teachers. As part of a long-term Jupiter synchrotron radiation (JSR) flux density monitoring program, LCER has been carrying out Jupiter observations with some student participation. In this paper we present the results of processed data sets observed between March 6, 2015 and April 6 2018. The data are divided into 5 epochs, grouped by time. We derive JSR beaming curves at different epochs and Earth declinations. We present a comparison of the observed beaming curves with those derived from most recent models for the radiation belts. Our results show an increasing trend of the JSR flux density which seem consistent with the models for the magnetospheric solar wind interactions.
△ Less
Submitted 17 July, 2020;
originally announced July 2020.
-
Brain Computer Interface Technologies in the Coming Decades
Authors:
Brent J. Lance,
Scott E. Kerick,
Anthony J. Ries,
Kelvin S. Oie,
Kaleb McDowell
Abstract:
As the proliferation of technology dramatically infiltrates all aspects of modern life, in many ways the world is becoming so dynamic and complex that technological capabilities are overwhelming human capabilities to optimally interact with and leverage those technologies. Fortunately, these technological advancements have also driven an explosion of neuroscience research over the past several dec…
▽ More
As the proliferation of technology dramatically infiltrates all aspects of modern life, in many ways the world is becoming so dynamic and complex that technological capabilities are overwhelming human capabilities to optimally interact with and leverage those technologies. Fortunately, these technological advancements have also driven an explosion of neuroscience research over the past several decades, presenting engineers with a remarkable opportunity to design and develop flexible and adaptive brain-based neurotechnologies that integrate with and capitalize on human capabilities and limitations to improve human-system interactions. Major forerunners of this conception are brain-computer interfaces (BCIs), which to this point have been largely focused on improving the quality of life for particular clinical populations and include, for example, applications for advanced communications with paralyzed or locked in patients as well as the direct control of prostheses and wheelchairs. Near-term applications are envisioned that are primarily task oriented and are targeted to avoid the most difficult obstacles to development. In the farther term, a holistic approach to BCIs will enable a broad range of task-oriented and opportunistic applications by leveraging pervasive technologies and advanced analytical approaches to sense and merge critical brain, behavioral, task, and environmental information. Communications and other applications that are envisioned to be broadly impacted by BCIs are highlighted; however, these represent just a small sample of the potential of these technologies.
△ Less
Submitted 5 November, 2012;
originally announced November 2012.
-
Shear zones in granular media: 3D Contact Dynamics simulation
Authors:
Alexander Ries,
Tamas Unger,
Dietrich E. Wolf
Abstract:
Shear zone formation is investigated in slow 3D shear flows. We simulate the linear version of the split-bottom shear cell. It is shown that the same type of wide shear zones is achieved in the presence as well as in the absence of gravity. We investigate the relaxation of the material towards a stationary flow and analyze the stress and the velocity fields. We provide the functional form of the…
▽ More
Shear zone formation is investigated in slow 3D shear flows. We simulate the linear version of the split-bottom shear cell. It is shown that the same type of wide shear zones is achieved in the presence as well as in the absence of gravity. We investigate the relaxation of the material towards a stationary flow and analyze the stress and the velocity fields. We provide the functional form of the widening of the shear zone inside the bulk. We discuss the growth of the region where the material is in critical state. It is found that the growth of the critical zone is responsible for the initial transient of the shear zone.
△ Less
Submitted 25 April, 2007; v1 submitted 18 April, 2007;
originally announced April 2007.
