-
Reliability of Smartphone-Based Vibration Threshold Measurements
Authors:
Rachel A. G. Adenekan,
Kyle T. Yoshida,
Anis Benyoucef,
Alejandrina Gonzalez Reyes,
Adeyinka E. Adenekan,
Allison M. Okamura,
Cara M. Nunez
Abstract:
Smartphone-based measurement platforms can collect data on human sensory function in an accessible manner. We developed a smartphone app that measures vibration perception thresholds by commanding vibrations with varying amplitudes and recording user responses via (1) a staircase method that adjusts a variable stimulus, and (2) a decay method that measures the time a user feels a decaying stimulus…
▽ More
Smartphone-based measurement platforms can collect data on human sensory function in an accessible manner. We developed a smartphone app that measures vibration perception thresholds by commanding vibrations with varying amplitudes and recording user responses via (1) a staircase method that adjusts a variable stimulus, and (2) a decay method that measures the time a user feels a decaying stimulus. We conducted two studies with healthy adults to assess the reliability and usability of the app when the smartphone was applied to the hand and foot. The staircase mode had good reliability for repeated measurements, both with and without the support of an in-person experimenter. The app has the potential to be used at home in unguided scenarios.
△ Less
Submitted 25 January, 2024;
originally announced January 2024.
-
A Comparative Analysis of Smartphone and Standard Tools for Touch Perception Assessment Across Multiple Body Sites
Authors:
Rachel A. G. Adenekan,
Alejandrina Gonzalez Reyes,
Kyle T. Yoshida,
Sreela Kodali,
Allison M. Okamura,
Cara M. Nunez
Abstract:
Tactile perception plays an important role in activities of daily living, and it can be impaired in individuals with certain medical conditions. The most common tools used to assess tactile sensation, the Semmes-Weinstein monofilaments and the 128 Hz tuning fork, have poor repeatability and resolution. Long term, we aim to provide a repeatable, high-resolution testing platform that can be used to…
▽ More
Tactile perception plays an important role in activities of daily living, and it can be impaired in individuals with certain medical conditions. The most common tools used to assess tactile sensation, the Semmes-Weinstein monofilaments and the 128 Hz tuning fork, have poor repeatability and resolution. Long term, we aim to provide a repeatable, high-resolution testing platform that can be used to assess vibrotactile perception through smartphones without the need for an experimenter to be present to conduct the test. We present a smartphone-based vibration perception measurement platform and compare its performance to measurements from standard monofilament and tuning fork tests. We conducted a user study with 36 healthy adults in which we tested each tool on the hand, wrist, and foot, to assess how well our smartphone-based vibration perception thresholds (VPTs) detect known trends obtained from standard tests. The smartphone platform detected statistically significant changes in VPT between the index finger and foot and also between the feet of younger adults and older adults. Our smartphone-based VPT had a moderate correlation to tuning fork-based VPT. Our overarching objective is to develop an accessible smartphone-based platform that can eventually be used to measure disease progression and regression.
△ Less
Submitted 25 January, 2024; v1 submitted 14 January, 2024;
originally announced January 2024.
-
Exploring Human Response Times to Combinations of Audio, Haptic, and Visual Stimuli from a Mobile Device
Authors:
Kyle T. Yoshida,
Joel X. Kiernan,
Allison M. Okamura,
Cara M. Nunez
Abstract:
Auditory, haptic, and visual stimuli provide alerts, notifications, and information for a wide variety of applications ranging from virtual reality to wearable and hand-held devices. Response times to these stimuli have been used to assess motor control and design human-computer interaction systems. In this study, we investigate human response times to 26 combinations of auditory, haptic, and visu…
▽ More
Auditory, haptic, and visual stimuli provide alerts, notifications, and information for a wide variety of applications ranging from virtual reality to wearable and hand-held devices. Response times to these stimuli have been used to assess motor control and design human-computer interaction systems. In this study, we investigate human response times to 26 combinations of auditory, haptic, and visual stimuli at three levels (high, low, and off). We developed an iOS app that presents these stimuli in random intervals and records response times on an iPhone 11. We conducted a user study with 20 participants and found that response time decreased with more types and higher levels of stimuli. The low visual condition had the slowest mean response time (mean +/- standard deviation, 528 +/- 105 ms) and the condition with high levels of audio, haptic, and visual stimuli had the fastest mean response time (320 +/- 43 ms). This work quantifies response times to multi-modal stimuli, identifies interactions between different stimuli types and levels, and introduces an app-based method that can be widely distributed to measure response time. Understanding preferences and response times for stimuli can provide insight into designing devices for human-machine interaction.
△ Less
Submitted 26 May, 2023;
originally announced May 2023.
-
Cognitive and Physical Activities Impair Perception of Smartphone Vibrations
Authors:
Kyle T. Yoshida,
Joel X. Kiernan,
Rachel A. G. Adenekan,
Steven H. Trinh,
Alexis J. Lowber,
Allison M. Okamura,
Cara M. Nunez
Abstract:
Vibration feedback is common in everyday devices, from virtual reality systems to smartphones. However, cognitive and physical activities may impede our ability to sense vibrations from devices. In this study, we develop and characterize a smartphone platform to investigate how a shape-memory task (cognitive activity) and walking (physical activity) impair human perception of smartphone vibrations…
▽ More
Vibration feedback is common in everyday devices, from virtual reality systems to smartphones. However, cognitive and physical activities may impede our ability to sense vibrations from devices. In this study, we develop and characterize a smartphone platform to investigate how a shape-memory task (cognitive activity) and walking (physical activity) impair human perception of smartphone vibrations. We measured how Apple's Core Haptics Framework parameters can be used for haptics research, namely how hapticIntensity modulates amplitudes of 230 Hz vibrations. A 23-person user study found that physical (p<0.001) and cognitive (p=0.004) activity increase vibration perception thresholds. Cognitive activity also increases vibration response time (p<0.001). This work also introduces a smartphone platform that can be used for out-of-lab vibration perception testing. Researchers can use our smartphone platform and results to design better haptic devices for diverse, unique populations.
△ Less
Submitted 11 May, 2023;
originally announced May 2023.
-
Deep Learning Classification of Touch Gestures Using Distributed Normal and Shear Force
Authors:
Hojung Choi,
Dane Brouwer,
Michael A. Lin,
Kyle T. Yoshida,
Carine Rognon,
Benjamin Stephens-Fripp,
Allison M. Okamura,
Mark R. Cutkosky
Abstract:
When humans socially interact with another agent (e.g., human, pet, or robot) through touch, they do so by applying varying amounts of force with different directions, locations, contact areas, and durations. While previous work on touch gesture recognition has focused on the spatio-temporal distribution of normal forces, we hypothesize that the addition of shear forces will permit more reliable c…
▽ More
When humans socially interact with another agent (e.g., human, pet, or robot) through touch, they do so by applying varying amounts of force with different directions, locations, contact areas, and durations. While previous work on touch gesture recognition has focused on the spatio-temporal distribution of normal forces, we hypothesize that the addition of shear forces will permit more reliable classification. We present a soft, flexible skin with an array of tri-axial tactile sensors for the arm of a person or robot. We use it to collect data on 13 touch gesture classes through user studies and train a Convolutional Neural Network (CNN) to learn spatio-temporal features from the recorded data. The network achieved a recognition accuracy of 74% with normal and shear data, compared to 66% using only normal force data. Adding distributed shear data improved classification accuracy for 11 out of 13 touch gesture classes.
△ Less
Submitted 30 September, 2022;
originally announced October 2022.
-
Feasibility of Smartphone Vibrations as a Sensory Diagnostic Tool
Authors:
Rachel A. G. Adenekan,
Alexis J. Lowber,
Bryce N. Huerta,
Allison M. Okamura,
Kyle T. Yoshida,
Cara M. Nunez
Abstract:
Traditionally, clinicians use tuning forks as a binary measure to assess vibrotactile sensory perception. This approach has low measurement resolution, and the vibrations are highly variable. Therefore, we propose using vibrations from a smartphone to deliver a consistent and precise sensory test. First, we demonstrate that a smartphone has more consistent vibrations compared to a tuning fork. The…
▽ More
Traditionally, clinicians use tuning forks as a binary measure to assess vibrotactile sensory perception. This approach has low measurement resolution, and the vibrations are highly variable. Therefore, we propose using vibrations from a smartphone to deliver a consistent and precise sensory test. First, we demonstrate that a smartphone has more consistent vibrations compared to a tuning fork. Then we develop an app and conduct a validation study to show that the smartphone can precisely measure a user's absolute threshold. This finding motivates future work to use smartphones to assess vibrotactile perception, allowing for increased monitoring and widespread accessibility.
△ Less
Submitted 6 June, 2022;
originally announced June 2022.
