-
EyeEcho: Continuous and Low-power Facial Expression Tracking on Glasses
Authors:
Ke Li,
Ruidong Zhang,
Siyuan Chen,
Boao Chen,
Mose Sakashita,
François Guimbretière,
Cheng Zhang
Abstract:
In this paper, we introduce EyeEcho, a minimally-obtrusive acoustic sensing system designed to enable glasses to continuously monitor facial expressions. It utilizes two pairs of speakers and microphones mounted on glasses, to emit encoded inaudible acoustic signals directed towards the face, capturing subtle skin deformations associated with facial expressions. The reflected signals are processed…
▽ More
In this paper, we introduce EyeEcho, a minimally-obtrusive acoustic sensing system designed to enable glasses to continuously monitor facial expressions. It utilizes two pairs of speakers and microphones mounted on glasses, to emit encoded inaudible acoustic signals directed towards the face, capturing subtle skin deformations associated with facial expressions. The reflected signals are processed through a customized machine-learning pipeline to estimate full facial movements. EyeEcho samples at 83.3 Hz with a relatively low power consumption of 167 mW. Our user study involving 12 participants demonstrates that, with just four minutes of training data, EyeEcho achieves highly accurate tracking performance across different real-world scenarios, including sitting, walking, and after remounting the devices. Additionally, a semi-in-the-wild study involving 10 participants further validates EyeEcho's performance in naturalistic scenarios while participants engage in various daily activities. Finally, we showcase EyeEcho's potential to be deployed on a commercial-off-the-shelf (COTS) smartphone, offering real-time facial expression tracking.
△ Less
Submitted 23 February, 2024; v1 submitted 13 February, 2024;
originally announced February 2024.
-
EchoWrist: Continuous Hand Pose Tracking and Hand-Object Interaction Recognition Using Low-Power Active Acoustic Sensing On a Wristband
Authors:
Chi-Jung Lee,
Ruidong Zhang,
Devansh Agarwal,
Tianhong Catherine Yu,
Vipin Gunda,
Oliver Lopez,
James Kim,
Sicheng Yin,
Boao Dong,
Ke Li,
Mose Sakashita,
Francois Guimbretiere,
Cheng Zhang
Abstract:
Our hands serve as a fundamental means of interaction with the world around us. Therefore, understanding hand poses and interaction context is critical for human-computer interaction. We present EchoWrist, a low-power wristband that continuously estimates 3D hand pose and recognizes hand-object interactions using active acoustic sensing. EchoWrist is equipped with two speakers emitting inaudible s…
▽ More
Our hands serve as a fundamental means of interaction with the world around us. Therefore, understanding hand poses and interaction context is critical for human-computer interaction. We present EchoWrist, a low-power wristband that continuously estimates 3D hand pose and recognizes hand-object interactions using active acoustic sensing. EchoWrist is equipped with two speakers emitting inaudible sound waves toward the hand. These sound waves interact with the hand and its surroundings through reflections and diffractions, carrying rich information about the hand's shape and the objects it interacts with. The information captured by the two microphones goes through a deep learning inference system that recovers hand poses and identifies various everyday hand activities. Results from the two 12-participant user studies show that EchoWrist is effective and efficient at tracking 3D hand poses and recognizing hand-object interactions. Operating at 57.9mW, EchoWrist is able to continuously reconstruct 20 3D hand joints with MJEDE of 4.81mm and recognize 12 naturalistic hand-object interactions with 97.6% accuracy.
△ Less
Submitted 29 March, 2024; v1 submitted 30 January, 2024;
originally announced January 2024.
-
Study on the reusability of fluorescent nuclear track detectors using optical bleaching
Authors:
Abdul Muneem,
Junya Yoshida,
Hiroyuki Ekawa,
Masahiro Hino,
Katsuya Hirota,
Go Ichikawa,
Ayumi Kasagi,
Masaaki Kitaguchi,
Satoshi Kodaira,
Kenji Mishima,
Jameel-Un Nabi,
Manami Nakagawa,
Michio Sakashita,
Norihito Saito,
Takehiko R. Saito,
Satoshi Wada,
Nakahiro Yasuda
Abstract:
Fluorescent nuclear track detectors (FNTDs) based on Al${_2}$O${_3}$:C,Mg crystals are luminescent detectors that can be used for dosimetry and detection of charged particles and neutrons. These detectors can be utilised for imaging applications where a reasonably high track density, approximately of the order of 1 $\times$ $10^4$ tracks in an area of 100 $\times$ 100 $μ$m$^2$, is required. To inv…
▽ More
Fluorescent nuclear track detectors (FNTDs) based on Al${_2}$O${_3}$:C,Mg crystals are luminescent detectors that can be used for dosimetry and detection of charged particles and neutrons. These detectors can be utilised for imaging applications where a reasonably high track density, approximately of the order of 1 $\times$ $10^4$ tracks in an area of 100 $\times$ 100 $μ$m$^2$, is required. To investigate the reusability of FNTDs for imaging applications, we present an approach to perform optical bleaching under the required track density conditions. The reusability was assessed through seven irradiation-bleaching cycles. For the irradiation, the studied FNTD was exposed to alpha-particles from an $^{241}$Am radioactive source. The optical bleaching was performed by means of ultraviolet laser light with a wavelength of 355 nm. Three dedicated regions on a single FNTD with different accumulated track densities and bleaching conditions were investigated. After every irradiation-bleaching cycle, signal-to-noise ratio was calculated to evaluate FNTD performance. It is concluded that FNTDs can be reused at least seven times for applications where accumulation of a high track density is required.
△ Less
Submitted 3 November, 2022;
originally announced November 2022.
-
Quark confinement potential examined by excitation energy of the Lambda_c and Lambda_b baryons in a quark-diquark model
Authors:
Daisuke Jido,
Minori Sakashita
Abstract:
The possibility to have diquark configuration in heavy baryons, such as Lambda_c and Lambda_b, is examined by a nonrelativistic potential model with a heavy quark and a light scalar diquark. Assuming that the Lambda_c and Lambda_b baryons are composed of the heavy quark and the point-like scalar-isoscalar ud diquark, we solve the two-body Schrodinger equation with the Coulomb plus linear potential…
▽ More
The possibility to have diquark configuration in heavy baryons, such as Lambda_c and Lambda_b, is examined by a nonrelativistic potential model with a heavy quark and a light scalar diquark. Assuming that the Lambda_c and Lambda_b baryons are composed of the heavy quark and the point-like scalar-isoscalar ud diquark, we solve the two-body Schrodinger equation with the Coulomb plus linear potential and obtain the energy spectra for the heavy baryons. Contrary to our expectation, it is found that the potential determined by the quarkonium spectra fails to reproduce the excitation spectra of the Lambda_c and Lambda_b in the quark-diquark picture, while the Lambda_c and Lambda_b spectra is reproduced with a half strength of the confinement string tension than for the quarkonium. The finite size effect of the diquark is also examined and it is found that introduction of a finite size diquark would resolve the failure of the spectrum reproduction. The Xi_c excitation energy is also calculated and is found to be smaller than Lambda_c in the quark-diquark model. This is not consistent with the experimental observation.
△ Less
Submitted 12 July, 2016; v1 submitted 24 May, 2016;
originally announced May 2016.
