-
Hands-Free VR
Authors:
Jorge Askur Vazquez Fernandez,
Jae Joong Lee,
Santiago Andrés Serrano Vacca,
Alejandra Magana,
Bedrich Benes,
Voicu Popescu
Abstract:
The paper introduces Hands-Free VR, a voice-based natural-language interface for VR. The user gives a command using their voice, the speech audio data is converted to text using a speech-to-text deep learning model that is fine-tuned for robustness to word phonetic similarity and to spoken English accents, and the text is mapped to an executable VR command using a large language model that is robu…
▽ More
The paper introduces Hands-Free VR, a voice-based natural-language interface for VR. The user gives a command using their voice, the speech audio data is converted to text using a speech-to-text deep learning model that is fine-tuned for robustness to word phonetic similarity and to spoken English accents, and the text is mapped to an executable VR command using a large language model that is robust to natural language diversity. Hands-Free VR was evaluated in a controlled within-subjects study (N = 22) that asked participants to find specific objects and to place them in various configurations. In the control condition participants used a conventional VR user interface to grab, carry, and position the objects using the handheld controllers. In the experimental condition participants used Hands-Free VR. The results confirm that: (1) Hands-Free VR is robust to spoken English accents, as for 20 of our participants English was not their first language, and to word phonetic similarity, correctly transcribing the voice command 96.71% of the time; (2) Hands-Free VR is robust to natural language diversity, correctly map** the transcribed command to an executable command in 97.83% of the time; (3) Hands-Free VR had a significant efficiency advantage over the conventional VR interface in terms of task completion time, total viewpoint translation, total view direction rotation, and total left and right hand translations; (4) Hands-Free VR received high user preference ratings in terms of ease of use, intuitiveness, ergonomics, reliability, and desirability.
△ Less
Submitted 22 February, 2024;
originally announced February 2024.
-
Student and AI responses to physics problems examined through the lenses of sensemaking and mechanistic reasoning
Authors:
Amogh Sirnoorkar,
Dean Zollman,
James T. Laverty,
Alejandra J. Magana,
Sanjay Rebello,
Lynn A. Bryan
Abstract:
Several reports in education have called for transforming physics learning environments by promoting sensemaking of real-world scenarios in light of curricular ideas. Recent advancements in Generative-Artificial Intelligence has garnered increasing traction in educators' community by virtue of its potential in transforming STEM learning. In this exploratory study, we adopt a mixed-methods approach…
▽ More
Several reports in education have called for transforming physics learning environments by promoting sensemaking of real-world scenarios in light of curricular ideas. Recent advancements in Generative-Artificial Intelligence has garnered increasing traction in educators' community by virtue of its potential in transforming STEM learning. In this exploratory study, we adopt a mixed-methods approach in comparatively examining student- and AI-generated responses to two different formats of a physics problem through the cognitive lenses of sensemaking and mechanistic reasoning. The student data is derived from think-aloud interviews of introductory students and the AI data comes from ChatGPT's solutions collected using Zero shot approach. The results highlight AI responses to evidence most features of the two processes through well-structured solutions and student responses to effectively leverage representations in their solutions through iterative refinement of arguments. In other words, while AI responses reflect how physics is talked about, the student responses reflect how physics is practiced. Implications of these results in light of development and deployment of AI systems in physics pedagogy are discussed.
△ Less
Submitted 31 December, 2023;
originally announced January 2024.
-
Viewpoint Generation using Feature-Based Constrained Spaces for Robot Vision Systems
Authors:
Alejandro Magaña,
Jonas Dirr,
Philipp Bauer,
Gunther Reinhart
Abstract:
The efficient computation of viewpoints under consideration of various system and process constraints is a common challenge that any robot vision system is confronted with when trying to execute a vision task. Although fundamental research has provided solid and sound solutions for tackling this problem, a holistic framework that poses its formal description, considers the heterogeneity of robot v…
▽ More
The efficient computation of viewpoints under consideration of various system and process constraints is a common challenge that any robot vision system is confronted with when trying to execute a vision task. Although fundamental research has provided solid and sound solutions for tackling this problem, a holistic framework that poses its formal description, considers the heterogeneity of robot vision systems, and offers an integrated solution remains unaddressed. Hence, this publication outlines the generation of viewpoints as a geometrical problem and introduces a generalized theoretical framework based on Feature-Based Constrained Spaces ($\mathcal{C}$-spaces) as the backbone for solving it. A $\mathcal{C}$-space can be understood as the topological space that a viewpoint constraint spans, where the sensor can be positioned for acquiring a feature while fulfilling the regarded constraint. The present study demonstrates that many viewpoint constraints can be efficiently formulated as $\mathcal{C}$-spaces providing geometric, deterministic, and closed solutions. The introduced $\mathcal{C}$-spaces are characterized based on generic domain and viewpoint constraints models to ease the transferability of the present framework to different applications and robot vision systems. The effectiveness and efficiency of the concepts introduced are verified on a simulation-based scenario and validated on a real robot vision system comprising two different sensors.
△ Less
Submitted 12 June, 2023;
originally announced June 2023.
-
Using Machine Learning to Predict Engineering Technology Students' Success with Computer Aided Design
Authors:
Jasmine Singh,
Viranga Perera,
Alejandra J. Magana,
Brittany Newell,
** Wei-Kocsis,
Ying Ying Seah,
Greg J. Strimel,
Charles Xie
Abstract:
Computer-aided design (CAD) programs are essential to engineering as they allow for better designs through low-cost iterations. While CAD programs are typically taught to undergraduate students as a job skill, such software can also help students learn engineering concepts. A current limitation of CAD programs (even those that are specifically designed for educational purposes) is that they are no…
▽ More
Computer-aided design (CAD) programs are essential to engineering as they allow for better designs through low-cost iterations. While CAD programs are typically taught to undergraduate students as a job skill, such software can also help students learn engineering concepts. A current limitation of CAD programs (even those that are specifically designed for educational purposes) is that they are not capable of providing automated real-time help to students. To encourage CAD programs to build in assistance to students, we used data generated from students using a free, open source CAD software called Aladdin to demonstrate how student data combined with machine learning techniques can predict how well a particular student will perform in a design task. We challenged students to design a house that consumed zero net energy as part of an introductory engineering technology undergraduate course. Using data from 128 students, along with the scikit-learn Python machine learning library, we tested our models using both total counts of design actions and sequences of design actions as inputs. We found that our models using early design sequence actions are particularly valuable for prediction. Our logistic regression model achieved a >60% chance of predicting if a student would succeed in designing a zero net energy house. Our results suggest that it would be feasible for Aladdin to provide useful feedback to students when they are approximately halfway through their design. Further improvements to these models could lead to earlier predictions and thus provide students feedback sooner to enhance their learning.
△ Less
Submitted 12 August, 2021;
originally announced August 2021.
-
Human-Adversarial Visual Question Answering
Authors:
Sasha Sheng,
Amanpreet Singh,
Vedanuj Goswami,
Jose Alberto Lopez Magana,
Wojciech Galuba,
Devi Parikh,
Douwe Kiela
Abstract:
Performance on the most commonly used Visual Question Answering dataset (VQA v2) is starting to approach human accuracy. However, in interacting with state-of-the-art VQA models, it is clear that the problem is far from being solved. In order to stress test VQA models, we benchmark them against human-adversarial examples. Human subjects interact with a state-of-the-art VQA model, and for each imag…
▽ More
Performance on the most commonly used Visual Question Answering dataset (VQA v2) is starting to approach human accuracy. However, in interacting with state-of-the-art VQA models, it is clear that the problem is far from being solved. In order to stress test VQA models, we benchmark them against human-adversarial examples. Human subjects interact with a state-of-the-art VQA model, and for each image in the dataset, attempt to find a question where the model's predicted answer is incorrect. We find that a wide range of state-of-the-art models perform poorly when evaluated on these examples. We conduct an extensive analysis of the collected adversarial examples and provide guidance on future research directions. We hope that this Adversarial VQA (AdVQA) benchmark can help drive progress in the field and advance the state of the art.
△ Less
Submitted 4 June, 2021;
originally announced June 2021.
-
Hack.VR: A Programming Game in Virtual Reality
Authors:
Dominic Kao,
Christos Mousas,
Alejandra J. Magana,
D. Fox Harrell,
Rabindra Ratan,
Edward F. Melcer,
Brett Sherrick,
Paul Parsons,
Dmitri A. Gusev
Abstract:
In this article we describe Hack.VR, an object-oriented programming game in virtual reality. Hack.VR uses a VR programming language in which nodes represent functions and node connections represent data flow. Using this programming framework, players reprogram VR objects such as elevators, robots, and switches. Hack.VR has been designed to be highly interactable both physically and semantically.
In this article we describe Hack.VR, an object-oriented programming game in virtual reality. Hack.VR uses a VR programming language in which nodes represent functions and node connections represent data flow. Using this programming framework, players reprogram VR objects such as elevators, robots, and switches. Hack.VR has been designed to be highly interactable both physically and semantically.
△ Less
Submitted 23 November, 2020; v1 submitted 8 July, 2020;
originally announced July 2020.
-
Phonon and Thermal Properties of Quasi-Two-Dimensional FePS3 and MnPS3 Antiferromagnetic Semiconductor Materials
Authors:
Fariborz Kargar,
Ece Aytan,
Subhajit Ghosh,
Jonathan Lee,
Michael Gomez,
Yuhang Liu,
Andres Sanchez Magana,
Zahra Barani Beiranvand,
Bishwajit Debnath,
Richard Wilson,
Roger K. Lake,
Alexander A. Balandin
Abstract:
We report results of investigation of the phonon and thermal properties of the exfoliated films of layered single crystals of antiferromagnetic FePS3 and MnPS3 semiconductors. The Raman spectroscopy was conducted using three different excitation lasers with the wavelengths of 325 nm (UV), 488 nm (blue), and 633 nm (red). The resonant UV-Raman spectroscopy reveals new spectral features, which are n…
▽ More
We report results of investigation of the phonon and thermal properties of the exfoliated films of layered single crystals of antiferromagnetic FePS3 and MnPS3 semiconductors. The Raman spectroscopy was conducted using three different excitation lasers with the wavelengths of 325 nm (UV), 488 nm (blue), and 633 nm (red). The resonant UV-Raman spectroscopy reveals new spectral features, which are not detectable via visible Raman light scattering. The thermal conductivity of FePS3 and MnPS3 thin films was measured by two different techniques: the steady-state Raman optothermal and transient time-resolved magneto-optical Kerr effect. The Raman optothermal measurements provided the orientation-average thermal conductivity of FePS3 to be 1.35 W/mK at room temperature. The transient measurements revealed that the through-plane and in-plane thermal conductivity of FePS3 is 0.85 W/mK and 2.7 W/mK, respectively. The films of MnPS3 have higher thermal conductivity of 1.1 W/mK through-plane and 6.3 W/mK in-plane. The data obtained by both techniques reveal strong thermal anisotropy of the films and the dominant contribution of phonons to heat conduction. Our results are important for the proposed applications of the antiferromagnetic semiconductor thin films in spintronic devices.
△ Less
Submitted 14 August, 2019;
originally announced August 2019.
-
Thermal and Electrical Properties of Hybrid Composites with Graphene and Boron Nitride Fillers
Authors:
Jacob S. Lewis,
Zahra Barani,
Andres Sanchez Magana,
Fariborz Kargar,
Alexander A. Balandin
Abstract:
We report on the thermal and electrical properties of hybrid epoxy composites with graphene and boron nitride fillers. The thicknesses, lateral dimensions, and aspect ratios of each filler material were intentionally selected for geometric similarity to one another, in contrast to prior studies that utilized dissimilar filler geometries to achieve a "synergistic" effect. We demonstrate that the el…
▽ More
We report on the thermal and electrical properties of hybrid epoxy composites with graphene and boron nitride fillers. The thicknesses, lateral dimensions, and aspect ratios of each filler material were intentionally selected for geometric similarity to one another, in contrast to prior studies that utilized dissimilar filler geometries to achieve a "synergistic" effect. We demonstrate that the electrically-conductive graphene and electrically-insulating boron nitride fillers allow one to effectively engineer the thermal and electrical conductivities of their resulting composites. By varying the constituent fraction of boron nitride to graphene in a composite with ~44% total filler loading, one can tune the thermal conductivity enhancement from a factor of x15 to x35 and increase the electrical conductivity by many orders of magnitude. The obtained results are important for the development of next-generation thermal interface materials with controllable electrical properties necessary for applications requiring either electrical grounding or insulation.
△ Less
Submitted 3 March, 2019;
originally announced March 2019.
-
Graphene Composites with Dual Functionality: Electromagnetic Shielding and Thermal Management
Authors:
Fariborz Kargar,
Zahra Barani,
Michael G. Balinskiy,
Andres Sanchez Magana,
Jacob S. Lewis,
Alexander A. Balandin
Abstract:
We report on the synthesis and characterization of the epoxy-based composites with the few-layer graphene fillers, which are capable of the duel functional applications. It was found that composites with the certain types of few-layer graphene fillers reveal an efficient total electromagnetic interference shielding, SE~45 dB, in the important X-band frequency range, f=8.2 GHz - 12.4 GHz, while sim…
▽ More
We report on the synthesis and characterization of the epoxy-based composites with the few-layer graphene fillers, which are capable of the duel functional applications. It was found that composites with the certain types of few-layer graphene fillers reveal an efficient total electromagnetic interference shielding, SE~45 dB, in the important X-band frequency range, f=8.2 GHz - 12.4 GHz, while simultaneously providing the high thermal conductivity, K = 8 W/mK, which is a factor of x35 larger than that of the base matrix material. The efficiency of the dual functional application depends on the filler characteristics: thickness, lateral dimensions, aspect ratio and concentration. Graphene loading fractions above the percolation threshold allow for strong enhancement of both the electromagnetic interference shielding and heat conduction properties. Interestingly, graphene composites can block the electromagnetic energy even below the percolation threshold, remaining electrically insulating, which is an important feature for some types of thermal interface materials. The dual functionality of the graphene composites can substantially improve the electromagnetic shielding and thermal management of the airborne systems while simultaneously reducing their weight and cost.
△ Less
Submitted 9 August, 2018;
originally announced August 2018.
-
Imaging of the umbrella motion and tunneling in the ammonia molecule by strong-field ionization
Authors:
Johann Förster,
Etienne Plesiat,
Alvaro Magana,
Alejandro Saenz
Abstract:
The geometry-dependent ionization behavior of the ammonia molecule is investigated. Different theoretical approaches for obtaining the ionization yield are compared, all of them showing a strong dependence of the ionization yield on the inversion coordinate at long wavelengths ($\geq$ 800 nm). It is shown how this effect can be exploited to create and probe nuclear wave packets in neutral ammonia…
▽ More
The geometry-dependent ionization behavior of the ammonia molecule is investigated. Different theoretical approaches for obtaining the ionization yield are compared, all of them showing a strong dependence of the ionization yield on the inversion coordinate at long wavelengths ($\geq$ 800 nm). It is shown how this effect can be exploited to create and probe nuclear wave packets in neutral ammonia using Lochfraß. Furthermore, imaging of a wave packet tunneling through the barrier of a double-well potential in real time is discussed.
△ Less
Submitted 5 August, 2016;
originally announced August 2016.
-
Multiple orbital contributions to molecular high-harmonic generation in an asymmetric top
Authors:
Limor S. Spector,
Shungo Miyabe,
Alvaro Magana,
Simon Petretti,
Piero Decleva,
Todd Martinez,
Alejandro Saenz,
Markus Guehr,
Philip H. Bucksbaum
Abstract:
High-order harmonic generation (HHG) in aligned linear molecules can offer valuable information about strong-field interactions in lower-lying molecular orbitals, but extracting this information is difficult for three-dimensional molecular geometries. Our measurements of the asymmetric top SO2 show large axis dependencies, which change with harmonic order. The analysis shows that these spectral fe…
▽ More
High-order harmonic generation (HHG) in aligned linear molecules can offer valuable information about strong-field interactions in lower-lying molecular orbitals, but extracting this information is difficult for three-dimensional molecular geometries. Our measurements of the asymmetric top SO2 show large axis dependencies, which change with harmonic order. The analysis shows that these spectral features must be due to field ionization and recombination from multiple orbitals during HHG. We expect that HHG can probe orbital dependencies using this approach for a broad class of asymmetric-top molecules.
△ Less
Submitted 16 August, 2013;
originally announced August 2013.
-
Probes on D3-D7 Quark-Gluon Plasmas
Authors:
A. Magaña,
J. Mas,
L. Mazzanti,
J. Tarrio
Abstract:
We study the holographic dual model of quenched flavors immersed in a quark-gluon plasma with massless dynamical quarks in the Veneziano limit. This is modeled by embedding a probe D7 brane in a background where the backreaction of massless D7 branes has been taken into account. The background, and hence the effects, are perturbative in the Veneziano parameter N_f/N_c, therefore giving small shift…
▽ More
We study the holographic dual model of quenched flavors immersed in a quark-gluon plasma with massless dynamical quarks in the Veneziano limit. This is modeled by embedding a probe D7 brane in a background where the backreaction of massless D7 branes has been taken into account. The background, and hence the effects, are perturbative in the Veneziano parameter N_f/N_c, therefore giving small shifts of all magnitudes like the constituent mass, the quark condensate, and several transport coefficients. We provide qualitative results for the effect of flavor degrees of freedom on the probes. For example, the meson melting temperature is enhanced, while the screening length is diminished. The drag force is also enhanced.
△ Less
Submitted 28 May, 2012;
originally announced May 2012.