Subtle Sensing: Detecting Differences in the Flexibility of Virtually Simulated Molecular Objects
Authors:
Rhoslyn Roebuck Williams,
Xan Varcoe,
Becca R. Glowacki,
Ella M. Gale,
Alexander Jamieson-Binnie,
David R. Glowacki
Abstract:
During VR demos we have performed over last few years, many participants (in the absence of any haptic feedback) have commented on their perceived ability to 'feel' differences between simulated molecular objects. The mechanisms for such 'feeling' are not entirely clear: observing from outside VR, one can see that there is nothing physical for participants to 'feel'. Here we outline exploratory us…
▽ More
During VR demos we have performed over last few years, many participants (in the absence of any haptic feedback) have commented on their perceived ability to 'feel' differences between simulated molecular objects. The mechanisms for such 'feeling' are not entirely clear: observing from outside VR, one can see that there is nothing physical for participants to 'feel'. Here we outline exploratory user studies designed to evaluate the extent to which participants can distinguish quantitative differences in the flexibility of VR-simulated molecular objects. The results suggest that an individual's capacity to detect differences in molecular flexibility is enhanced when they can interact with and manipulate the molecules, as opposed to merely observing the same interaction. Building on these results, we intend to carry out further studies investigating humans' ability to sense quantitative properties of VR simulations without haptic technology.
△ Less
Submitted 7 May, 2020;
originally announced May 2020.
Interactive molecular dynamics in virtual reality from quantum chemistry to drug binding: An open-source multi-person framework
Authors:
Michael O'Connor,
Simon J. Bennie,
Helen M. Deeks,
Alexander Jamieson-Binnie,
Alex J. Jones,
Robin J. Shannon,
Rebecca Walters,
Thomas J. Mitchell,
Adrian J. Mulholland,
David R. Glowacki
Abstract:
As molecular scientists have made progress in their ability to engineer nano-scale molecular structure, we are facing new challenges in our ability to engineer molecular dynamics (MD) and flexibility. Dynamics at the molecular scale differs from the familiar mechanics of everyday objects, because it involves a complicated, highly correlated, and three-dimensional many-body dynamical choreography w…
▽ More
As molecular scientists have made progress in their ability to engineer nano-scale molecular structure, we are facing new challenges in our ability to engineer molecular dynamics (MD) and flexibility. Dynamics at the molecular scale differs from the familiar mechanics of everyday objects, because it involves a complicated, highly correlated, and three-dimensional many-body dynamical choreography which is often non-intuitive even for highly trained researchers. We recently described how interactive molecular dynamics in virtual reality (iMD-VR) can help to meet this challenge, enabling researchers to manipulate real-time MD simulations of flexible structures in 3D. In this article, we outline efforts to extend immersive technologies to the molecular sciences, and we introduce 'Narupa', a flexible, open-source, multi-person iMD-VR software framework which enables groups of researchers to simultaneously cohabit real-time simulation environments to interactively visualize and manipulate the dynamics of molecular structures with atomic-level precision. We outline several application domains where iMD-VR is facilitating research, communication, and creative approaches within the molecular sciences, including training machines to learn reactive potential energy surfaces (PESs), biomolecular conformational sampling, protein-ligand binding, reaction discovery using 'on-the-fly' quantum chemistry, and transport dynamics in materials. We touch on iMD-VR's various cognitive and perceptual affordances, and how these provide research insight for molecular systems. By synergistically combining human spatial reasoning and design insight with computational automation, technologies like iMD-VR have the potential to improve our ability to understand, engineer, and communicate microscopic dynamical behavior, offering the potential to usher in a new paradigm for engineering molecules and nano-architectures.
△ Less
Submitted 1 May, 2019; v1 submitted 5 February, 2019;
originally announced February 2019.
OMG-VR: Open-source Mudra Gloves for Manipulating Molecular Simulations in VR
Authors:
Rachel Freire,
Becca Rose Glowacki,
Rhoslyn Roebuck Williams,
Mark Wonnacott,
Alexander Jamieson-Binnie,
David R. Glowacki
Abstract:
As VR finds increasing application in scientific research domains like nanotechnology and biochemistry, we are beginning to better understand the domains in which it brings the most benefit, as well as the gestures and form factors that are most useful for specific applications. Here we describe Open-source Mudra Gloves for Virtual Reality (OMG-VR): etextile gloves designed to facilitate research…
▽ More
As VR finds increasing application in scientific research domains like nanotechnology and biochemistry, we are beginning to better understand the domains in which it brings the most benefit, as well as the gestures and form factors that are most useful for specific applications. Here we describe Open-source Mudra Gloves for Virtual Reality (OMG-VR): etextile gloves designed to facilitate research scientists and students carrying out detailed and complex manipulation of simulated 3d molecular objects in VR. The OMG-VR is designed to sense when a user pinches together their thumb and index finger, or thumb and middle finger, forming a "mudra" position. Tests show that they provide good positional tracking of the point at which a pinch takes place, require no calibration, and are sufficiently accurate and robust to enable scientists to accomplish a range of tasks that involve complex spatial manipulation of molecules. The open source design offers a promising alternative to existing controllers and more costly commercial VR data gloves.
△ Less
Submitted 5 May, 2020; v1 submitted 11 January, 2019;
originally announced January 2019.