-
Interactive molecular dynamics in virtual reality from quantum chemistry to drug binding: An open-source multi-person framework
Authors:
Michael O'Connor,
Simon J. Bennie,
Helen M. Deeks,
Alexander Jamieson-Binnie,
Alex J. Jones,
Robin J. Shannon,
Rebecca Walters,
Thomas J. Mitchell,
Adrian J. Mulholland,
David R. Glowacki
Abstract:
As molecular scientists have made progress in their ability to engineer nano-scale molecular structure, we are facing new challenges in our ability to engineer molecular dynamics (MD) and flexibility. Dynamics at the molecular scale differs from the familiar mechanics of everyday objects, because it involves a complicated, highly correlated, and three-dimensional many-body dynamical choreography w…
▽ More
As molecular scientists have made progress in their ability to engineer nano-scale molecular structure, we are facing new challenges in our ability to engineer molecular dynamics (MD) and flexibility. Dynamics at the molecular scale differs from the familiar mechanics of everyday objects, because it involves a complicated, highly correlated, and three-dimensional many-body dynamical choreography which is often non-intuitive even for highly trained researchers. We recently described how interactive molecular dynamics in virtual reality (iMD-VR) can help to meet this challenge, enabling researchers to manipulate real-time MD simulations of flexible structures in 3D. In this article, we outline efforts to extend immersive technologies to the molecular sciences, and we introduce 'Narupa', a flexible, open-source, multi-person iMD-VR software framework which enables groups of researchers to simultaneously cohabit real-time simulation environments to interactively visualize and manipulate the dynamics of molecular structures with atomic-level precision. We outline several application domains where iMD-VR is facilitating research, communication, and creative approaches within the molecular sciences, including training machines to learn reactive potential energy surfaces (PESs), biomolecular conformational sampling, protein-ligand binding, reaction discovery using 'on-the-fly' quantum chemistry, and transport dynamics in materials. We touch on iMD-VR's various cognitive and perceptual affordances, and how these provide research insight for molecular systems. By synergistically combining human spatial reasoning and design insight with computational automation, technologies like iMD-VR have the potential to improve our ability to understand, engineer, and communicate microscopic dynamical behavior, offering the potential to usher in a new paradigm for engineering molecules and nano-architectures.
△ Less
Submitted 1 May, 2019; v1 submitted 5 February, 2019;
originally announced February 2019.
-
Somatic Practices for Understanding Real, Imagined, and Virtual Realities
Authors:
Lisa May Thomas,
Helen M. Deeks,
Alex J. Jones,
Oussama Metatla,
David R. Glowacki
Abstract:
In most VR experiences, the visual sense dominates other modes of sensory input, encouraging non-visual senses to respond as if the visual were real. The simulated visual world thus becomes a sort of felt actuality, where the 'actual' physical body and environment can 'drop away', opening up possibilities for designing entirely new kinds of experience. Most VR experiences place visual sensory inpu…
▽ More
In most VR experiences, the visual sense dominates other modes of sensory input, encouraging non-visual senses to respond as if the visual were real. The simulated visual world thus becomes a sort of felt actuality, where the 'actual' physical body and environment can 'drop away', opening up possibilities for designing entirely new kinds of experience. Most VR experiences place visual sensory input (of the simulated environment) in the perceptual foreground, and the physical body in the background. In what follows, we discuss methods for resolving the apparent tension which arises from VR's prioritization of visual perception. We specifically aim to understand how somatic techniques encouraging participants to 'attend to their attention' enable them to access more subtle aspects of sensory phenomena in a VR experience, bound neither by rigid definitions of vision-based virtuality nor body-based corporeality. During a series of workshops, we implemented experimental somatic-dance practices to better understand perceptual and imaginative subtleties that arise for participants whilst they are embedded in a multi-person VR framework. Our preliminary observations suggest that somatic methods can be used to design VR experiences which enable (i) a tactile quality or felt sense of phenomena in the virtual environment (VE), (ii) lingering impacts on participant imagination even after the VR headset is taken off, and (iii) an expansion of imaginative potential.
△ Less
Submitted 11 January, 2019;
originally announced January 2019.
-
Sampling molecular conformations and dynamics in a multi-user virtual reality framework
Authors:
Michael O Connor,
Helen M. Deeks,
Edward Dawn,
Oussama Metatla,
Anne Roudaut,
Matthew Sutton,
Becca Rose Glowacki,
Rebecca Sage,
Philip Tew,
Mark Wonnacott,
Phil Bates,
Adrian J. Mulholland,
David R. Glowacki
Abstract:
We describe a framework for interactive molecular dynamics in a multiuser virtual reality environment, combining rigorous cloud-mounted physical atomistic simulation with commodity virtual reality hardware, which we have made accessible to readers (see isci.itch.io/nsb-imd). It allows users to visualize and sample, with atomic-level precision, the structures and dynamics of complex molecular struc…
▽ More
We describe a framework for interactive molecular dynamics in a multiuser virtual reality environment, combining rigorous cloud-mounted physical atomistic simulation with commodity virtual reality hardware, which we have made accessible to readers (see isci.itch.io/nsb-imd). It allows users to visualize and sample, with atomic-level precision, the structures and dynamics of complex molecular structures 'on the fly', and to interact with other users in the same virtual environment. A series of controlled studies, wherein participants were tasked with a range of molecular manipulation goals (threading methane through a nanotube, changing helical screw-sense, and tying a protein knot), quantitatively demonstrate that users within the interactive VR environment can complete sophisticated molecular modelling tasks more quickly than they can using conventional interfaces, especially for molecular pathways and structural transitions whose conformational choreographies are intrinsically 3d. This framework should accelerate progress in nanoscale molecular engineering areas such as drug development, synthetic biology, and catalyst design. More broadly, our findings highlight VR's potential in scientific domains where 3d dynamics matter, spanning research and education.
△ Less
Submitted 9 January, 2018;
originally announced January 2018.
