-
Calibration and generalizability of probabilistic models on low-data chemical datasets with DIONYSUS
Authors:
Gary Tom,
Riley J. Hickman,
Aniket Zinzuwadia,
Afshan Mohajeri,
Benjamin Sanchez-Lengeling,
Alan Aspuru-Guzik
Abstract:
Deep learning models that leverage large datasets are often the state of the art for modelling molecular properties. When the datasets are smaller (< 2000 molecules), it is not clear that deep learning approaches are the right modelling tool. In this work we perform an extensive study of the calibration and generalizability of probabilistic machine learning models on small chemical datasets. Using…
▽ More
Deep learning models that leverage large datasets are often the state of the art for modelling molecular properties. When the datasets are smaller (< 2000 molecules), it is not clear that deep learning approaches are the right modelling tool. In this work we perform an extensive study of the calibration and generalizability of probabilistic machine learning models on small chemical datasets. Using different molecular representations and models, we analyse the quality of their predictions and uncertainties in a variety of tasks (binary, regression) and datasets. We also introduce two simulated experiments that evaluate their performance: (1) Bayesian optimization guided molecular design, (2) inference on out-of-distribution data via ablated cluster splits. We offer practical insights into model and feature choice for modelling small chemical datasets, a common scenario in new chemical experiments. We have packaged our analysis into the DIONYSUS repository, which is open sourced to aid in reproducibility and extension to new datasets.
△ Less
Submitted 6 December, 2022; v1 submitted 3 December, 2022;
originally announced December 2022.
-
Machine Learning for Scent: Learning Generalizable Perceptual Representations of Small Molecules
Authors:
Benjamin Sanchez-Lengeling,
Jennifer N. Wei,
Brian K. Lee,
Richard C. Gerkin,
Alán Aspuru-Guzik,
Alexander B. Wiltschko
Abstract:
Predicting the relationship between a molecule's structure and its odor remains a difficult, decades-old task. This problem, termed quantitative structure-odor relationship (QSOR) modeling, is an important challenge in chemistry, impacting human nutrition, manufacture of synthetic fragrance, the environment, and sensory neuroscience. We propose the use of graph neural networks for QSOR, and show t…
▽ More
Predicting the relationship between a molecule's structure and its odor remains a difficult, decades-old task. This problem, termed quantitative structure-odor relationship (QSOR) modeling, is an important challenge in chemistry, impacting human nutrition, manufacture of synthetic fragrance, the environment, and sensory neuroscience. We propose the use of graph neural networks for QSOR, and show they significantly out-perform prior methods on a novel data set labeled by olfactory experts. Additional analysis shows that the learned embeddings from graph neural networks capture a meaningful odor space representation of the underlying relationship between structure and odor, as demonstrated by strong performance on two challenging transfer learning tasks. Machine learning has already had a large impact on the senses of sight and sound. Based on these early results with graph neural networks for molecular properties, we hope machine learning can eventually do for olfaction what it has already done for vision and hearing.
△ Less
Submitted 25 October, 2019; v1 submitted 23 October, 2019;
originally announced October 2019.
-
Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Models
Authors:
Daniil Polykovskiy,
Alexander Zhebrak,
Benjamin Sanchez-Lengeling,
Sergey Golovanov,
Oktai Tatanov,
Stanislav Belyaev,
Rauf Kurbanov,
Aleksey Artamonov,
Vladimir Aladinskiy,
Mark Veselov,
Artur Kadurin,
Simon Johansson,
Hongming Chen,
Sergey Nikolenko,
Alan Aspuru-Guzik,
Alex Zhavoronkov
Abstract:
Generative models are becoming a tool of choice for exploring the molecular space. These models learn on a large training dataset and produce novel molecular structures with similar properties. Generated structures can be utilized for virtual screening or training semi-supervised predictive models in the downstream tasks. While there are plenty of generative models, it is unclear how to compare an…
▽ More
Generative models are becoming a tool of choice for exploring the molecular space. These models learn on a large training dataset and produce novel molecular structures with similar properties. Generated structures can be utilized for virtual screening or training semi-supervised predictive models in the downstream tasks. While there are plenty of generative models, it is unclear how to compare and rank them. In this work, we introduce a benchmarking platform called Molecular Sets (MOSES) to standardize training and comparison of molecular generative models. MOSES provides a training and testing datasets, and a set of metrics to evaluate the quality and diversity of generated structures. We have implemented and compared several molecular generation models and suggest to use our results as reference points for further advancements in generative chemistry research. The platform and source code are available at https://github.com/molecularsets/moses.
△ Less
Submitted 28 October, 2020; v1 submitted 29 November, 2018;
originally announced November 2018.
-
Objective-Reinforced Generative Adversarial Networks (ORGAN) for Sequence Generation Models
Authors:
Gabriel Lima Guimaraes,
Benjamin Sanchez-Lengeling,
Carlos Outeiral,
Pedro Luis Cunha Farias,
Alán Aspuru-Guzik
Abstract:
In unsupervised data generation tasks, besides the generation of a sample based on previous observations, one would often like to give hints to the model in order to bias the generation towards desirable metrics. We propose a method that combines Generative Adversarial Networks (GANs) and reinforcement learning (RL) in order to accomplish exactly that. While RL biases the data generation process t…
▽ More
In unsupervised data generation tasks, besides the generation of a sample based on previous observations, one would often like to give hints to the model in order to bias the generation towards desirable metrics. We propose a method that combines Generative Adversarial Networks (GANs) and reinforcement learning (RL) in order to accomplish exactly that. While RL biases the data generation process towards arbitrary metrics, the GAN component of the reward function ensures that the model still remembers information learned from data. We build upon previous results that incorporated GANs and RL in order to generate sequence data and test this model in several settings for the generation of molecules encoded as text sequences (SMILES) and in the context of music generation, showing for each case that we can effectively bias the generation process towards desired metrics.
△ Less
Submitted 6 February, 2018; v1 submitted 30 May, 2017;
originally announced May 2017.
-
Automatic chemical design using a data-driven continuous representation of molecules
Authors:
Rafael Gómez-Bombarelli,
Jennifer N. Wei,
David Duvenaud,
José Miguel Hernández-Lobato,
Benjamín Sánchez-Lengeling,
Dennis Sheberla,
Jorge Aguilera-Iparraguirre,
Timothy D. Hirzel,
Ryan P. Adams,
Alán Aspuru-Guzik
Abstract:
We report a method to convert discrete representations of molecules to and from a multidimensional continuous representation. This model allows us to generate new molecules for efficient exploration and optimization through open-ended spaces of chemical compounds. A deep neural network was trained on hundreds of thousands of existing chemical structures to construct three coupled functions: an enc…
▽ More
We report a method to convert discrete representations of molecules to and from a multidimensional continuous representation. This model allows us to generate new molecules for efficient exploration and optimization through open-ended spaces of chemical compounds. A deep neural network was trained on hundreds of thousands of existing chemical structures to construct three coupled functions: an encoder, a decoder and a predictor. The encoder converts the discrete representation of a molecule into a real-valued continuous vector, and the decoder converts these continuous vectors back to discrete molecular representations. The predictor estimates chemical properties from the latent continuous vector representation of the molecule. Continuous representations allow us to automatically generate novel chemical structures by performing simple operations in the latent space, such as decoding random vectors, perturbing known chemical structures, or interpolating between molecules. Continuous representations also allow the use of powerful gradient-based optimization to efficiently guide the search for optimized functional compounds. We demonstrate our method in the domain of drug-like molecules and also in the set of molecules with fewer that nine heavy atoms.
△ Less
Submitted 5 December, 2017; v1 submitted 7 October, 2016;
originally announced October 2016.
