-
Molecular Diffusion Models with Virtual Receptors
Authors:
Matan Halfon,
Eyal Rozenberg,
Ehud Rivlin,
Daniel Freedman
Abstract:
Machine learning approaches to Structure-Based Drug Design (SBDD) have proven quite fertile over the last few years. In particular, diffusion-based approaches to SBDD have shown great promise. We present a technique which expands on this diffusion approach in two crucial ways. First, we address the size disparity between the drug molecule and the target/receptor, which makes learning more challeng…
▽ More
Machine learning approaches to Structure-Based Drug Design (SBDD) have proven quite fertile over the last few years. In particular, diffusion-based approaches to SBDD have shown great promise. We present a technique which expands on this diffusion approach in two crucial ways. First, we address the size disparity between the drug molecule and the target/receptor, which makes learning more challenging and inference slower. We do so through the notion of a Virtual Receptor, which is a compressed version of the receptor; it is learned so as to preserve key aspects of the structural information of the original receptor, while respecting the relevant group equivariance. Second, we incorporate a protein language embedding used originally in the context of protein folding. We experimentally demonstrate the contributions of both the virtual receptors and the protein embeddings: in practice, they lead to both better performance, as well as significantly faster computations.
△ Less
Submitted 26 June, 2024;
originally announced June 2024.
-
A Theoretical Framework for an Efficient Normalizing Flow-Based Solution to the Schrodinger Equation
Authors:
Daniel Freedman,
Eyal Rozenberg,
Alex Bronstein
Abstract:
A central problem in quantum mechanics involves solving the Electronic Schrodinger Equation for a molecule or material. The Variational Monte Carlo approach to this problem approximates a particular variational objective via sampling, and then optimizes this approximated objective over a chosen parameterized family of wavefunctions, known as the ansatz. Recently neural networks have been used as t…
▽ More
A central problem in quantum mechanics involves solving the Electronic Schrodinger Equation for a molecule or material. The Variational Monte Carlo approach to this problem approximates a particular variational objective via sampling, and then optimizes this approximated objective over a chosen parameterized family of wavefunctions, known as the ansatz. Recently neural networks have been used as the ansatz, with accompanying success. However, sampling from such wavefunctions has required the use of a Markov Chain Monte Carlo approach, which is inherently inefficient. In this work, we propose a solution to this problem via an ansatz which is cheap to sample from, yet satisfies the requisite quantum mechanical properties. We prove that a normalizing flow using the following two essential ingredients satisfies our requirements: (a) a base distribution which is constructed from Determinantal Point Processes; (b) flow layers which are equivariant to a particular subgroup of the permutation group. We then show how to construct both continuous and discrete normalizing flows which satisfy the requisite equivariance. We further demonstrate the manner in which the non-smooth nature ("cusps") of the wavefunction may be captured, and how the framework may be generalized to provide induction across multiple molecules. The resulting theoretical framework entails an efficient approach to solving the Electronic Schrodinger Equation.
△ Less
Submitted 28 May, 2024;
originally announced June 2024.
-
Overcoming Order in Autoregressive Graph Generation
Authors:
Edo Cohen-Karlik,
Eyal Rozenberg,
Daniel Freedman
Abstract:
Graph generation is a fundamental problem in various domains, including chemistry and social networks. Recent work has shown that molecular graph generation using recurrent neural networks (RNNs) is advantageous compared to traditional generative approaches which require converting continuous latent representations into graphs. One issue which arises when treating graph generation as sequential ge…
▽ More
Graph generation is a fundamental problem in various domains, including chemistry and social networks. Recent work has shown that molecular graph generation using recurrent neural networks (RNNs) is advantageous compared to traditional generative approaches which require converting continuous latent representations into graphs. One issue which arises when treating graph generation as sequential generation is the arbitrary order of the sequence which results from a particular choice of graph flattening method. In this work we propose using RNNs, taking into account the non-sequential nature of graphs by adding an Orderless Regularization (OLR) term that encourages the hidden state of the recurrent model to be invariant to different valid orderings present under the training distribution. We demonstrate that sequential graph generation models benefit from our proposed regularization scheme, especially when data is scarce. Our findings contribute to the growing body of research on graph generation and provide a valuable tool for various applications requiring the synthesis of realistic and diverse graph structures.
△ Less
Submitted 4 February, 2024;
originally announced February 2024.
-
Designing Nonlinear Photonic Crystals for High-Dimensional Quantum State Engineering
Authors:
Eyal Rozenberg,
Aviv Karnieli,
Ofir Yesharim,
Joshua Foley-Comer,
Sivan Trajtenberg-Mills,
Sarika Mishra,
Shashi Prabhakar,
Ravindra Pratap,
Daniel Freedman,
Alex M. Bronstein,
Ady Arie
Abstract:
We propose a novel, physically-constrained and differentiable approach for the generation of D-dimensional qudit states via spontaneous parametric down-conversion (SPDC) in quantum optics. We circumvent any limitations imposed by the inherently stochastic nature of the physical process and incorporate a set of stochastic dynamical equations governing its evolution under the SPDC Hamiltonian. We de…
▽ More
We propose a novel, physically-constrained and differentiable approach for the generation of D-dimensional qudit states via spontaneous parametric down-conversion (SPDC) in quantum optics. We circumvent any limitations imposed by the inherently stochastic nature of the physical process and incorporate a set of stochastic dynamical equations governing its evolution under the SPDC Hamiltonian. We demonstrate the effectiveness of our model through the design of structured nonlinear photonic crystals (NLPCs) and shaped pump beams; and show, theoretically and experimentally, how to generate maximally entangled states in the spatial degree of freedom. The learning of NLPC structures offers a promising new avenue for sha** and controlling arbitrary quantum states and enables all-optical coherent control of the generated states. We believe that this approach can readily be extended from bulky crystals to thin Metasurfaces and potentially applied to other quantum systems sharing a similar Hamiltonian structures, such as superfluids and superconductors.
△ Less
Submitted 13 April, 2023;
originally announced April 2023.
-
Semi-Equivariant Conditional Normalizing Flows
Authors:
Eyal Rozenberg,
Daniel Freedman
Abstract:
We study the problem of learning conditional distributions of the form $p(G | \hat G)$, where $G$ and $\hat G$ are two 3D graphs, using continuous normalizing flows. We derive a semi-equivariance condition on the flow which ensures that conditional invariance to rigid motions holds. We demonstrate the effectiveness of the technique in the molecular setting of receptor-aware ligand generation.
We study the problem of learning conditional distributions of the form $p(G | \hat G)$, where $G$ and $\hat G$ are two 3D graphs, using continuous normalizing flows. We derive a semi-equivariance condition on the flow which ensures that conditional invariance to rigid motions holds. We demonstrate the effectiveness of the technique in the molecular setting of receptor-aware ligand generation.
△ Less
Submitted 13 April, 2023;
originally announced April 2023.
-
Semi-Equivariant Continuous Normalizing Flows for Target-Aware Molecule Generation
Authors:
Eyal Rozenberg,
Daniel Freedman
Abstract:
We propose an algorithm for learning a conditional generative model of a molecule given a target. Specifically, given a receptor molecule that one wishes to bind to, the conditional model generates candidate ligand molecules that may bind to it. The distribution should be invariant to rigid body transformations that act $\textit{jointly}$ on the ligand and the receptor; it should also be invariant…
▽ More
We propose an algorithm for learning a conditional generative model of a molecule given a target. Specifically, given a receptor molecule that one wishes to bind to, the conditional model generates candidate ligand molecules that may bind to it. The distribution should be invariant to rigid body transformations that act $\textit{jointly}$ on the ligand and the receptor; it should also be invariant to permutations of either the ligand or receptor atoms. Our learning algorithm is based on a continuous normalizing flow. We establish semi-equivariance conditions on the flow which guarantee the aforementioned invariance conditions on the conditional distribution. We propose a graph neural network architecture which implements this flow, and which is designed to learn effectively despite the vast differences in size between the ligand and receptor. We evaluate our method on the CrossDocked2020 dataset, attaining a significant improvement in binding affinity over competing methods.
△ Less
Submitted 9 November, 2022;
originally announced November 2022.
-
SPDCinv: Inverse Quantum-Optical Design of High-Dimensional Qudits
Authors:
Eyal Rozenberg,
Aviv Karnieli,
Ofir Yesharim,
Joshua Foley-Comer,
Sivan Trajtenberg-Mills,
Daniel Freedman,
Alex M. Bronstein,
Ady Arie
Abstract:
Spontaneous parametric down-conversion in quantum optics is an invaluable resource for the realization of high-dimensional qudits with spatial modes of light. One of the main open challenges is how to directly generate a desirable qudit state in the SPDC process. This problem can be addressed through advanced computational learning methods; however, due to difficulties in modeling the SPDC process…
▽ More
Spontaneous parametric down-conversion in quantum optics is an invaluable resource for the realization of high-dimensional qudits with spatial modes of light. One of the main open challenges is how to directly generate a desirable qudit state in the SPDC process. This problem can be addressed through advanced computational learning methods; however, due to difficulties in modeling the SPDC process by a fully differentiable algorithm that takes into account all interaction effects, progress has been limited. Here, we overcome these limitations and introduce a physically-constrained and differentiable model, validated against experimental results for shaped pump beams and structured crystals, capable of learning every interaction parameter in the process. We avoid any restrictions induced by the stochastic nature of our physical model and integrate the dynamic equations governing the evolution under the SPDC Hamiltonian. We solve the inverse problem of designing a nonlinear quantum optical system that achieves the desired quantum state of down-converted photon pairs. The desired states are defined using either the second-order correlations between different spatial modes or by specifying the required density matrix. By learning nonlinear volume holograms as well as different pump shapes, we successfully show how to generate maximally entangled states. Furthermore, we simulate all-optical coherent control over the generated quantum state by actively changing the profile of the pump beam. Our work can be useful for applications such as novel designs of high-dimensional quantum key distribution and quantum information processing protocols. In addition, our method can be readily applied for controlling other degrees of freedom of light in the SPDC process, such as the spectral and temporal properties, and may even be used in condensed-matter systems having a similar interaction Hamiltonian.
△ Less
Submitted 11 December, 2021;
originally announced December 2021.
-
Inverse Design of Quantum Holograms in Three-Dimensional Nonlinear Photonic Crystals
Authors:
Eyal Rozenberg,
Aviv Karnieli,
Ofir Yesharim,
Sivan Trajtenberg-Mills,
Daniel Freedman,
Alex M. Bronstein,
Ady Arie
Abstract:
We introduce a systematic approach for designing 3D nonlinear photonic crystals and pump beams for generating desired quantum correlations between structured photon-pairs. Our model is fully differentiable, allowing accurate and efficient learning and discovery of novel designs.
We introduce a systematic approach for designing 3D nonlinear photonic crystals and pump beams for generating desired quantum correlations between structured photon-pairs. Our model is fully differentiable, allowing accurate and efficient learning and discovery of novel designs.
△ Less
Submitted 20 February, 2021;
originally announced February 2021.
-
Broadband and robust adiabatic second-harmonic generation by a temperature gradient in birefringently phase-matched lithium triborate crystal
Authors:
Eyal Rozenberg,
Ady Arie
Abstract:
Phase-matched nonlinear processes exhibit a tradeoff between the conversion efficiency and the acceptance bandwidth. Adiabatic nonlinear processes, in which the phase mismatch varies slowly along the interaction length, enable us to overcome this tradeoff, allowing an efficient frequency conversion with broad spectral and thermal bandwidths. Until now, the variation in the phase mismatch condition…
▽ More
Phase-matched nonlinear processes exhibit a tradeoff between the conversion efficiency and the acceptance bandwidth. Adiabatic nonlinear processes, in which the phase mismatch varies slowly along the interaction length, enable us to overcome this tradeoff, allowing an efficient frequency conversion with broad spectral and thermal bandwidths. Until now, the variation in the phase mismatch condition was mainly based on quasi-phase matching in ferroelectric crystals. However, this solution is limited to low power sources. Here, instead, we study the adiabatic second harmonic in birefringently phase-matched lithium triborate crystal, enabling us to handle much higher power levels. The variation in the phase mismatch is achieved by inducing a temperature gradient along the crystal. By using a 50 mm long crystal, the adiabatic process provided a temperature bandwidth of 18-celsius degrees, 5.4 times wider than what is achieved when the same crystal is held at the fixed phasematching temperature. The conversion efficiency exceeded 60% for a 0.9 millijoule pump pulse.
△ Less
Submitted 19 September, 2019;
originally announced September 2019.
-
Localization with Limited Annotation for Chest X-rays
Authors:
Eyal Rozenberg,
Daniel Freedman,
Alex Bronstein
Abstract:
Localization of an object within an image is a common task in medical imaging. Learning to localize or detect objects typically requires the collection of data which has been labelled with bounding boxes or similar annotations, which can be very time consuming and expensive. A technique which could perform such learning with much less annotation would, therefore, be quite valuable. We present such…
▽ More
Localization of an object within an image is a common task in medical imaging. Learning to localize or detect objects typically requires the collection of data which has been labelled with bounding boxes or similar annotations, which can be very time consuming and expensive. A technique which could perform such learning with much less annotation would, therefore, be quite valuable. We present such a technique for localization with limited annotation, in which the number of images with bounding boxes can be a small fraction of the total dataset (e.g. less than 1%); all other images only possess a whole image label and no bounding box. We propose a novel loss function for tackling this problem; the loss is a continuous relaxation of a well-defined discrete formulation of weakly supervised learning and is numerically well-posed. Furthermore, we propose a new architecture which accounts for both patch dependence and shift-invariance, through the inclusion of CRF layers and anti-aliasing filters, respectively. We apply our technique to the localization of thoracic diseases in chest X-ray images and demonstrate state-of-the-art localization performance on the ChestX-ray14 dataset.
△ Less
Submitted 10 October, 2019; v1 submitted 19 September, 2019;
originally announced September 2019.
-
A computational model for analytic column stores
Authors:
Eyal Rozenberg
Abstract:
This work presents an abstract model for the computations performed by analytic column stores or columnar query processors. The model is based on circuits whose wires carry columns rather than scalar values, and whose nodes apply operators with column inputs and outputs. This model allows expression of most of the architectural features of existing column-store DBMSes through columnar execution pl…
▽ More
This work presents an abstract model for the computations performed by analytic column stores or columnar query processors. The model is based on circuits whose wires carry columns rather than scalar values, and whose nodes apply operators with column inputs and outputs. This model allows expression of most of the architectural features of existing column-store DBMSes through columnar execution plans, rather than such features being implemented sui-generis, and without the column store maintaining significant out-of-plan data. A strict adherence to columnarity allows for a relatively simple and robust model; enabling extensive and intensive optimization of almost all aspects of query processing; and also enabling massive uniform parallelization of query process on modern hardware. Moreover, the computational model's expressivity makes it useful also as an \emph{analytical} tool for considering design aspects and features of existing column stores, individually and comparatively.
To achieve the model's wide expressiveness, much of this work develops representation schemes of relevant data structures as combinations of plain columns, with columnar circuits used as scheme encoders and decoders. A particular focus is given to schemes which also compress the data, and their use in query execution --- as an integral part of the computation: Subcircuits of larger columnar circuits, not black boxes. Decoder and encoder circuits are thus also composed to form more elaborate schemes. Such formulation allows both for an alternative view of well-known compression schemes, and for the development of new columnar compression schemes with useful features; these should be of independent interest irrespective of column store systems.
△ Less
Submitted 11 November, 2019; v1 submitted 27 April, 2019;
originally announced April 2019.
-
Widefield imaging of superconductor vortices with electron spins in diamond
Authors:
Yechezkel Schlussel,
Till Lenz,
Dominik Rohner,
Yaniv Bar-Haim,
Lykourgos Bougas,
David Groswasser,
Michael Kieschnick,
Evgeny Rozenberg,
Lucas Thiel,
Amir Waxman,
Jan Meijer,
Patrick Maletinsky,
Dmitry Budker,
Ron Folman
Abstract:
Understanding the mechanisms behind high-$T_{c}$ Type-II superconductors (SC) is still an open task in condensed matter physics. One way to gain further insight into the microscopic mechanisms leading to superconductivity is to study the magnetic properties of the SC in detail, for example by studying the properties of vortices and their dynamics. In this work we describe a new method of wide-fiel…
▽ More
Understanding the mechanisms behind high-$T_{c}$ Type-II superconductors (SC) is still an open task in condensed matter physics. One way to gain further insight into the microscopic mechanisms leading to superconductivity is to study the magnetic properties of the SC in detail, for example by studying the properties of vortices and their dynamics. In this work we describe a new method of wide-field imaging magnetometry using nitrogen-vacancy (NV) centers in diamond to image vortices in an yttrium barium copper oxide (YBCO) thin film. We demonstrate quantitative determination of the magnetic field strength of the vortex stray field, the observation of vortex patterns for different cooling fields and direct observation of vortex pinning in our disordered YBCO film. This method opens prospects for imaging of the magnetic-stray fields of vortices at frequencies from DC to several megahertz within a wide range of temperatures which allows for the study of both high-$T_{C}$ and low-$T_{C}$ SCs. The wide temperature range allowed by NV center magnetometry also makes our approach applicable for the study of phenomena like island superconductivity at elevated temperatures (e.g. in metal nano-clusters).
△ Less
Submitted 5 March, 2018;
originally announced March 2018.
-
Low temperature charge ordering versus grain boundary effects in polycrystalline La1-xCaxMnO3 manganites
Authors:
E. Rozenberg
Abstract:
In this communication the enhancement of low temperature magnetoresistance in polycrystalline La1-xCaxMnO3 manganites is discussed. It is shown that so-called grain boundary effects seem to be the simplest and natural explanation of this phenomenon.
In this communication the enhancement of low temperature magnetoresistance in polycrystalline La1-xCaxMnO3 manganites is discussed. It is shown that so-called grain boundary effects seem to be the simplest and natural explanation of this phenomenon.
△ Less
Submitted 19 April, 2004;
originally announced April 2004.
-
Comment on low-temperature transport properties of non-stoichiometric La_{0.95-x}Sr_{x}MnO_{3}
Authors:
E. Rozenberg,
M. Auslender
Abstract:
In a recent paper (Michalopolou A., Syskakis E. and Papastaikoudis C., 2001 J. Phys.: Cond. Mat. 13, 11615) the authors reported on the measurements of electrical resistivity and specific heat at zero magnetic field carried out on polycrystalline non-stoichiometric La_{0.95-x}Sr_{x}MnO_{3} manganites.In particular, they attributed the low temperature behavior of resistivity (shallow minimum and…
▽ More
In a recent paper (Michalopolou A., Syskakis E. and Papastaikoudis C., 2001 J. Phys.: Cond. Mat. 13, 11615) the authors reported on the measurements of electrical resistivity and specific heat at zero magnetic field carried out on polycrystalline non-stoichiometric La_{0.95-x}Sr_{x}MnO_{3} manganites.In particular, they attributed the low temperature behavior of resistivity (shallow minimum and slight upturn at lowest temperatures) to 3D electron-electron interaction enhanced by disorder, using results of numerical fittings of the dependencies of resistivity on temperature in the interval 4.2 -- 40 K. We argue that such an analysis may be not valid for polycrystalline manganites where relatively strong grain boundary effects might mask weak contribution of quantum effects to low temperature resistivity. The crucial test of applicability of the theory of quantum corrections to conductivity in this case is the resistive measurements under non-zero magnetic field.
△ Less
Submitted 6 January, 2002;
originally announced January 2002.
-
A nature of low-temperature resistivity minimum in ceramic manganites
Authors:
E. Rozenberg,
M. Auslender,
I. Felner,
G. Gorodetsky
Abstract:
Measurements of magnetoresistance and magnetization were carried out on ceramic samples of La_{0.5}Pb_{0.5}MnO_{3} and La_{0.5}Pb_{0.5}MnO_{3}, containing 10 at. % Ag in a dispersed form. The results obtained for the resistivity at zero applied magnetic field exhibit a shallow minimum at temperatures T about 25 K - 30 K, which shifts towards lower temperatures upon applying magnetic field and di…
▽ More
Measurements of magnetoresistance and magnetization were carried out on ceramic samples of La_{0.5}Pb_{0.5}MnO_{3} and La_{0.5}Pb_{0.5}MnO_{3}, containing 10 at. % Ag in a dispersed form. The results obtained for the resistivity at zero applied magnetic field exhibit a shallow minimum at temperatures T about 25 K - 30 K, which shifts towards lower temperatures upon applying magnetic field and disappears at a certain (rather low) field. Also the resistivity at helium temperature decreases upon applying magnetic fields. It is shown that the model of spin-dependent carrier tunneling between antiferromagnetically coupled grains may account for the results observed.
△ Less
Submitted 24 July, 2000;
originally announced July 2000.
