-
TwinBooster: Synergising Large Language Models with Barlow Twins and Gradient Boosting for Enhanced Molecular Property Prediction
Authors:
Maximilian G. Schuh,
Davide Boldini,
Stephan A. Sieber
Abstract:
The success of drug discovery and development relies on the precise prediction of molecular activities and properties. While in silico molecular property prediction has shown remarkable potential, its use has been limited so far to assays for which large amounts of data are available. In this study, we use a fine-tuned large language model to integrate biological assays based on their textual info…
▽ More
The success of drug discovery and development relies on the precise prediction of molecular activities and properties. While in silico molecular property prediction has shown remarkable potential, its use has been limited so far to assays for which large amounts of data are available. In this study, we use a fine-tuned large language model to integrate biological assays based on their textual information, coupled with Barlow Twins, a Siamese neural network using a novel self-supervised learning approach. This architecture uses both assay information and molecular fingerprints to extract the true molecular information. TwinBooster enables the prediction of properties of unseen bioassays and molecules by providing state-of-the-art zero-shot learning tasks. Remarkably, our artificial intelligence pipeline shows excellent performance on the FS-Mol benchmark. This breakthrough demonstrates the application of deep learning to critical property prediction tasks where data is typically scarce. By accelerating the early identification of active molecules in drug discovery and development, this method has the potential to help streamline the identification of novel therapeutics.
△ Less
Submitted 30 January, 2024; v1 submitted 9 January, 2024;
originally announced January 2024.
-
Bayesian Optimization of the Beam Injection Process into a Storage Ring
Authors:
Chenran Xu,
Tobias Boltz,
Akira Mochihashi,
Andrea Santamaria Garcia,
Marcel Schuh,
Anke-Susanne Müller
Abstract:
We have evaluated the data-efficient Bayesian optimization method for the specific task of injection tuning in a circular accelerator. In this paper, we describe the implementation of this method at the Karlsruhe Research Accelerator with up to nine tuning parameters, including the determination of the associated hyperparameters. We show that the Bayesian optimization method outperforms manual tun…
▽ More
We have evaluated the data-efficient Bayesian optimization method for the specific task of injection tuning in a circular accelerator. In this paper, we describe the implementation of this method at the Karlsruhe Research Accelerator with up to nine tuning parameters, including the determination of the associated hyperparameters. We show that the Bayesian optimization method outperforms manual tuning and the commonly used Nelder-Mead optimization algorithm both in simulation and experiment. The algorithm was also successfully used to ease the commissioning phase after the installation of new injection magnets and is regularly used during accelerator operations. We demonstrate that the introduction of context variables that include intra-bunch scattering effects, such as the Touschek effect, further improves the control and robustness of the injection process.
△ Less
Submitted 6 March, 2023; v1 submitted 17 November, 2022;
originally announced November 2022.
-
Detuning Properties of RF Phase Modulation in the Electron Storage Ring KARA
Authors:
Akira Mochihashi,
Sebastian Maier,
Edmund Blomley,
Marcel Schuh,
Erhard Huttel,
Tobias Boltz,
Benjamin Kehrer,
Anke-Susanne Müller,
Dmitry Teytelman
Abstract:
In electron storage rings, it is possible to increase the electron bunch length by applying a phase modulation on the radio frequency accelerating field by choosing appropriate parameters for the modulation. Such a bunch lengthening effect improves beam parameters such as the beam lifetime, which can help us to get better beam stability. The dependence of the bunch lengthening on the modulation fr…
▽ More
In electron storage rings, it is possible to increase the electron bunch length by applying a phase modulation on the radio frequency accelerating field by choosing appropriate parameters for the modulation. Such a bunch lengthening effect improves beam parameters such as the beam lifetime, which can help us to get better beam stability. The dependence of the bunch lengthening on the modulation frequency, the so-called detuning property, tends to have a peak with asymmetric slopes around it. The modulation amplitude and the beam current also affect the properties of the detuning condition of such bunch lengthening. We have investigated the detuning property with systematic measurements at the electron storage ring KARA. The experimental results agree with the theoretical model and the simulation results.
△ Less
Submitted 30 November, 2021;
originally announced November 2021.
-
Revealing the dynamics of ultrarelativistic non-equilibrium many-electron systems with phase space tomography
Authors:
Stefan Funkner,
Gudrun Niehues,
Michael J. Nasse,
Erik Bründermann,
Michele Caselle,
Benjamin Kehrer,
Lorenzo Rota,
Patrik Schönfeldt,
Marcel Schuh,
Bernd Steffen,
Johannes L. Steinmann,
Marc Weber,
Anke-Susanne Müller
Abstract:
The description of physical processes with many-particle systems is a key approach to the modeling of countless physical systems. In storage rings, where ultrarelativistic particles are agglomerated in dense bunches, the measurement of their phase-space distribution (PSD) is of paramount importance: at any time the PSD not only determines the complete space-time evolution but also provides fundame…
▽ More
The description of physical processes with many-particle systems is a key approach to the modeling of countless physical systems. In storage rings, where ultrarelativistic particles are agglomerated in dense bunches, the measurement of their phase-space distribution (PSD) is of paramount importance: at any time the PSD not only determines the complete space-time evolution but also provides fundamental performance characteristics for storage ring operation. Here, we demonstrate a non-destructive tomographic imaging technique for the 2D longitudinal PSD of ultrarelativistic electron bunches. For this purpose, we utilize a unique setup, which streams turn-by-turn near-field measurements of bunch profiles at MHz repetition rates. To demonstrate the feasibility of our method, we induce a non-equilibrium state and show, that the PSD microstructuring as well as the PSD dynamics can be observed in great detail with an unprecedented resolution. Our approach offers a pathway to control ultrashort bunches and supports, as one example, the development of compact accelerators with low energy footprints.
△ Less
Submitted 3 December, 2019;
originally announced December 2019.
-
Systematic Studies of the Micro-Bunching Instability at Very Low Bunch Charges
Authors:
Miriam Brosi,
Johannes L. Steinmann,
Edmund Blomley,
Erik Bründermann,
Julian Gethmann,
Benjamin Kehrer,
Yves-Laurent Mathis,
Alexander Papash,
Manuel Schedler,
Patrik Schönfeldt,
Marcel Schuh,
Markus Schwarz,
Michele Caselle,
Lorenzo Rota,
Marc Weber,
Peter Kuske,
Anke-Susanne Müller
Abstract:
At KARA, the KArlsruhe Research Accelerator of the KIT synchrotron, the so called short bunch operation mode allows the reduction of the bunch length down to a few picoseconds. The micro- bunching instability resulting from the high degree of longitudinal compression leads to fluctuations in the emitted THz radiation, referred to as bursting. For extremely compressed bunches at KARA, bursting occu…
▽ More
At KARA, the KArlsruhe Research Accelerator of the KIT synchrotron, the so called short bunch operation mode allows the reduction of the bunch length down to a few picoseconds. The micro- bunching instability resulting from the high degree of longitudinal compression leads to fluctuations in the emitted THz radiation, referred to as bursting. For extremely compressed bunches at KARA, bursting occurs not only in one but in two different bunch-current ranges that are separated by a stable region. This work presents measurements of the bursting behavior in both regimes. Good agreement is found between data and numerical solutions of the Vlasov-Fokker-Planck equation.
△ Less
Submitted 3 July, 2018;
originally announced July 2018.
-
Continuous bunch-by-bunch spectroscopic investigation of the micro-bunching instability
Authors:
Johannes L. Steinmann,
Tobias Boltz,
Miriam Brosi,
Erik Bründermann,
Michele Caselle,
Benjamin Kehrer,
Lorenzo Rota,
Patrik Schönfeldt,
Marcel Schuh,
Michael Siegel,
Marc Weber,
Anke-Susanne Müller
Abstract:
Electron accelerators and synchrotrons can be operated to provide short emission pulses due to longitudinally compressed or sub-structured electron bunches. Above a threshold current, the high charge density leads to the micro-bunching instability and the formation of sub-structures on the bunch shape. These time-varying sub-structures on bunches of picoseconds-long duration lead to bursts of cohe…
▽ More
Electron accelerators and synchrotrons can be operated to provide short emission pulses due to longitudinally compressed or sub-structured electron bunches. Above a threshold current, the high charge density leads to the micro-bunching instability and the formation of sub-structures on the bunch shape. These time-varying sub-structures on bunches of picoseconds-long duration lead to bursts of coherent synchrotron radiation in the terahertz frequency range. Therefore, the spectral information in this range contains valuable information about the bunch length, shape and sub-structures. Based on the KAPTURE readout system, a 4-channel single-shot THz spectrometer capable of recording 500 million spectra per second and streaming readout is presented. First measurements of time-resolved spectra are compared to simulation results of the Inovesa Vlasov-Fokker-Planck solver. The presented results lead to a better understanding of the bursting dynamics especially above the micro-bunching instability threshold.
△ Less
Submitted 4 October, 2018; v1 submitted 26 October, 2017;
originally announced October 2017.
-
Simultaneous Detection of Longitudinal and Transverse Bunch Signals at a Storage Ring
Authors:
Benjamin Kehrer,
Miriam Brosi,
Johannes L. Steinmann,
Edmund Blomley,
Erik Bründermann,
Michele Caselle,
Stefan Funkner,
Nicole Hiller,
Michael J. Nasse,
Gudrun Niehues,
Lorenzo Rota,
Manuel Schedler,
Patrik Schönfeldt,
Marcel Schuh,
Paul Schütze,
Marc Weber,
Anke-Susanne Müller
Abstract:
To understand and control the dynamics in the longitudinal phase space, time-resolved measurements of different bunch parameters are required. For a reconstruction of this phase space, the detector systems have to be synchronized. This reconstruction can be used e.g. for studies of the micro-bunching instability. It occurs if the interaction of the bunch with its own radiation leads to the formati…
▽ More
To understand and control the dynamics in the longitudinal phase space, time-resolved measurements of different bunch parameters are required. For a reconstruction of this phase space, the detector systems have to be synchronized. This reconstruction can be used e.g. for studies of the micro-bunching instability. It occurs if the interaction of the bunch with its own radiation leads to the formation of sub-structures on the longitudinal bunch profile. These sub-structures can grow rapidly -- leading to a sawtooth-like behaviour of the bunch. At KARA, we use a fast-gated intensified camera for energy spread studies, Schottky diodes for coherent synchrotron radiation studies as well as electro-optical spectral decoding for longitudinal bunch profile measurements. For a synchronization, a hardware synchronization scheme is used which compensates for eventual hardware delays. In this paper, the different experimental setups and their synchronization are discussed and first results of synchronous measurements are presented.
△ Less
Submitted 2 October, 2018; v1 submitted 26 September, 2017;
originally announced September 2017.
-
Fast Map** of Terahertz Bursting Thresholds and Characteristics at Synchrotron Light Sources
Authors:
Miriam Brosi,
Johannes L. Steinmann,
Edmund Blomley,
Erik Bründermann,
Michele Caselle,
Nicole Hiller,
Benjamin Kehrer,
Michael J. Nasse,
Lorenzo Rota,
Manuel Schedler,
Patrik Schönfeldt,
Marcel Schuh,
Markus Schwarz,
Marc Weber,
Anke-Susanne Müller
Abstract:
Dedicated optics with extremely short electron bunches enable synchrotron light sources to generate intense coherent THz radiation. The high degree of spatial compression in this so-called low-alpha optics entails a complex longitudinal dynamics of the electron bunches, which can be probed studying the fluctuations in the emitted terahertz radiation caused by the micro-bunching instability ("burst…
▽ More
Dedicated optics with extremely short electron bunches enable synchrotron light sources to generate intense coherent THz radiation. The high degree of spatial compression in this so-called low-alpha optics entails a complex longitudinal dynamics of the electron bunches, which can be probed studying the fluctuations in the emitted terahertz radiation caused by the micro-bunching instability ("bursting"). This article presents a "quasi-instantaneous" method for measuring the bursting characteristics by simultaneously collecting and evaluating the information from all bunches in a multi-bunch fill, reducing the measurement time from hours to seconds. This speed-up allows systematic studies of the bursting characteristics for various accelerator settings within a single fill of the machine, enabling a comprehensive comparison of the measured bursting thresholds with theoretical predictions by the bunched-beam theory. This paper introduces the method and presents first results obtained at the ANKA synchrotron radiation facility.
△ Less
Submitted 2 May, 2016;
originally announced May 2016.
-
Classical calculation of relativistic frequency-shifts in an ideal Penning trap
Authors:
Jochen Ketter,
Tommi Eronen,
Martin Höcker,
Marc Schuh,
Sebastian Streubel,
Klaus Blaum
Abstract:
The ideal Penning trap consists of a uniform magnetic field and an electrostatic quadrupole potential. In the classical low-energy limit, the three characteristic eigenfrequencies of a charged particle trapped in this configuration do not depend on the amplitudes of the three eigenmotions. No matter how accurate the experimental realization of the ideal Penning trap, its harmonicity is ultimately…
▽ More
The ideal Penning trap consists of a uniform magnetic field and an electrostatic quadrupole potential. In the classical low-energy limit, the three characteristic eigenfrequencies of a charged particle trapped in this configuration do not depend on the amplitudes of the three eigenmotions. No matter how accurate the experimental realization of the ideal Penning trap, its harmonicity is ultimately compromised by special relativity. Using a classical formalism of first-order perturbation theory, we calculate the relativistic frequency-shifts associated with the motional degrees of freedom for a spinless particle stored in an ideal Penning trap, and we compare the results with the simple but surprisingly accurate model of relativistic mass-increase.
△ Less
Submitted 6 March, 2014; v1 submitted 16 October, 2013;
originally announced October 2013.