-
YOLO-FEDER FusionNet: A Novel Deep Learning Architecture for Drone Detection
Authors:
Tamara R. Lenhard,
Andreas Weinmann,
Stefan Jäger,
Tobias Koch
Abstract:
Predominant methods for image-based drone detection frequently rely on employing generic object detection algorithms like YOLOv5. While proficient in identifying drones against homogeneous backgrounds, these algorithms often struggle in complex, highly textured environments. In such scenarios, drones seamlessly integrate into the background, creating camouflage effects that adversely affect the de…
▽ More
Predominant methods for image-based drone detection frequently rely on employing generic object detection algorithms like YOLOv5. While proficient in identifying drones against homogeneous backgrounds, these algorithms often struggle in complex, highly textured environments. In such scenarios, drones seamlessly integrate into the background, creating camouflage effects that adversely affect the detection quality. To address this issue, we introduce a novel deep learning architecture called YOLO-FEDER FusionNet. Unlike conventional approaches, YOLO-FEDER FusionNet combines generic object detection methods with the specialized strength of camouflage object detection techniques to enhance drone detection capabilities. Comprehensive evaluations of YOLO-FEDER FusionNet show the efficiency of the proposed model and demonstrate substantial improvements in both reducing missed detections and false alarms.
△ Less
Submitted 17 June, 2024;
originally announced June 2024.
-
Improved Three-Dimensional Reconstructions in Electron Ptychography through Defocus Series Measurements
Authors:
Marcel Schloz,
Thomas C. Pekin,
Hamish G. Brown,
Dana O. Byrne,
Bryan D. Esser,
Emmanuel Terzoudis-Lumsden,
Takashi Taniguchi,
Kenji Watanabe,
Scott D. Findlay,
Benedikt Haas,
Jim Ciston,
Christoph T. Koch
Abstract:
A detailed analysis of ptychography for 3D phase reconstructions of thick specimens is performed. We introduce multi-focus ptychography, which incorporates a 4D-STEM defocus series to enhance the quality of 3D reconstructions along the beam direction through a higher overdetermination ratio. This method is compared with established multi-slice ptychography techniques, such as conventional ptychogr…
▽ More
A detailed analysis of ptychography for 3D phase reconstructions of thick specimens is performed. We introduce multi-focus ptychography, which incorporates a 4D-STEM defocus series to enhance the quality of 3D reconstructions along the beam direction through a higher overdetermination ratio. This method is compared with established multi-slice ptychography techniques, such as conventional ptychography, regularized ptychography, and multi-mode ptychography. Additionally, we contrast multi-focus ptychography with an alternative method that uses virtual optical sectioning through a reconstructed scattering matrix ($\mathcal{S}$-matrix), which offers more precise 3D structure information compared to conventional ptychography. Our findings from multiple 3D reconstructions based on simulated and experimental data demonstrate that multi-focus ptychography surpasses other techniques, particularly in accurately reconstructing the surfaces and interface regions of thick specimens.
△ Less
Submitted 3 June, 2024;
originally announced June 2024.
-
Noise reduction by bias cooling in gated Si/SixGe1-x quantum dots
Authors:
Julian Ferrero,
Thomas Koch,
Sonja Vogel,
Daniel Schroller,
Viktor Adam,
Ran Xue,
Inga Seidler,
Lars R. Schreiber,
Hendrik Bluhm,
Wolfgang Wernsdorfer
Abstract:
Silicon-Germanium heterostructures are a promising quantum circuit platform, but crucial aspects as the long-term charge dynamics and cooldown-to-cooldown variations are still widely unexplored quantitatively. In this letter we present the results of an extensive bias cooling study performed on gated silicon-germanium quantum dots with an Al2O3-dielectric. Over 80 cooldowns were performed in the c…
▽ More
Silicon-Germanium heterostructures are a promising quantum circuit platform, but crucial aspects as the long-term charge dynamics and cooldown-to-cooldown variations are still widely unexplored quantitatively. In this letter we present the results of an extensive bias cooling study performed on gated silicon-germanium quantum dots with an Al2O3-dielectric. Over 80 cooldowns were performed in the course of our investigations. The performance of the devices is assessed by low-frequency charge noise measurements in the band of 200 micro Hertz to 10 milli Hertz. We measure the total noise power as a function of the applied voltage during cooldown in four different devices and find a minimum in noise at 0.7V bias cooling voltage for all observed samples. We manage to decrease the total noise power median by a factor of 6 and compute a reduced tunneling current density using Schrödinger-Poisson simulations. Furthermore, we show the variation in noise from the same device in the course of eleven different cooldowns performed under the nominally same conditions.
△ Less
Submitted 8 May, 2024; v1 submitted 30 April, 2024;
originally announced May 2024.
-
Putting Language into Context Using Smartphone-Based Keyboard Logging
Authors:
Florian Bemmann,
Timo Koch,
Maximilian Bergmann,
Clemens Stachl,
Daniel Buschek,
Ramona Schoedel,
Sven Mayer
Abstract:
While the study of language as typed on smartphones offers valuable insights, existing data collection methods often fall short in providing contextual information and ensuring user privacy. We present a privacy-respectful approach - context-enriched keyboard logging - that allows for the extraction of contextual information on the user's input motive, which is meaningful for linguistics, psycholo…
▽ More
While the study of language as typed on smartphones offers valuable insights, existing data collection methods often fall short in providing contextual information and ensuring user privacy. We present a privacy-respectful approach - context-enriched keyboard logging - that allows for the extraction of contextual information on the user's input motive, which is meaningful for linguistics, psychology, and behavioral sciences. In particular, with our approach, we enable distinguishing language contents by their channel (i.e., comments, messaging, search inputs). Filtering by channel allows for better pre-selection of data, which is in the interest of researchers and improves users' privacy. We demonstrate our approach on a large-scale six-month user study (N=624) of language use in smartphone interactions in the wild. Finally, we highlight the implications for research on language use in human-computer interaction and interdisciplinary contexts.
△ Less
Submitted 8 March, 2024;
originally announced March 2024.
-
On the Second-Order Asymptotics of the Hoeffding Test and Other Divergence Tests
Authors:
K. V. Harsha,
Jithin Ravi,
Tobias Koch
Abstract:
Consider a binary statistical hypothesis testing problem, where $n$ independent and identically distributed random variables $Z^n$ are either distributed according to the null hypothesis $P$ or the alternative hypothesis $Q$, and only $P$ is known. A well-known test that is suitable for this case is the so-called Hoeffding test, which accepts $P$ if the Kullback-Leibler (KL) divergence between the…
▽ More
Consider a binary statistical hypothesis testing problem, where $n$ independent and identically distributed random variables $Z^n$ are either distributed according to the null hypothesis $P$ or the alternative hypothesis $Q$, and only $P$ is known. A well-known test that is suitable for this case is the so-called Hoeffding test, which accepts $P$ if the Kullback-Leibler (KL) divergence between the empirical distribution of $Z^n$ and $P$ is below some threshold. This work characterizes the first and second-order terms of the type-II error probability for a fixed type-I error probability for the Hoeffding test as well as for divergence tests, where the KL divergence is replaced by a general divergence. It is demonstrated that, irrespective of the divergence, divergence tests achieve the first-order term of the Neyman-Pearson test, which is the optimal test when both $P$ and $Q$ are known. In contrast, the second-order term of divergence tests is strictly worse than that of the Neyman-Pearson test. It is further demonstrated that divergence tests with an invariant divergence achieve the same second-order term as the Hoeffding test, but divergence tests with a non-invariant divergence may outperform the Hoeffding test for some alternative hypotheses $Q$. Potentially, this behavior could be exploited by a composite hypothesis test with partial knowledge of the alternative hypothesis $Q$ by tailoring the divergence of the divergence test to the set of possible alternative hypotheses.
△ Less
Submitted 12 April, 2024; v1 submitted 6 March, 2024;
originally announced March 2024.
-
The SCIP Optimization Suite 9.0
Authors:
Suresh Bolusani,
Mathieu Besançon,
Ksenia Bestuzheva,
Antonia Chmiela,
João Dionísio,
Tim Donkiewicz,
Jasper van Doornmalen,
Leon Eifler,
Mohammed Ghannam,
Ambros Gleixner,
Christoph Graczyk,
Katrin Halbig,
Ivo Hedtke,
Alexander Hoen,
Christopher Hojny,
Rolf van der Hulst,
Dominik Kamp,
Thorsten Koch,
Kevin Kofler,
Jurgen Lentz,
Julian Manns,
Gioni Mexi,
Erik Mühmer,
Marc E. Pfetsch,
Franziska Schlösser
, et al. (6 additional authors not shown)
Abstract:
The SCIP Optimization Suite provides a collection of software packages for mathematical optimization, centered around the constraint integer programming (CIP) framework SCIP. This report discusses the enhancements and extensions included in the SCIP Optimization Suite 9.0. The updates in SCIP 9.0 include improved symmetry handling, additions and improvements of nonlinear handlers and primal heuris…
▽ More
The SCIP Optimization Suite provides a collection of software packages for mathematical optimization, centered around the constraint integer programming (CIP) framework SCIP. This report discusses the enhancements and extensions included in the SCIP Optimization Suite 9.0. The updates in SCIP 9.0 include improved symmetry handling, additions and improvements of nonlinear handlers and primal heuristics, a new cut generator and two new cut selection schemes, a new branching rule, a new LP interface, and several bug fixes. The SCIP Optimization Suite 9.0 also features new Rust and C++ interfaces for SCIP, new Python interface for SoPlex, along with enhancements to existing interfaces. The SCIP Optimization Suite 9.0 also includes new and improved features in the LP solver SoPlex, the presolving library PaPILO, the parallel framework UG, the decomposition framework GCG, and the SCIP extension SCIP-SDP. These additions and enhancements have resulted in an overall performance improvement of SCIP in terms of solving time, number of nodes in the branch-and-bound tree, as well as the reliability of the solver.
△ Less
Submitted 27 February, 2024;
originally announced February 2024.
-
PySCIPOpt-ML: Embedding Trained Machine Learning Models into Mixed-Integer Programs
Authors:
Mark Turner,
Antonia Chmiela,
Thorsten Koch,
Michael Winkler
Abstract:
A standard tool for modelling real-world optimisation problems is mixed-integer programming (MIP). However, for many of these problems, information about the relationships between variables is either incomplete or highly complex, making it difficult or even impossible to model the problem directly. To overcome these hurdles, machine learning (ML) predictors are often used to represent these relati…
▽ More
A standard tool for modelling real-world optimisation problems is mixed-integer programming (MIP). However, for many of these problems, information about the relationships between variables is either incomplete or highly complex, making it difficult or even impossible to model the problem directly. To overcome these hurdles, machine learning (ML) predictors are often used to represent these relationships and are then embedded in the MIP as surrogate models. Due to the large amount of available ML frameworks and the complexity of many ML predictors, formulating such predictors into MIPs is a highly non-trivial task. In this paper, we introduce PySCIPOpt-ML, an open-source tool for the automatic formulation and embedding of trained ML predictors into MIPs. By directly interfacing with a broad range of commonly used ML frameworks and an open-source MIP solver, PySCIPOpt-ML provides a way to easily integrate ML constraints into optimisation problems. Alongside PySCIPOpt-ML, we introduce, SurrogateLIB, a library of MIP instances with embedded ML constraints, and present computational results over SurrogateLIB, providing intuition on the scale of ML predictors that can be practically embedded. The project is available at https://github.com/Opt-Mucca/PySCIPOpt-ML.
△ Less
Submitted 23 May, 2024; v1 submitted 13 December, 2023;
originally announced December 2023.
-
Quantum Optimization: Potential, Challenges, and the Path Forward
Authors:
Amira Abbas,
Andris Ambainis,
Brandon Augustino,
Andreas Bärtschi,
Harry Buhrman,
Carleton Coffrin,
Giorgio Cortiana,
Vedran Dunjko,
Daniel J. Egger,
Bruce G. Elmegreen,
Nicola Franco,
Filippo Fratini,
Bryce Fuller,
Julien Gacon,
Constantin Gonciulea,
Sander Gribling,
Swati Gupta,
Stuart Hadfield,
Raoul Heese,
Gerhard Kircher,
Thomas Kleinert,
Thorsten Koch,
Georgios Korpas,
Steve Lenk,
Jakub Marecek
, et al. (21 additional authors not shown)
Abstract:
Recent advances in quantum computers are demonstrating the ability to solve problems at a scale beyond brute force classical simulation. As such, a widespread interest in quantum algorithms has developed in many areas, with optimization being one of the most pronounced domains. Across computer science and physics, there are a number of algorithmic approaches, often with little linkage. This is fur…
▽ More
Recent advances in quantum computers are demonstrating the ability to solve problems at a scale beyond brute force classical simulation. As such, a widespread interest in quantum algorithms has developed in many areas, with optimization being one of the most pronounced domains. Across computer science and physics, there are a number of algorithmic approaches, often with little linkage. This is further complicated by the fragmented nature of the field of mathematical optimization, where major classes of optimization problems, such as combinatorial optimization, convex optimization, non-convex optimization, and stochastic extensions, have devoted communities. With these aspects in mind, this work draws on multiple approaches to study quantum optimization. Provably exact versus heuristic settings are first explained using computational complexity theory - highlighting where quantum advantage is possible in each context. Then, the core building blocks for quantum optimization algorithms are outlined to subsequently define prominent problem classes and identify key open questions that, if answered, will advance the field. The effects of scaling relevant problems on noisy quantum devices are also outlined in detail, alongside meaningful benchmarking problems. We underscore the importance of benchmarking by proposing clear metrics to conduct appropriate comparisons with classical optimization techniques. Lastly, we highlight two domains - finance and sustainability - as rich sources of optimization problems that could be used to benchmark, and eventually validate, the potential real-world impact of quantum optimization.
△ Less
Submitted 4 December, 2023;
originally announced December 2023.
-
Reconstructing Lattice Vibrations of Crystals with Electron Ptychography
Authors:
Anton Gladyshev,
Benedikt Haas,
Tara M. Boland,
Peter Rez,
Christoph T. Koch
Abstract:
While capable of imaging the atoms constituting thin slabs of material, the achievable resolution of conventional electron imaging techniques in a transmission electron microscope (TEM) is very sensitive to the partial spatial coherence of the electron source, lens aberrations and mechanical instabilities of the microscope. The desire to break free from the limitations of the apparatus spurred the…
▽ More
While capable of imaging the atoms constituting thin slabs of material, the achievable resolution of conventional electron imaging techniques in a transmission electron microscope (TEM) is very sensitive to the partial spatial coherence of the electron source, lens aberrations and mechanical instabilities of the microscope. The desire to break free from the limitations of the apparatus spurred the popularity of ptychography, a computational phase retrieval technique that, to some extent, can compensate for the imperfections of the equipment. Recently it was shown that ptychography is capable of resolving specimen features as fine as the blurring due to the vibrations of atoms, a limit defined not by the microscope, but by the investigated sample itself. Here we report on the successful application of a mixed-object formalism in the ptychographic reconstruction that enables the resolution of fluctuations in atomic positions within real space. We show a reconstruction of a symmetric Σ9 grain boundary in silicon from realistically (molecular dynamics) simulated data. By reconstructing the object as an ensemble of 10 different states we were able to observe movements of atoms in the range of 0.1-0.2 Åin agreement with the expectation. This is a significant step forward in the field of electron ptychography, as it enables the study of dynamic systems with unprecedented precision and overcomes the resolution limit so far considered to be imposed by the thermal motion of the atoms.
△ Less
Submitted 21 September, 2023;
originally announced September 2023.
-
Charge-Trap**-Induced Compensation of the Ferroelectric Polarization in FTJs: Optimal Conditions for a Synaptic Device Operation
Authors:
R. Fontanini,
M. Segatto,
K. S. Nair,
M. Holzer,
F. Driussi,
I. Häusler,
C. T. Koch,
C. Dubourdieu,
V. Deshpande,
D. Esseni
Abstract:
In this work, we present a clear evidence, based on numerical simulations and experiments, that the polarization compensation due to trapped charge strongly influences the ON/ OFF ratio in Hf 0.5 Zr 0.5 O 2 (HZO)-based ferroelectric tunnel junctions (FTJs). Furthermore, we identify and explain compensation conditions that enable an optimal operation of FTJs. Our results provide both key physical i…
▽ More
In this work, we present a clear evidence, based on numerical simulations and experiments, that the polarization compensation due to trapped charge strongly influences the ON/ OFF ratio in Hf 0.5 Zr 0.5 O 2 (HZO)-based ferroelectric tunnel junctions (FTJs). Furthermore, we identify and explain compensation conditions that enable an optimal operation of FTJs. Our results provide both key physical insights and design guidelines for the operation of FTJs as multilevel synaptic devices.
△ Less
Submitted 4 September, 2023;
originally announced September 2023.
-
Stable and locally mass- and momentum-conservative control-volume finite-element schemes for the Stokes problem
Authors:
Martin Schneider,
Timo Koch
Abstract:
We introduce new control-volume finite-element discretization schemes suitable for solving the Stokes problem. Within a common framework, we present different approaches for constructing such schemes. The first and most established strategy employs a non-overlap** partitioning into control volumes. The second represents a new idea by splitting into two sets of control volumes, the first set yiel…
▽ More
We introduce new control-volume finite-element discretization schemes suitable for solving the Stokes problem. Within a common framework, we present different approaches for constructing such schemes. The first and most established strategy employs a non-overlap** partitioning into control volumes. The second represents a new idea by splitting into two sets of control volumes, the first set yielding a partition of the domain and the second containing the remaining overlap** control volumes required for stability. The third represents a hybrid approach where finite volumes are combined with finite elements based on a hierarchical splitting of the ansatz space. All approaches are based on typical finite element function spaces but yield locally mass and momentum conservative discretization schemes that can be interpreted as finite volume schemes. We apply all strategies to the inf-sub stable MINI finite-element pair. Various test cases, including convergence tests and the numerical observation of the boundedness of the number of preconditioned Krylov solver iterations, as well as more complex scenarios of flow around obstacles or through a three-dimensional vessel bifurcation, demonstrate the stability and robustness of the schemes.
△ Less
Submitted 1 September, 2023;
originally announced September 2023.
-
LORD: Leveraging Open-Set Recognition with Unknown Data
Authors:
Tobias Koch,
Christian Riess,
Thomas Köhler
Abstract:
Handling entirely unknown data is a challenge for any deployed classifier. Classification models are typically trained on a static pre-defined dataset and are kept in the dark for the open unassigned feature space. As a result, they struggle to deal with out-of-distribution data during inference. Addressing this task on the class-level is termed open-set recognition (OSR). However, most OSR method…
▽ More
Handling entirely unknown data is a challenge for any deployed classifier. Classification models are typically trained on a static pre-defined dataset and are kept in the dark for the open unassigned feature space. As a result, they struggle to deal with out-of-distribution data during inference. Addressing this task on the class-level is termed open-set recognition (OSR). However, most OSR methods are inherently limited, as they train closed-set classifiers and only adapt the downstream predictions to OSR. This work presents LORD, a framework to Leverage Open-set Recognition by exploiting unknown Data. LORD explicitly models open space during classifier training and provides a systematic evaluation for such approaches. We identify three model-agnostic training strategies that exploit background data and applied them to well-established classifiers. Due to LORD's extensive evaluation protocol, we consistently demonstrate improved recognition of unknown data. The benchmarks facilitate in-depth analysis across various requirement levels. To mitigate dependency on extensive and costly background datasets, we explore mixup as an off-the-shelf data generation technique. Our experiments highlight mixup's effectiveness as a substitute for background datasets. Lightweight constraints on mixup synthesis further improve OSR performance.
△ Less
Submitted 24 August, 2023;
originally announced August 2023.
-
Branching via Cutting Plane Selection: Improving Hybrid Branching
Authors:
Mark Turner,
Timo Berthold,
Mathieu Besançon,
Thorsten Koch
Abstract:
Cutting planes and branching are two of the most important algorithms for solving mixed-integer linear programs. For both algorithms, disjunctions play an important role, being used both as branching candidates and as the foundation for some cutting planes. We relate branching decisions and cutting planes to each other through the underlying disjunctions that they are based on, with a focus on Gom…
▽ More
Cutting planes and branching are two of the most important algorithms for solving mixed-integer linear programs. For both algorithms, disjunctions play an important role, being used both as branching candidates and as the foundation for some cutting planes. We relate branching decisions and cutting planes to each other through the underlying disjunctions that they are based on, with a focus on Gomory mixed-integer cuts and their corresponding split disjunctions. We show that selecting branching decisions based on quality measures of Gomory mixed-integer cuts leads to relatively small branch-and-bound trees, and that the result improves when using cuts that more accurately represent the branching decisions. Finally, we show how the history of previously computed Gomory mixed-integer cuts can be used to improve the performance of the state-of-the-art hybrid branching rule of SCIP. Our results show a 4% decrease in solve time, and an 8% decrease in number of nodes over affected instances of MIPLIB 2017.
△ Less
Submitted 7 July, 2023; v1 submitted 9 June, 2023;
originally announced June 2023.
-
How Many Clues To Give? A Bilevel Formulation For The Minimum Sudoku Clue Problem
Authors:
Gennesaret Tjusila,
Mathieu Besançon,
Mark Turner,
Thorsten Koch
Abstract:
It has been shown that any 9 by 9 Sudoku puzzle must contain at least 17 clues to have a unique solution. This paper investigates the more specific question: given a particular completed Sudoku grid, what is the minimum number of clues in any puzzle whose unique solution is the given grid? We call this problem the Minimum Sudoku Clue Problem (MSCP). We formulate MSCP as a binary bilevel linear pro…
▽ More
It has been shown that any 9 by 9 Sudoku puzzle must contain at least 17 clues to have a unique solution. This paper investigates the more specific question: given a particular completed Sudoku grid, what is the minimum number of clues in any puzzle whose unique solution is the given grid? We call this problem the Minimum Sudoku Clue Problem (MSCP). We formulate MSCP as a binary bilevel linear program, present a class of globally valid inequalities, and provide a computational study on 50 MSCP instances of 9 by 9 Sudoku grids. Using a general bilevel solver, we solve 95% of instances to optimality, and show that the solution process benefits from the addition of a moderate amount of inequalities. Finally, we extend the proposed model to other combinatorial problems in which uniqueness of the solution is of interest.
△ Less
Submitted 2 May, 2023;
originally announced May 2023.
-
Enabling Research through the SCIP Optimization Suite 8.0
Authors:
Ksenia Bestuzheva,
Mathieu Besançon,
Wei-Kun Chen,
Antonia Chmiela,
Tim Donkiewicz,
Jasper van Doornmalen,
Leon Eifler,
Oliver Gaul,
Gerald Gamrath,
Ambros Gleixner,
Leona Gottwald,
Christoph Graczyk,
Katrin Halbig,
Alexander Hoen,
Christopher Hojny,
Rolf van der Hulst,
Thorsten Koch,
Marco Lübbecke,
Stephen J. Maher,
Frederic Matter,
Erik Mühmer,
Benjamin Müller,
Marc E. Pfetsch,
Daniel Rehfeldt,
Steffan Schlein
, et al. (10 additional authors not shown)
Abstract:
The SCIP Optimization Suite provides a collection of software packages for mathematical optimization centered around the constraint integer programming framework SCIP. The focus of this paper is on the role of the SCIP Optimization Suite in supporting research. SCIP's main design principles are discussed, followed by a presentation of the latest performance improvements and developments in version…
▽ More
The SCIP Optimization Suite provides a collection of software packages for mathematical optimization centered around the constraint integer programming framework SCIP. The focus of this paper is on the role of the SCIP Optimization Suite in supporting research. SCIP's main design principles are discussed, followed by a presentation of the latest performance improvements and developments in version 8.0, which serve both as examples of SCIP's application as a research tool and as a platform for further developments. Further, the paper gives an overview of interfaces to other programming and modeling languages, new features that expand the possibilities for user interaction with the framework, and the latest developments in several extensions built upon SCIP.
△ Less
Submitted 13 March, 2023;
originally announced March 2023.
-
Atomic resolution map** of localized phonon modes at grain boundaries
Authors:
Benedikt Haas,
Tara M. Boland,
Christian Elsässer,
Arunima K. Singh,
Katia March,
Juri Barthel,
Christoph T. Koch,
Peter Rez
Abstract:
Phonon scattering at grain boundaries (GBs) is significant in controlling nanoscale device thermal conductivity. However, GBs could also act as waveguides for selected modes. To measure localized GB phonon modes, meV energy resolution is needed with sub-nm spatial resolution. Using monochromated electron energy loss spectroscopy (EELS) in the scanning transmission electron microscope (STEM) we hav…
▽ More
Phonon scattering at grain boundaries (GBs) is significant in controlling nanoscale device thermal conductivity. However, GBs could also act as waveguides for selected modes. To measure localized GB phonon modes, meV energy resolution is needed with sub-nm spatial resolution. Using monochromated electron energy loss spectroscopy (EELS) in the scanning transmission electron microscope (STEM) we have mapped the 60 meV optic mode across GBs in silicon at atomic resolution and compared it to calculated phonon densities of states (DOS). The intensity is strongly reduced at GBs characterised by the presence of five- and seven-fold rings where bond angles differ from the bulk. The excellent agreement between theory and experiment strongly supports the existence of localized phonon modes and thus of GBs acting as waveguides.
△ Less
Submitted 15 June, 2023; v1 submitted 9 March, 2023;
originally announced March 2023.
-
A sustainable infrastructure concept for improved accessibility, reusability, and archival of research software
Authors:
Timo Koch,
Dennis Gläser,
Anett Seeland,
Sarbani Roy,
Katharina Schulze,
Kilian Weishaupt,
David Boehringer,
Sibylle Hermann,
Bernd Flemisch
Abstract:
Research software is an integral part of most research today and it is widely accepted that research software artifacts should be accessible and reproducible. However, the sustainable archival of research software artifacts is an ongoing effort. We identify research software artifacts as snapshots of the current state of research and an integral part of a sustainable cycle of software development,…
▽ More
Research software is an integral part of most research today and it is widely accepted that research software artifacts should be accessible and reproducible. However, the sustainable archival of research software artifacts is an ongoing effort. We identify research software artifacts as snapshots of the current state of research and an integral part of a sustainable cycle of software development, research, and publication. We develop requirements and recommendations to improve the archival, access, and reuse of research software artifacts based on installable, configurable, extensible research software, and sustainable public open-access infrastructure. The described goal is to enable the reuse and exploration of research software beyond published research results, in parallel with reproducibility efforts, and in line with the FAIR principles for data and software. Research software artifacts can be reused in varying scenarios. To this end, we design a multi-modal representation concept supporting multiple reuse scenarios. We identify types of research software artifacts that can be viewed as different modes of the same software-based research result, for example, installation-free configurable browser-based apps to containerized environments, descriptions in journal publications and software documentation, or source code with installation instructions. We discuss how the sustainability and reuse of research software are enhanced or enabled by a suitable archive infrastructure. Finally, at the example of a pilot project at the University of Stuttgart, Germany -- a collaborative effort between research software developers and infrastructure providers -- we outline practical challenges and experiences
△ Less
Submitted 26 January, 2023;
originally announced January 2023.
-
Cutting Plane Selection with Analytic Centers and Multiregression
Authors:
Mark Turner,
Timo Berthold,
Mathieu Besançon,
Thorsten Koch
Abstract:
Cutting planes are a crucial component of state-of-the-art mixed-integer programming solvers, with the choice of which subset of cuts to add being vital for solver performance. We propose new distance-based measures to qualify the value of a cut by quantifying the extent to which it separates relevant parts of the relaxed feasible set. For this purpose, we use the analytic centers of the relaxatio…
▽ More
Cutting planes are a crucial component of state-of-the-art mixed-integer programming solvers, with the choice of which subset of cuts to add being vital for solver performance. We propose new distance-based measures to qualify the value of a cut by quantifying the extent to which it separates relevant parts of the relaxed feasible set. For this purpose, we use the analytic centers of the relaxation polytope or of its optimal face, as well as alternative optimal solutions of the linear programming relaxation. We assess the impact of the choice of distance measure on root node performance and throughout the whole branch-and-bound tree, comparing our measures against those prevalent in the literature. Finally, by a multi-output regression, we predict the relative performance of each measure, using static features readily available before the separation process. Our results indicate that analytic center-based methods help to significantly reduce the number of branch-and-bound nodes needed to explore the search space and that our multiregression approach can further improve on any individual method.
△ Less
Submitted 31 January, 2023; v1 submitted 14 December, 2022;
originally announced December 2022.
-
Lossy Compression of Electron Diffraction Patterns for Ptychography via Change of Basis
Authors:
Anton Gladyshev,
Thomas C. Pekin,
Marcel Schloz,
Benedikt Haas,
Johannes Müller,
Christoph T. Koch
Abstract:
Ptychography is a computational imaging technique that has risen in popularity in the x-ray and electron microscopy communities in the past half decade. One of the reasons for this success is the development of new high performance electron detectors with increased dynamic range and readout speed, both of which are necessary for a successful application of this technique. Despite the advances made…
▽ More
Ptychography is a computational imaging technique that has risen in popularity in the x-ray and electron microscopy communities in the past half decade. One of the reasons for this success is the development of new high performance electron detectors with increased dynamic range and readout speed, both of which are necessary for a successful application of this technique. Despite the advances made in computing power, processing the recorded data remains a challenging task, and the growth in data rate has made the size of the resulting datasets a bottleneck for the whole process. Here we present an investigation into lossy compression methods for electron diffraction patterns that retain the necessary information for ptychographic reconstructions, yet lead to a decrease in data set size by three or four orders of magnitude. We apply several compression methods to both simulated and experimental data - all with promising results.
△ Less
Submitted 23 September, 2023; v1 submitted 14 November, 2022;
originally announced November 2022.
-
Optimal discrete pipe sizing for tree-shaped CO2 networks
Authors:
Jaap Pedersen,
Thi Thai Le,
Thorsten Koch,
Janina Zittel
Abstract:
Many energy-intensive industries, like the steel industry, plan to switch to renewable energy sources. Other industries, such as the cement industry, have to rely on carbon capture utilization and storage (CCUS) technologies to reduce their production processes' inevitable carbon dioxide (CO2) emissions. However, a new transport infrastructure needs to be established to connect the point of captur…
▽ More
Many energy-intensive industries, like the steel industry, plan to switch to renewable energy sources. Other industries, such as the cement industry, have to rely on carbon capture utilization and storage (CCUS) technologies to reduce their production processes' inevitable carbon dioxide (CO2) emissions. However, a new transport infrastructure needs to be established to connect the point of capture and the point of storage or utilization. Given a tree-shaped network transporting captured CO2 from multiple sources to a single sink, we investigate how to select optimal pipeline diameters from a discrete set of diameters. The general problem of optimizing arc capacities in potential-based fluid networks is already a challenging mixed-integer nonlinear optimization problem. The problem becomes even more complex when adding the highly sensitive nonlinear behavior of CO2 regarding temperature and pressure changes. We propose an iterative algorithm that splits the problem into two parts: a) the pipe-sizing problem under a fixed supply scenario and temperature distribution and b) the thermophysical modeling, including mixing effects, the Joule-Thomson effect, and the heat exchange with the surrounding environment. We show the effectiveness of our approach by applying our algorithm to a real-world network planning problem for a CO2 network in Germany.
△ Less
Submitted 9 November, 2022;
originally announced November 2022.
-
How far are German companies in improving security through static program analysis tools?
Authors:
Goran Piskachev,
Stefan Dziwok,
Thorsten Koch,
Sven Merschjohan,
Eric Bodden
Abstract:
As security becomes more relevant for many companies, the popularity of static program analysis (SPA) tools is increasing. In this paper, we target the use of SPA tools among companies in Germany with a focus on security. We give insights on the current issues and the developers' willingness to configure the tools to overcome these issues. Compared to previous studies, our study considers the comp…
▽ More
As security becomes more relevant for many companies, the popularity of static program analysis (SPA) tools is increasing. In this paper, we target the use of SPA tools among companies in Germany with a focus on security. We give insights on the current issues and the developers' willingness to configure the tools to overcome these issues. Compared to previous studies, our study considers the companies' culture and processes for using SPA tools. We conducted an online survey with 256 responses and semi-structured interviews with 17 product owners and executives from multiple companies. Our results show a diversity in the usage of tools. Only half of our survey participants use SPA tools. The free tools tend to be more popular among software developers. In most companies, software developers are encouraged to use free tools, whereas commercial tools can be requested. However, the product owners and executives in our interviews reported that their developers do not request new tools. We also find out that automatic security checks with tools are rarely performed on each release.
△ Less
Submitted 12 August, 2022;
originally announced August 2022.
-
Progress in Mathematical Programming Solvers from 2001 to 2020
Authors:
Thorsten Koch,
Timo Berthold,
Jaap Pedersen,
Charlie Vanaret
Abstract:
This study investigates the progress made in LP and MILP solver performance during the last two decades by comparing the solver software from the beginning of the millennium with the codes available today. On average, we found out that for solving LP/MILP, computer hardware got about 20 times faster, and the algorithms improved by a factor of about nine for LP and around 50 for MILP, which gives a…
▽ More
This study investigates the progress made in LP and MILP solver performance during the last two decades by comparing the solver software from the beginning of the millennium with the codes available today. On average, we found out that for solving LP/MILP, computer hardware got about 20 times faster, and the algorithms improved by a factor of about nine for LP and around 50 for MILP, which gives a total speed-up of about 180 and 1,000 times, respectively. However, these numbers have a very high variance and they considerably underestimate the progress made on the algorithmic side: many problem instances can nowadays be solved within seconds, which the old codes are not able to solve within any reasonable time.
△ Less
Submitted 22 June, 2022; v1 submitted 20 June, 2022;
originally announced June 2022.
-
Controlling transient gas flow in real-world pipeline intersection areas
Authors:
Felix Hennings,
Lovis Anderson,
Kai Hoppmann-Baum,
Mark Turner,
Thorsten Koch
Abstract:
Compressor stations are the heart of every high-pressure gas transport network. Located at intersection areas of the network they are contained in huge complex plants, where they are in combination with valves and regulators responsible for routing and pushing the gas through the network. Due to their complexity and lack of data compressor stations are usually dealt with in the scientific literatu…
▽ More
Compressor stations are the heart of every high-pressure gas transport network. Located at intersection areas of the network they are contained in huge complex plants, where they are in combination with valves and regulators responsible for routing and pushing the gas through the network. Due to their complexity and lack of data compressor stations are usually dealt with in the scientific literature in a highly simplified and idealized manner. As part of an ongoing project with one of Germany's largest Transmission System Operators to develop a decision support system for their dispatching center, we investigated how to automatize control of compressor stations. Each station has to be in a particular configuration, leading in combination with the other nearby elements to a discrete set of up to 2000 possible feasible operation modes in the intersection area. Since the desired performance of the station changes over time, the configuration of the station has to adapt. Our goal is to minimize the necessary changes in the overall operation modes and related elements over time, while fulfilling a preset performance envelope or demand scenario. This article describes the chosen model and the implemented mixed integer programming based algorithms to tackle this challenge. By presenting extensive computational results on real world data we demonstrate the performance of our approach.
△ Less
Submitted 13 June, 2022;
originally announced June 2022.
-
Exploring the Open World Using Incremental Extreme Value Machines
Authors:
Tobias Koch,
Felix Liebezeit,
Christian Riess,
Vincent Christlein,
Thomas Köhler
Abstract:
Dynamic environments require adaptive applications. One particular machine learning problem in dynamic environments is open world recognition. It characterizes a continuously changing domain where only some classes are seen in one batch of the training data and such batches can only be learned incrementally. Open world recognition is a demanding task that is, to the best of our knowledge, addresse…
▽ More
Dynamic environments require adaptive applications. One particular machine learning problem in dynamic environments is open world recognition. It characterizes a continuously changing domain where only some classes are seen in one batch of the training data and such batches can only be learned incrementally. Open world recognition is a demanding task that is, to the best of our knowledge, addressed by only a few methods. This work introduces a modification of the widely known Extreme Value Machine (EVM) to enable open world recognition. Our proposed method extends the EVM with a partial model fitting function by neglecting unaffected space during an update. This reduces the training time by a factor of 28. In addition, we provide a modified model reduction using weighted maximum K-set cover to strictly bound the model complexity and reduce the computational effort by a factor of 3.5 from 2.1 s to 0.6 s. In our experiments, we rigorously evaluate openness with two novel evaluation protocols. The proposed method achieves superior accuracy of about 12 % and computational efficiency in the tasks of image classification and face recognition.
△ Less
Submitted 30 May, 2022;
originally announced May 2022.
-
Shared Metadata for Data-Centric Materials Science
Authors:
Luca M. Ghiringhelli,
Carsten Baldauf,
Tristan Bereau,
Sandor Brockhauser,
Christian Carbogno,
Javad Chamanara,
Stefano Cozzini,
Stefano Curtarolo,
Claudia Draxl,
Shyam Dwaraknath,
Ádám Fekete,
James Kermode,
Christoph T. Koch,
Markus Kühbach,
Alvin Noe Ladines,
Patrick Lambrix,
Maja-Olivia Lenz-Himmer,
Sergey Levchenko,
Micael Oliveira,
Adam Michalchuk,
Ron Miller,
Berk Onat,
Pasquale Pavone,
Giovanni Pizzi,
Benjamin Regler
, et al. (10 additional authors not shown)
Abstract:
The expansive production of data in materials science, their widespread sharing and repurposing requires educated support and stewardship. In order to ensure that this need helps rather than hinders scientific work, the implementation of the FAIR-data principles (Findable, Accessible, Interoperable, and Reusable) must not be too narrow. Besides, the wider materials-science community ought to agree…
▽ More
The expansive production of data in materials science, their widespread sharing and repurposing requires educated support and stewardship. In order to ensure that this need helps rather than hinders scientific work, the implementation of the FAIR-data principles (Findable, Accessible, Interoperable, and Reusable) must not be too narrow. Besides, the wider materials-science community ought to agree on the strategies to tackle the challenges that are specific to its data, both from computations and experiments. In this paper, we present the result of the discussions held at the workshop on "Shared Metadata and Data Formats for Big-Data Driven Materials Science". We start from an operative definition of metadata, and what features a FAIR-compliant metadata schema should have. We will mainly focus on computational materials-science data and propose a constructive approach for the FAIRification of the (meta)data related to ground-state and excited-states calculations, potential-energy sampling, and generalized workflows. Finally, challenges with the FAIRification of experimental (meta)data and materials-science ontologies are presented together with an outlook of how to meet them.
△ Less
Submitted 23 August, 2023; v1 submitted 29 May, 2022;
originally announced May 2022.
-
Nanocriticality in the magnetic phase transition of CoO nanoparticles
Authors:
Machteld E. Kamminga,
Jonas Okkels Birk,
Jari í Hjøllum,
Henrik Jacobsen,
Jakob Lass,
Thorbjørn L. Koch,
Niels B. Christensen,
Christof Niedermayer,
Lukas Keller,
Luise Theil Kuhn,
Elisabeth T. Ulrikkeholm,
Erik Brok,
Cathrine Frandsen,
Kim Lefmann
Abstract:
The universal theory of critical phase transitions describes the critical behavior at second-order phase transitions in infinitely large systems. With the increased contemporary interest in nanoscale materials, we investigated CoO nanoparticles by means of neutron scattering and found how the theory of critical phenomena breaks down in the nanoscale regime. Using CoO as a model system, we have ide…
▽ More
The universal theory of critical phase transitions describes the critical behavior at second-order phase transitions in infinitely large systems. With the increased contemporary interest in nanoscale materials, we investigated CoO nanoparticles by means of neutron scattering and found how the theory of critical phenomena breaks down in the nanoscale regime. Using CoO as a model system, we have identified a size-dependent nanocritical temperature region close to the antiferromagnetic phase transition where the magnetic correlation length of the nanoparticles converges to a constant value, which is significantly smaller than that of the saturated state found at low temperatures. This is in clear contrast to the divergence around $T_{\rm N}$ observed for bulk systems. Our findings of nanocriticality in the magnetic phase transition is of great importance for the understanding of phase transitions at the nanoscale.
△ Less
Submitted 30 May, 2022; v1 submitted 27 May, 2022;
originally announced May 2022.
-
Second-Order Asymptotics of Hoeffding-Like Hypothesis Tests
Authors:
K. V. Harsha,
Jithin Ravi,
Tobias Koch
Abstract:
We consider a binary statistical hypothesis testing problem, where $n$ independent and identically distributed random variables $Z^n$ are either distributed according to the null hypothesis $P$ or the alternate hypothesis $Q$, and only $P$ is known. For this problem, a well-known test is the Hoeffding test, which accepts $P$ if the Kullback-Leibler (KL) divergence between the empirical distributio…
▽ More
We consider a binary statistical hypothesis testing problem, where $n$ independent and identically distributed random variables $Z^n$ are either distributed according to the null hypothesis $P$ or the alternate hypothesis $Q$, and only $P$ is known. For this problem, a well-known test is the Hoeffding test, which accepts $P$ if the Kullback-Leibler (KL) divergence between the empirical distribution of $Z^n$ and $P$ is below some threshold. In this paper, we consider Hoeffding-like tests, where the KL divergence is replaced by other divergences, and characterize, for a large class of divergences, the first and second-order terms of the type-II error for a fixed type-I error. Since the considered class includes the KL divergence, we obtain the second-order term of the Hoeffiding test as a special case.
△ Less
Submitted 11 May, 2022;
originally announced May 2022.
-
FAIR data enabling new horizons for materials research
Authors:
Matthias Scheffler,
Martin Aeschlimann,
Martin Albrecht,
Tristan Bereau,
Hans-Joachim Bungartz,
Claudia Felser,
Mark Greiner,
Axel Groß,
Christoph T. Koch,
Kurt Kremer,
Wolfgang E. Nagel,
Markus Scheidgen,
Christof Wöll,
Claudia Draxl
Abstract:
The prosperity and lifestyle of our society are very much governed by achievements in condensed matter physics, chemistry and materials science, because new products for sectors such as energy, the environment, health, mobility and information technology (IT) rely largely on improved or even new materials. Examples include solid-state lighting, touchscreens, batteries, implants, drug delivery and…
▽ More
The prosperity and lifestyle of our society are very much governed by achievements in condensed matter physics, chemistry and materials science, because new products for sectors such as energy, the environment, health, mobility and information technology (IT) rely largely on improved or even new materials. Examples include solid-state lighting, touchscreens, batteries, implants, drug delivery and many more. The enormous amount of research data produced every day in these fields represents a gold mine of the twenty-first century. This gold mine is, however, of little value if these data are not comprehensively characterized and made available. How can we refine this feedstock; that is, turn data into knowledge and value? For this, a FAIR (findable, accessible, interoperable and reusable) data infrastructure is a must. Only then can data be readily shared and explored using data analytics and artificial intelligence (AI) methods. Making data 'findable and AI ready' (a forward-looking interpretation of the acronym) will change the way in which science is carried out today. In this Perspective, we discuss how we can prepare to make this happen for the field of materials science.
△ Less
Submitted 27 April, 2022;
originally announced April 2022.
-
Deep Reinforcement Learning for Data-Driven Adaptive Scanning in Ptychography
Authors:
Marcel Schloz,
Johannes Müller,
Thomas C. Pekin,
Wouter Van den Broek,
Christoph T. Koch
Abstract:
We present a method that lowers the dose required for a ptychographic reconstruction by adaptively scanning the specimen, thereby providing the required spatial information redundancy in the regions of highest importance. The proposed method is built upon a deep learning model that is trained by reinforcement learning (RL), using prior knowledge of the specimen structure from training data sets. W…
▽ More
We present a method that lowers the dose required for a ptychographic reconstruction by adaptively scanning the specimen, thereby providing the required spatial information redundancy in the regions of highest importance. The proposed method is built upon a deep learning model that is trained by reinforcement learning (RL), using prior knowledge of the specimen structure from training data sets. We show that equivalent low-dose experiments using adaptive scanning outperform conventional ptychography experiments in terms of reconstruction resolution.
△ Less
Submitted 29 March, 2022;
originally announced March 2022.
-
Adaptive Cut Selection in Mixed-Integer Linear Programming
Authors:
Mark Turner,
Thorsten Koch,
Felipe Serrano,
Michael Winkler
Abstract:
Cutting plane selection is a subroutine used in all modern mixed-integer linear programming solvers with the goal of selecting a subset of generated cuts that induce optimal solver performance. These solvers have millions of parameter combinations, and so are excellent candidates for parameter tuning. Cut selection scoring rules are usually weighted sums of different measurements, where the weight…
▽ More
Cutting plane selection is a subroutine used in all modern mixed-integer linear programming solvers with the goal of selecting a subset of generated cuts that induce optimal solver performance. These solvers have millions of parameter combinations, and so are excellent candidates for parameter tuning. Cut selection scoring rules are usually weighted sums of different measurements, where the weights are parameters. We present a parametric family of mixed-integer linear programs together with infinitely many family-wide valid cuts. Some of these cuts can induce integer optimal solutions directly after being applied, while others fail to do so even if an infinite amount are applied. We show for a specific cut selection rule, that any finite grid search of the parameter space will always miss all parameter values, which select integer optimal inducing cuts in an infinite amount of our problems. We propose a variation on the design of existing graph convolutional neural networks, adapting them to learn cut selection rule parameters. We present a reinforcement learning framework for selecting cuts, and train our design using said framework over MIPLIB 2017 and a neural network verification data set. Our framework and design show that adaptive cut selection does substantially improve performance over a diverse set of instances, but that finding a single function describing such a rule is difficult. Code for reproducing all experiments is available at https://github.com/Opt-Mucca/Adaptive-Cutsel-MILP.
△ Less
Submitted 23 February, 2023; v1 submitted 22 February, 2022;
originally announced February 2022.
-
Article's Scientific Prestige: measuring the impact of individual articles in the Web of Science
Authors:
Ying Chen,
Thorsten Koch,
Nazgul Zakiyeva,
Kailiang Liu,
Zhitong Xu,
Chun-houh Chen,
Junji Nakano,
Keisuke Honda
Abstract:
We performed a citation analysis on the Web of Science publications consisting of more than 63 million articles and 1.45 billion citations on 254 subjects from 1981 to 2020. We proposed the Article's Scientific Prestige (ASP) metric and compared this metric to number of citations (#Cit) and journal grade in measuring the scientific impact of individual articles in the large-scale hierarchical and…
▽ More
We performed a citation analysis on the Web of Science publications consisting of more than 63 million articles and 1.45 billion citations on 254 subjects from 1981 to 2020. We proposed the Article's Scientific Prestige (ASP) metric and compared this metric to number of citations (#Cit) and journal grade in measuring the scientific impact of individual articles in the large-scale hierarchical and multi-disciplined citation network. In contrast to #Cit, ASP, that is computed based on the eigenvector centrality, considers both direct and indirect citations, and provides steady-state evaluation cross different disciplines. We found that ASP and #Cit are not aligned for most articles, with a growing mismatch amongst the less cited articles. While both metrics are reliable for evaluating the prestige of articles such as Nobel Prize winning articles, ASP tends to provide more persuasive rankings than #Cit when the articles are not highly cited. The journal grade, that is eventually determined by a few highly cited articles, is unable to properly reflect the scientific impact of individual articles. The number of references and coauthors are less relevant to scientific impact, but subjects do make a difference.
△ Less
Submitted 17 February, 2022;
originally announced February 2022.
-
Faster exact solution of sparse MaxCut and QUBO problems
Authors:
Daniel Rehfeldt,
Thorsten Koch,
Yuji Shinano
Abstract:
The maximum-cut problem is one of the fundamental problems in combinatorial optimization. With the advent of quantum computers, both the maximum-cut and the equivalent quadratic unconstrained binary optimization problem have experienced much interest in recent years.
This article aims to advance the state of the art in the exact solution of both problems -- by using mathematical programming tech…
▽ More
The maximum-cut problem is one of the fundamental problems in combinatorial optimization. With the advent of quantum computers, both the maximum-cut and the equivalent quadratic unconstrained binary optimization problem have experienced much interest in recent years.
This article aims to advance the state of the art in the exact solution of both problems -- by using mathematical programming techniques on digital computers. The main focus lies on sparse problem instances, although also dense ones can be solved. We enhance several algorithmic components such as reduction techniques and cutting-plane separation algorithms, and combine them in an exact branch-and-cut solver. Furthermore, we provide a parallel implementation. The new solver is shown to significantly outperform existing state-of-the-art software for sparse MaxCut and QUBO instances. Furthermore, we improve the best known bounds for several instances from the 7th DIMACS Challenge and the QPLIB, and solve some of them (for the first time) to optimality.
△ Less
Submitted 4 February, 2022;
originally announced February 2022.
-
The SCIP Optimization Suite 8.0
Authors:
Ksenia Bestuzheva,
Mathieu Besançon,
Wei-Kun Chen,
Antonia Chmiela,
Tim Donkiewicz,
Jasper van Doornmalen,
Leon Eifler,
Oliver Gaul,
Gerald Gamrath,
Ambros Gleixner,
Leona Gottwald,
Christoph Graczyk,
Katrin Halbig,
Alexander Hoen,
Christopher Hojny,
Rolf van der Hulst,
Thorsten Koch,
Marco Lübbecke,
Stephen J. Maher,
Frederic Matter,
Erik Mühmer,
Benjamin Müller,
Marc E. Pfetsch,
Daniel Rehfeldt,
Steffan Schlein
, et al. (10 additional authors not shown)
Abstract:
The SCIP Optimization Suite provides a collection of software packages for mathematical optimization centered around the constraint integer programming framework SCIP. This paper discusses enhancements and extensions contained in version 8.0 of the SCIP Optimization Suite. Major updates in SCIP include improvements in symmetry handling and decomposition algorithms, new cutting planes, a new plugin…
▽ More
The SCIP Optimization Suite provides a collection of software packages for mathematical optimization centered around the constraint integer programming framework SCIP. This paper discusses enhancements and extensions contained in version 8.0 of the SCIP Optimization Suite. Major updates in SCIP include improvements in symmetry handling and decomposition algorithms, new cutting planes, a new plugin type for cut selection, and a complete rework of the way nonlinear constraints are handled. Additionally, SCIP 8.0 now supports interfaces for Julia as well as Matlab. Further, UG now includes a unified framework to parallelize all solvers, a utility to analyze computational experiments has been added to GCG, dual solutions can be postsolved by PaPILO, new heuristics and presolving methods were added to SCIP-SDP, and additional problem classes and major performance improvements are available in SCIP-Jack.
△ Less
Submitted 16 December, 2021;
originally announced December 2021.
-
Robust monolithic solvers for the Stokes-Darcy problem with the Darcy equation in primal form
Authors:
Wietse M. Boon,
Timo Koch,
Miroslav Kuchta,
Kent-Andre Mardal
Abstract:
We construct mesh-independent and parameter-robust monolithic solvers for the coupled primal Stokes-Darcy problem. Three different formulations and their discretizations in terms of conforming and non-conforming finite element methods and finite volume methods are considered. In each case, robust preconditioners are derived using a unified theoretical framework. In particular, the suggested precon…
▽ More
We construct mesh-independent and parameter-robust monolithic solvers for the coupled primal Stokes-Darcy problem. Three different formulations and their discretizations in terms of conforming and non-conforming finite element methods and finite volume methods are considered. In each case, robust preconditioners are derived using a unified theoretical framework. In particular, the suggested preconditioners utilize operators in fractional Sobolev spaces. Numerical experiments demonstrate the parameter-robustness of the proposed solvers.
△ Less
Submitted 14 October, 2021;
originally announced October 2021.
-
AppSecure.nrw Software Security Study
Authors:
Stefan Dziwok,
Thorsten Koch,
Sven Merschjohann,
Boris Budweg,
Sebastian Leuer
Abstract:
In recent years, the World Economic Forum has identified software security as the most significant technological risk to the world's population, as software-intensive systems process critical data and provide critical services. This raises the question of the extent to which German companies are addressing software security in develo** and operating their software products. This paper reports on…
▽ More
In recent years, the World Economic Forum has identified software security as the most significant technological risk to the world's population, as software-intensive systems process critical data and provide critical services. This raises the question of the extent to which German companies are addressing software security in develo** and operating their software products. This paper reports on the results of an extensive study among developers, product owners, and managers to answer this question. Our results show that ensuring security is a multi-faceted challenge for companies, involving low awareness, inaccurate self-assessment, and a lack of competence on the topic of secure software development among all stakeholders. The current situation in software development is therefore detrimental to the security of software products in the medium and long term.
△ Less
Submitted 25 August, 2021;
originally announced August 2021.
-
Projection-based resolved interface mixed-dimension method for embedded tubular network systems
Authors:
Timo Koch
Abstract:
We present a flexible discretization technique for computational models of thin tubular networks embedded in a bulk domain, for example a porous medium. These systems occur in the simulation of fluid flow in vascularized biological tissue, root water and nutrient uptake in soil, hydrological or petroleum wells in rock formations, or heat transport in micro-cooling devices. The key processes, such…
▽ More
We present a flexible discretization technique for computational models of thin tubular networks embedded in a bulk domain, for example a porous medium. These systems occur in the simulation of fluid flow in vascularized biological tissue, root water and nutrient uptake in soil, hydrological or petroleum wells in rock formations, or heat transport in micro-cooling devices. The key processes, such as heat and mass transfer, are usually dominated by the exchange between the network system and the embedding domain. By explicitly resolving the interface between these domains with the computational mesh, we can accurately describe these processes. The network is efficiently described by a network of line segments. Coupling terms are evaluated by projection of the interface variables. The new method is naturally applicable for nonlinear and time-dependent problems and can therefore be used as a reference method in the development of novel implicit interface 1D-3D methods and in the design of verification benchmarks for embedded tubular network methods. Implicit interface, not resolving the bulk-network interface explicitly have proven to be very efficient but have only been mathematically analyzed for linear elliptic problems so far. Using two application scenarios, fluid perfusion of vascularized tissue and root water uptake from soil, we investigate the effect of some common modeling assumptions of implicit interface methods numerically.
△ Less
Submitted 11 June, 2021;
originally announced June 2021.
-
Nonlinear mixed-dimension model for embedded tubular networks with application to root water uptake
Authors:
Timo Koch,
Hanchuan Wu,
Martin Schneider
Abstract:
We present a numerical scheme for the solution of nonlinear mixed-dimensional PDEs describing coupled processes in embedded tubular network system in exchange with a bulk domain. Such problems arise in various biological and technical applications such as in the modeling of root-water uptake, heat exchangers, or geothermal wells. The nonlinearity appears in form of solution-dependent parameters su…
▽ More
We present a numerical scheme for the solution of nonlinear mixed-dimensional PDEs describing coupled processes in embedded tubular network system in exchange with a bulk domain. Such problems arise in various biological and technical applications such as in the modeling of root-water uptake, heat exchangers, or geothermal wells. The nonlinearity appears in form of solution-dependent parameters such as pressure-dependent permeability or temperature-dependent thermal conductivity. We derive and analyse a numerical scheme based on distributing the bulk-network coupling source term by a smoothing kernel with local support. By the use of local analytical solutions, interface unknowns and fluxes at the bulk-network interface can be accurately reconstructed from coarsely resolved numerical solutions in the bulk domain. Numerical examples give confidence in the robustness of the method and show the results in comparison to previously published methods. The new method outperforms these existing methods in accuracy and efficiency. In a root water uptake scenario, we accurately estimate the transpiration rate using only a few thousand 3D mesh cells and a structured cube grid whereas other state-of-the-art numerical schemes require millions of cells and local grid refinement to reach comparable accuracy.
△ Less
Submitted 14 June, 2021; v1 submitted 9 June, 2021;
originally announced June 2021.
-
Extrinsic localized excitons in patterned 2D semiconductors
Authors:
D Yagodkin,
K Greben,
A Eljarrat,
S Kovalchuk,
M Ghorbani-Asl,
M Jain,
S Kretschmer,
N Severin,
J P Rabe,
A V Krasheninnikov,
C T Koch,
K I Bolotin
Abstract:
We demonstrate a new localized excitonic state in patterned monolayer 2D semiconductors. This state is not associated with lattice disorder but is extrinsic, i.e. results from external molecules on the material surface. The signature of an exciton associated with that state is observed in the photoluminescence spectrum after electron beam exposure of several 2D semiconductors. The localized state,…
▽ More
We demonstrate a new localized excitonic state in patterned monolayer 2D semiconductors. This state is not associated with lattice disorder but is extrinsic, i.e. results from external molecules on the material surface. The signature of an exciton associated with that state is observed in the photoluminescence spectrum after electron beam exposure of several 2D semiconductors. The localized state, which is distinguished by non-linear power dependence, survives up to room temperature and is patternable down to 20 nm resolution. We probe the response of the new exciton to the changes of electron energy, nanomechanical cleaning, and encapsulation via multiple microscopic, spectroscopic, and computational techniques. All these approaches suggest that the state does not originate from irradiation-induced structural defects or spatially non-uniform strain, as commonly assumed. Instead, we show that it is extrinsic, likely a charge transfer exciton associated with the organic substance deposited onto the 2D semiconductor. By demonstrating that structural defects are not required for the formation of localized excitons, our work opens new possibilities for further understanding of these states and using them for example in chemical sensing and quantum technologies.
△ Less
Submitted 29 March, 2022; v1 submitted 28 May, 2021;
originally announced May 2021.
-
Increasing Spatial Fidelity and SNR of 4D-STEM using Multi-frame Data Fusion
Authors:
Colum M. O'Leary,
Benedikt Haas,
Christoph T. Koch,
Peter D. Nellist,
Lewys Jones
Abstract:
4D-STEM, in which the 2D diffraction plane is captured for each 2D scan position in the scanning transmission electron microscope (STEM) using a pixelated detector, is complementing and increasingly replacing existing imaging approaches. However, at present the speed of those detectors, although having drastically improved in the recent years, is still 100 to 1,000 times slower than the current PM…
▽ More
4D-STEM, in which the 2D diffraction plane is captured for each 2D scan position in the scanning transmission electron microscope (STEM) using a pixelated detector, is complementing and increasingly replacing existing imaging approaches. However, at present the speed of those detectors, although having drastically improved in the recent years, is still 100 to 1,000 times slower than the current PMT technology operators are used to. Regrettably, this means environmental scanning-distortion often limits the overall performance of the recorded 4D data. Here we present an extension of existing STEM distortion correction techniques for the treatment of 4D-data series. Although applicable to 4D-data in general, we use electron ptychography and electric-field map** as model cases and demonstrate an improvement in spatial-fidelity, signal-to-noise ratio (SNR), phase-precision and spatial-resolution.
△ Less
Submitted 5 July, 2021; v1 submitted 4 March, 2021;
originally announced March 2021.
-
The Variational Bayesian Inference for Network Autoregression Models
Authors:
Wei-Ting Lai,
Ray-Bing Chen,
Ying Chen,
Thorsten Koch
Abstract:
We develop a variational Bayesian (VB) approach for estimating large-scale dynamic network models in the network autoregression framework. The VB approach allows for the automatic identification of the dynamic structure of such a model and obtains a direct approximation of the posterior density. Compared to Markov Chain Monte Carlo (MCMC) based sampling approaches, the VB approach achieves enhance…
▽ More
We develop a variational Bayesian (VB) approach for estimating large-scale dynamic network models in the network autoregression framework. The VB approach allows for the automatic identification of the dynamic structure of such a model and obtains a direct approximation of the posterior density. Compared to Markov Chain Monte Carlo (MCMC) based sampling approaches, the VB approach achieves enhanced computational efficiency without sacrificing estimation accuracy. In the simulation study conducted here, the proposed VB approach detects various types of proper active structures for dynamic network models. Compared to the alternative approach, the proposed method achieves similar or better accuracy, and its computational time is halved. In a real data analysis scenario of day-ahead natural gas flow prediction in the German gas transmission network with 51 nodes between October 2013 and September 2015, the VB approach delivers promising forecasting accuracy along with clearly detected structures in terms of dynamic dependence.
△ Less
Submitted 18 February, 2021;
originally announced February 2021.
-
Generative deep learning for decision making in gas networks
Authors:
Lovis Anderson,
Mark Turner,
Thorsten Koch
Abstract:
A decision support system relies on frequent re-solving of similar problem instances. While the general structure remains the same in corresponding applications, the input parameters are updated on a regular basis. We propose a generative neural network design for learning integer decision variables of mixed-integer linear programming (MILP) formulations of these problems. We utilise a deep neural…
▽ More
A decision support system relies on frequent re-solving of similar problem instances. While the general structure remains the same in corresponding applications, the input parameters are updated on a regular basis. We propose a generative neural network design for learning integer decision variables of mixed-integer linear programming (MILP) formulations of these problems. We utilise a deep neural network discriminator and a MILP solver as our oracle to train our generative neural network. In this article, we present the results of our design applied to the transient gas optimisation problem. With the trained network we produce a feasible solution in 2.5s, use it as a warm-start solution, and thereby decrease global optimal solution solve time by 60.5%.
△ Less
Submitted 3 February, 2021;
originally announced February 2021.
-
Scaling Laws for Gaussian Random Many-Access Channels
Authors:
Jithin Ravi,
Tobias Koch
Abstract:
This paper considers a Gaussian multiple-access channel with random user activity where the total number of users $\ell_n$ and the average number of active users $k_n$ may grow with the blocklength $n$. For this channel, it studies the maximum number of bits that can be transmitted reliably per unit-energy as a function of $\ell_n$ and $k_n$. When all users are active with probability one, i.e.,…
▽ More
This paper considers a Gaussian multiple-access channel with random user activity where the total number of users $\ell_n$ and the average number of active users $k_n$ may grow with the blocklength $n$. For this channel, it studies the maximum number of bits that can be transmitted reliably per unit-energy as a function of $\ell_n$ and $k_n$. When all users are active with probability one, i.e., $\ell_n = k_n$, it is demonstrated that if $k_n$ is of an order strictly below $n/\log n$, then each user can achieve the single-user capacity per unit-energy $(\log e)/N_0$ (where $N_0/ 2$ is the noise power) by using an orthogonal-access scheme. In contrast, if $k_n$ is of an order strictly above $n/\log n$, then the capacity per unit-energy is zero. Consequently, there is a sharp transition between orders of growth where interference-free communication is feasible and orders of growth where reliable communication at a positive rate per unit-energy is infeasible. It is further demonstrated that orthogonal-access schemes in combination with orthogonal codebooks, which achieve the capacity per unit-energy when the number of users is bounded, can be strictly suboptimal.
When the user activity is random, i.e., when $\ell_n$ and $k_n$ are different, it is demonstrated that if $k_n\log \ell_n$ is sublinear in $n$, then each user can achieve the single-user capacity per unit-energy $(\log e)/N_0$. Conversely, if $k_n\log \ell_n$ is superlinear in $n$, then the capacity per unit-energy is zero. Consequently, there is again a sharp transition between orders of growth where interference-free communication is feasible and orders of growth where reliable communication at a positive rate is infeasible that depends on the asymptotic behaviours of both $\ell_n$ and $k_n$. It is further demonstrated that orthogonal-access schemes, which are optimal when $\ell_n = k_n$, can be strictly suboptimal.
△ Less
Submitted 2 September, 2021; v1 submitted 18 December, 2020;
originally announced December 2020.
-
A single-projection three-dimensional reconstruction algorithm for scanning transmission electron microscopy data
Authors:
Hamish G. Brown,
Philipp M. Pelz,
Shang-Lin Hsu,
Zimeng Zhang,
Ramamoorthy Ramesh,
Katherine Inzani,
Evan Sheridan,
Sinéad M. Griffin,
Marcel Schloz,
Thomas C. Pekin,
Christoph T. Koch,
Scott D. Findlay,
Leslie J. Allen,
Mary C. Scott,
Colin Ophus,
Jim Ciston
Abstract:
Increasing interest in three-dimensional nanostructures adds impetus to electron microscopy techniques capable of imaging at or below the nanoscale in three dimensions. We present a reconstruction algorithm that takes as input a focal series of four-dimensional scanning transmission electron microscopy (4D-STEM) data. We apply the approach to a lead iridate, Pb$_2$Ir$_2$O$_7$, and yttrium-stabiliz…
▽ More
Increasing interest in three-dimensional nanostructures adds impetus to electron microscopy techniques capable of imaging at or below the nanoscale in three dimensions. We present a reconstruction algorithm that takes as input a focal series of four-dimensional scanning transmission electron microscopy (4D-STEM) data. We apply the approach to a lead iridate, Pb$_2$Ir$_2$O$_7$, and yttrium-stabilized zirconia,Y$_{0.095}$Zr$_{0.905}$O$_2$ , heterostructure from data acquired with the specimen in a single plan-view orientation, with the epitaxial layers stacked along the beam direction. We demonstrate that Pb-Ir atomic columns are visible in the uppermost layers of the reconstructed volume. We compare this approach to the alternative techniques of depth sectioning using differential phase contrast scanning transmission electron microscopy (DPC-STEM) and multislice ptychographic reconstruction.
△ Less
Submitted 16 February, 2022; v1 submitted 15 November, 2020;
originally announced November 2020.
-
Creating it from SCRATCh: A Practical Approach for Enhancing the Security of IoT-Systems in a DevOps-enabled Software Development Environment
Authors:
Simon D Duque Anton,
Daniel Fraunholz,
Daniel Krohmer,
Daniel Reti,
Hans D Schotten,
Franklin Selgert,
Marcell Marosvölgyi,
Morten Larsen,
Krishna Sudhakar,
Tobias Koch,
Till Witt,
Cédric Bassem
Abstract:
DevOps describes a method to reorganize the way different disciplines in software engineering work together to speed up software delivery. However, the introduction of DevOps-methods to organisations is a complex task. A successful introduction results in a set of structured process descriptions. Despite the structure, this process leaves margin for error: Especially security issues are addressed…
▽ More
DevOps describes a method to reorganize the way different disciplines in software engineering work together to speed up software delivery. However, the introduction of DevOps-methods to organisations is a complex task. A successful introduction results in a set of structured process descriptions. Despite the structure, this process leaves margin for error: Especially security issues are addressed in individual stages, without consideration of the interdependence. Furthermore, applying DevOps-methods to distributed entities, such as the Internet of Things (IoT) is difficult as the architecture is tailormade for desktop and cloud resources. In this work, an overview of tooling employed in the stages of DevOps processes is introduced. Gaps in terms of security or applicability to the IoT are derived. Based on these gaps, solutions that are being developed in the course of the research project SCRATCh are presented and discussed in terms of benefit to DevOps-environments.
△ Less
Submitted 28 October, 2020;
originally announced October 2020.
-
Capacity per Unit-Energy of Gaussian Random Many-Access Channels
Authors:
Jithin Ravi,
Tobias Koch
Abstract:
We consider a Gaussian multiple-access channel with random user activity where the total number of users $\ell_n$ and the average number of active users $k_n$ may be unbounded. For this channel, we characterize the maximum number of bits that can be transmitted reliably per unit-energy in terms of $\ell_n$ and $k_n$. We show that if $k_n\log \ell_n$ is sublinear in $n$, then each user can achieve…
▽ More
We consider a Gaussian multiple-access channel with random user activity where the total number of users $\ell_n$ and the average number of active users $k_n$ may be unbounded. For this channel, we characterize the maximum number of bits that can be transmitted reliably per unit-energy in terms of $\ell_n$ and $k_n$. We show that if $k_n\log \ell_n$ is sublinear in $n$, then each user can achieve the single-user capacity per unit-energy. Conversely, if $k_n\log \ell_n$ is superlinear in $n$, then the capacity per unit-energy is zero. We further demonstrate that orthogonal-access schemes, which are optimal when all users are active with probability one, can be strictly suboptimal.
△ Less
Submitted 12 July, 2020; v1 submitted 15 May, 2020;
originally announced May 2020.
-
Overcoming information reduced data and experimentally uncertain parameters in ptychography with regularized optimization
Authors:
Marcel Schloz,
Thomas C. Pekin,
Zhen Chen,
Wouter Van den Broek,
David A. Muller,
Christoph T. Koch
Abstract:
The overdetermination of the mathematical problem underlying ptychography is reduced by a host of experimentally more desirable settings. Furthermore, reconstruction of the sample-induced phase shift is typically limited by uncertainty in the experimental parameters and finite sample thicknesses. Presented is a conjugate gradient descent algorithm, regularized optimization for ptychography (ROP),…
▽ More
The overdetermination of the mathematical problem underlying ptychography is reduced by a host of experimentally more desirable settings. Furthermore, reconstruction of the sample-induced phase shift is typically limited by uncertainty in the experimental parameters and finite sample thicknesses. Presented is a conjugate gradient descent algorithm, regularized optimization for ptychography (ROP), that recovers the partially known experimental parameters along with the phase shift, improves resolution by incorporating the multislice formalism to treat finite sample thicknesses, and includes regularization in the optimization process, thus achieving reliable results from noisy data with severely reduced and underdetermined information.
△ Less
Submitted 8 July, 2020; v1 submitted 4 May, 2020;
originally announced May 2020.
-
Optimal Installation of Solar Panels with Price Impact: a Solvable Singular Stochastic Control Problem
Authors:
Torben Koch,
Tiziano Vargiolu
Abstract:
We consider a price-maker company which generates electricity and sells it in the spot market. The company can increase its level of installed power by irreversible installations of solar panels. In absence of the company's economic activities, the spot electricity price evolves as an Ornstein-Uhlenbeck process, and therefore it has a mean-reverting behavior. The current level of the company's ins…
▽ More
We consider a price-maker company which generates electricity and sells it in the spot market. The company can increase its level of installed power by irreversible installations of solar panels. In absence of the company's economic activities, the spot electricity price evolves as an Ornstein-Uhlenbeck process, and therefore it has a mean-reverting behavior. The current level of the company's installed power has a permanent impact on the electricity price and affects its mean-reversion level. The company aims at maximizing the total expected profits from selling electricity in the market, net of the total expected proportional costs of installation. This problem is modeled as a two-dimensional degenerate singular stochastic control problem in which the installation strategy is identified as the company's control variable. We follow a guess-and-verify approach to solve the problem. We find that the optimal installation strategy is triggered by a curve which separates the waiting region, where it is not optimal to install additional panels, and the installation region, where it is. Such a curve depends on the current level of the company's installed power, and is the unique strictly increasing function which solves a first-order ordinary differential equation (ODE). Finally, our study is complemented by a numerical analysis of the dependency of the optimal installation strategy on the model's parameters.
△ Less
Submitted 11 November, 2019;
originally announced November 2019.
-
DuMu$^\text{x}$ 3 -- an open-source simulator for solving flow and transport problems in porous media with a focus on model coupling
Authors:
Timo Koch,
Dennis Gläser,
Kilian Weishaupt,
Sina Ackermann,
Martin Beck,
Beatrix Becker,
Samuel Burbulla,
Holger Class,
Edward Coltman,
Simon Emmert,
Thomas Fetzer,
Christoph Grüninger,
Katharina Heck,
Johannes Hommel,
Theresa Kurz,
Melanie Lipp,
Farid Mohammadi,
Samuel Scherrer,
Martin Schneider,
Gabriele Seitz,
Leopold Stadler,
Martin Utz,
Felix Weinhardt,
Bernd Flemisch
Abstract:
We present version 3 of the open-source simulator for flow and transport processes in porous media DuMu$^\text{x}$. DuMu$^\text{x}$ is based on the modular C++ framework Dune (Distributed and Unified Numerics Environment) and is developed as a research code with a focus on modularity and reusability. We describe recent efforts in improving the transparency and efficiency of the development process…
▽ More
We present version 3 of the open-source simulator for flow and transport processes in porous media DuMu$^\text{x}$. DuMu$^\text{x}$ is based on the modular C++ framework Dune (Distributed and Unified Numerics Environment) and is developed as a research code with a focus on modularity and reusability. We describe recent efforts in improving the transparency and efficiency of the development process and community-building, as well as efforts towards quality assurance and reproducible research. In addition to a major redesign of many simulation components in order to facilitate setting up complex simulations in DuMu$^\text{x}$, version 3 introduces a more consistent abstraction of finite volume schemes. Finally, the new framework for multi-domain simulations is described, and three numerical examples demonstrate its flexibility.
△ Less
Submitted 11 September, 2019;
originally announced September 2019.
-
Microstructure and Elastic Constants of Transition Metal Dichalcogenide Monolayers from Friction and Shear Force Microscopy
Authors:
Xiaomin Xu,
Thorsten Schultz,
Ziyu Qin,
Nikolai Severin,
Benedikt Haas,
Sumin Shen,
Jan N. Kirchhof,
Andreas Opitz,
Christoph T. Koch,
Kirill Bolotin,
Jürgen P. Rabe,
Goki Eda,
Norbert Koch
Abstract:
Optical and electrical properties of two-dimensional transition metal dichalcogenides (TMDCs) grown by chemical vapor deposition (CVD) are strongly determined by their microstructure. Consequently, the visualization of spatial structural variations is of paramount importance for future applications. Here we demonstrate how grain boundaries, crystal orientation, and strain fields can unambiguously…
▽ More
Optical and electrical properties of two-dimensional transition metal dichalcogenides (TMDCs) grown by chemical vapor deposition (CVD) are strongly determined by their microstructure. Consequently, the visualization of spatial structural variations is of paramount importance for future applications. Here we demonstrate how grain boundaries, crystal orientation, and strain fields can unambiguously be identified with combined lateral force microscopy (LFM) and transverse shear microscopy (TSM) for CVD-grown tungsten disulfide (WS2) monolayers, on length scales that are relevant for optoelectronic applications. Further, angle-dependent TSM measurements enable us to acquire the fourth-order elastic constants of monolayer WS2 experimentally. Our results facilitate high-throughput and nondestructive microstructure visualization of monolayer TMDCs, insights into their elastic properties, thus providing an accessible tool to support the development of advanced optoelectronic devices based on such two-dimensional semiconductors.
△ Less
Submitted 21 August, 2019;
originally announced August 2019.
-
First Experiments with Structure-Aware Presolving for a Parallel Interior-Point Method
Authors:
Ambros Gleixner,
Nils-Christian Kempke,
Thorsten Koch,
Daniel Rehfeldt,
Svenja Uslu
Abstract:
In linear optimization, matrix structure can often be exploited algorithmically. However, beneficial presolving reductions sometimes destroy the special structure of a given problem. In this article, we discuss structure-aware implementations of presolving as part of a parallel interior-point method to solve linear programs with block-diagonal structure, including both linking variables and linkin…
▽ More
In linear optimization, matrix structure can often be exploited algorithmically. However, beneficial presolving reductions sometimes destroy the special structure of a given problem. In this article, we discuss structure-aware implementations of presolving as part of a parallel interior-point method to solve linear programs with block-diagonal structure, including both linking variables and linking constraints. While presolving reductions are often mathematically simple, their implementation in a high-performance computing environment is a complex endeavor. We report results on impact, performance, and scalability of the resulting presolving routines on real-world energy system models with up to 700 million nonzero entries in the constraint matrix.
△ Less
Submitted 2 August, 2019;
originally announced August 2019.