Showing 1–30 of 30 results for author: Wenzel, T

Greedy Kernel Methods for Approximating Breakthrough Curves for Reactive Flow from 3D Porous Geometry Data

Authors: Robin Herkert, Patrick Buchfink, Tizian Wenzel, Bernard Haasdonk, Pavel Toktaliev, Oleg Iliev

Abstract: We address the challenging application of 3D pore scale reactive flow under varying geometry parameters. The task is to predict time-dependent integral quantities, i.e., breakthrough curves, from the given geometries. As the 3D reactive flow simulation is highly complex and computationally expensive, we are interested in data-based surrogates that can give a rapid prediction of the target quantiti… ▽ More We address the challenging application of 3D pore scale reactive flow under varying geometry parameters. The task is to predict time-dependent integral quantities, i.e., breakthrough curves, from the given geometries. As the 3D reactive flow simulation is highly complex and computationally expensive, we are interested in data-based surrogates that can give a rapid prediction of the target quantities of interest. This setting is an example of an application with scarce data, i.e., only having available few data samples, while the input and output dimensions are high. In this scarce data setting, standard machine learning methods are likely to ail. Therefore, we resort to greedy kernel approximation schemes that have shown to be efficient meshless approximation techniques for multivariate functions. We demonstrate that such methods can efficiently be used in the high-dimensional input/output case under scarce data. Especially, we show that the vectorial kernel orthogonal greedy approximation (VKOGA) procedure with a data-adapted two-layer kernel yields excellent predictors for learning from 3D geometry voxel data via both morphological descriptors or principal component analysis. △ Less

Submitted 29 May, 2024; originally announced May 2024.

Comments: 16 pages, 7 figures

Finetuning greedy kernel models by exchange algorithms

Authors: Tizian Wenzel, Armin Iske

Abstract: Kernel based approximation offers versatile tools for high-dimensional approximation, which can especially be leveraged for surrogate modeling. For this purpose, both "knot insertion" and "knot removal" approaches aim at choosing a suitable subset of the data, in order to obtain a sparse but nevertheless accurate kernel model. In the present work, focussing on kernel based interpolation, we aim at… ▽ More Kernel based approximation offers versatile tools for high-dimensional approximation, which can especially be leveraged for surrogate modeling. For this purpose, both "knot insertion" and "knot removal" approaches aim at choosing a suitable subset of the data, in order to obtain a sparse but nevertheless accurate kernel model. In the present work, focussing on kernel based interpolation, we aim at combining these two approaches to further improve the accuracy of kernel models, without increasing the computational complexity of the final kernel model. For this, we introduce a class of kernel exchange algorithms (KEA). The resulting KEA algorithm can be used for finetuning greedy kernel surrogate models, allowing for an reduction of the error up to 86.4% (17.2% on average) in our experiments. △ Less

Submitted 30 April, 2024; originally announced April 2024.

Automated tomographic assessment of structural defects of freeze-dried pharmaceuticals

Authors: Patric Müller, Achim Sack, Jens Dümler, Michael Heckel, Tim Wenzel, Teresa Siegert, Sonja Schuldt-Lieb, Henning Gieseler, Thorsten Pöschel

Abstract: The topology and surface characteristics of lyophilisates significantly impact the stability and reconstitutability of freeze-dried pharmaceuticals. Consequently, visual quality control of the product is imperative. However, this procedure is not only time-consuming and labor-intensive but also expensive and prone to errors. In this paper, we present an approach for fully automated, non-destructiv… ▽ More The topology and surface characteristics of lyophilisates significantly impact the stability and reconstitutability of freeze-dried pharmaceuticals. Consequently, visual quality control of the product is imperative. However, this procedure is not only time-consuming and labor-intensive but also expensive and prone to errors. In this paper, we present an approach for fully automated, non-destructive inspection of freeze-dried pharmaceuticals, leveraging robotics, computed tomography, and machine learning. △ Less

Submitted 17 April, 2024; originally announced April 2024.

Comments: 20 pages, 6 figures

A comparison study of supervised learning techniques for the approximation of high dimensional functions and feedback control

Authors: Mathias Oster, Luca Saluzzi, Tizian Wenzel

Abstract: Approximation of high dimensional functions is in the focus of machine learning and data-based scientific computing. In many applications, empirical risk minimisation techniques over nonlinear model classes are employed. Neural networks, kernel methods and tensor decomposition techniques are among the most popular model classes. We provide a numerical study comparing the performance of these metho… ▽ More Approximation of high dimensional functions is in the focus of machine learning and data-based scientific computing. In many applications, empirical risk minimisation techniques over nonlinear model classes are employed. Neural networks, kernel methods and tensor decomposition techniques are among the most popular model classes. We provide a numerical study comparing the performance of these methods on various high-dimensional functions with focus on optimal control problems, where the collection of the dataset is based on the application of the State-Dependent Riccati Equation. △ Less

Submitted 2 February, 2024; originally announced February 2024.

BEAM: The Modeling Framework for Behavior, Energy, Autonomy & Mobility

Authors: Haitam Laarabi, Zachary Needell, Rashid Waraich, Cristian Poliziani, Tom Wenzel

Abstract: This report outlines the concepts, mechanisms and inner dynamics of the BEAM (Behavior, Energy, Autonomy, and Mobility) modeling framework. BEAM is an open-source large-scale high-resolution transportation model that harnesses the principles of the actor model of computation to build a powerful and efficient agent-based model of travel behavior. It allows a detailed microscopic view of how people… ▽ More This report outlines the concepts, mechanisms and inner dynamics of the BEAM (Behavior, Energy, Autonomy, and Mobility) modeling framework. BEAM is an open-source large-scale high-resolution transportation model that harnesses the principles of the actor model of computation to build a powerful and efficient agent-based model of travel behavior. It allows a detailed microscopic view of how people make travel choices and interact with the transportation system, enabling more accurate simulations of human mobility and urban transport networks. It also allows the analysis of numerous spatially defined but interacting layers, and integrates them into a cohesive representation of a regional transportation system. This integrated picture provides invaluable insights to policy makers and other stakeholders about how changes to the transportation system result in changes to traffic congestion, mode share, energy use, and emissions throughout a modeled region. These capabilities are demonstrated with a case study of New York City that showcase BEAM's application in a very large and intricate urban transportation system, without relying on existing travel demand models. The unique ability of BEAM to simulate individual behaviors, integrate with other models, and adapt to different real-world scenarios underscores its importance in the rapidly evolving field of transportation and emphasizes its potential as a valuable proof-of-concept tool to contribute to more informed and effective policy and planning decisions. △ Less

Submitted 3 August, 2023; originally announced August 2023.

Comments: 47 pages, 12 figures, 6 tables, "under review" for publication as a Lawrence Berkeley National Laboratory Technical Report

On the optimality of target-data-dependent kernel greedy interpolation in Sobolev Reproducing Kernel Hilbert Spaces

Authors: Gabriele Santin, Tizian Wenzel, Bernard Haasdonk

Abstract: Kernel interpolation is a versatile tool for the approximation of functions from data, and it can be proven to have some optimality properties when used with kernels related to certain Sobolev spaces. In the context of interpolation, the selection of optimal function sampling locations is a central problem, both from a practical perspective, and as an interesting theoretical question. Greedy int… ▽ More Kernel interpolation is a versatile tool for the approximation of functions from data, and it can be proven to have some optimality properties when used with kernels related to certain Sobolev spaces. In the context of interpolation, the selection of optimal function sampling locations is a central problem, both from a practical perspective, and as an interesting theoretical question. Greedy interpolation algorithms provide a viable solution for this task, being efficient to run and provably accurate in their approximation. In this paper we close a gap that is present in the convergence theory for these algorithms by employing a recent result on general greedy algorithms. This modification leads to new convergence rates which match the optimal ones when restricted to the $P$-greedy target-data-independent selection rule, and can additionally be proven to be optimal when they fully exploit adaptivity ($f$-greedy). Other than closing this gap, the new results have some significance in the broader setting of the optimality of general approximation algorithms in Reproducing Kernel Hilbert Spaces, as they allow us to compare adaptive interpolation with non-adaptive best nonlinear approximation. △ Less

Submitted 19 July, 2023; originally announced July 2023.

Sharp inverse estimates for radial basis function interpolation: One-to-one correspondence between smoothness and approximation rates

Authors: Tizian Wenzel

Abstract: While direct statemets for kernel based approximation on domains $Ω\subset \mathbb{R}^d$ using radial basis functions are well researched, there still seems to be a gap in comparison with corresponding inverse statements. In this paper we sharpen inverse statements and by this close a ``gap of $d/2$" which was raised in the literature. In particular we show that for a large class of finitely smoot… ▽ More While direct statemets for kernel based approximation on domains $Ω\subset \mathbb{R}^d$ using radial basis functions are well researched, there still seems to be a gap in comparison with corresponding inverse statements. In this paper we sharpen inverse statements and by this close a ``gap of $d/2$" which was raised in the literature. In particular we show that for a large class of finitely smooth radial basis function kernels such as Matérn or Wendland kernels, there exists a one-to-one correspondence between the smoothness of a function and its $L^2(Ω)$ approximation rate via kernel interpolation: If a function can be approximation with a given rate, it has a corresponding smoothness and vice versa △ Less

Submitted 26 June, 2023; originally announced June 2023.

Application of Deep Kernel Models for Certified and Adaptive RB-ML-ROM Surrogate Modeling

Authors: Tizian Wenzel, Bernard Haasdonk, Hendrik Kleikamp, Mario Ohlberger, Felix Schindler

Abstract: In the framework of reduced basis methods, we recently introduced a new certified hierarchical and adaptive surrogate model, which can be used for efficient approximation of input-output maps that are governed by parametrized partial differential equations. This adaptive approach combines a full order model, a reduced order model and a machine-learning model. In this contribution, we extend the ap… ▽ More In the framework of reduced basis methods, we recently introduced a new certified hierarchical and adaptive surrogate model, which can be used for efficient approximation of input-output maps that are governed by parametrized partial differential equations. This adaptive approach combines a full order model, a reduced order model and a machine-learning model. In this contribution, we extend the approach by leveraging novel kernel models for the machine learning part, especially structured deep kernel networks as well as two layered kernel models. We demonstrate the usability of those enhanced kernel models for the RB-ML-ROM surrogate modeling chain and highlight their benefits in numerical experiments. △ Less

Submitted 28 February, 2023; originally announced February 2023.

Leveraging Interactions in Microfluidic Droplets for Enhanced Biotechnology Screens

Authors: Carolus Vitalis, Tobias Wenzel

Abstract: Microfluidic droplet screens serve as an innovative platform for high-throughput biotechnology, enabling significant advancements in discovery, product optimization, and analysis. This review sheds light on the emerging trend of interaction assays in microfluidic droplets, underscoring the unique suitability of droplets for these applications. Encompassing a diverse range of biological entities su… ▽ More Microfluidic droplet screens serve as an innovative platform for high-throughput biotechnology, enabling significant advancements in discovery, product optimization, and analysis. This review sheds light on the emerging trend of interaction assays in microfluidic droplets, underscoring the unique suitability of droplets for these applications. Encompassing a diverse range of biological entities such as antibodies, enzymes, DNA, RNA, various microbial and mammalian cell types, drugs, and other molecules, these assays demonstrate their versatility and scope. Recent methodological breakthroughs have escalated these screens to novel scales of bioanalysis and biotechnological product design. Moreover, we highlight pioneering advancements that extend droplet-based screens into new domains: cargo delivery within human bodies, application of synthetic gene circuits in natural environments, 3D-printing, and the development of droplet structures responsive to environmental signals. The potential of this field is profound and only set to increase. △ Less

Submitted 31 May, 2023; v1 submitted 31 January, 2023; originally announced February 2023.

Comments: 10 pages, 3 figures

MSC Class: 76T30; 78A70; 68U10

Journal ref: Current Opinion in Biotechnology, August 2023, Volume 82, 102966

Data-driven kernel designs for optimized greedy schemes: A machine learning perspective

Authors: Tizian Wenzel, Francesco Marchetti, Emma Perracchione

Abstract: Thanks to their easy implementation via Radial Basis Functions (RBFs), meshfree kernel methods have been proved to be an effective tool for e.g. scattered data interpolation, PDE collocation, classification and regression tasks. Their accuracy might depend on a length scale hyperparameter, which is often tuned via cross validation schemes. Here we leverage approaches and tools from the machine lea… ▽ More Thanks to their easy implementation via Radial Basis Functions (RBFs), meshfree kernel methods have been proved to be an effective tool for e.g. scattered data interpolation, PDE collocation, classification and regression tasks. Their accuracy might depend on a length scale hyperparameter, which is often tuned via cross validation schemes. Here we leverage approaches and tools from the machine learning community to introduce two-layered kernel machines, which generalize the classical RBF approaches that rely on a single hyperparameter. Indeed, the proposed learning strategy returns a kernel that is optimized not only in the Euclidean directions, but that further incorporates kernel rotations. The kernel optimization is shown to be robust by using recently improved calculations of cross validation scores. Finally, the use of greedy approaches, and specifically of the Vectorial Kernel Orthogonal Greedy Algorithm (VKOGA), allows us to construct an optimized basis that adapts to the data. Beyond a rigorous analysis on the convergence of the so-constructed two-Layered (2L)-VKOGA, its benefits are highlighted on both synthesized and real benchmark data sets. △ Less

Submitted 19 January, 2023; originally announced January 2023.

Global technology access in biolabs -- from DIY trend to an open source transformation

Authors: Tobias Wenzel

Abstract: This article illustrates how open hardware solutions are implemented by researchers as a strategy to access technology for cutting-edge research. Specifically, it is discussed what kind of open technologies are most enabling in scientific environments characterized by economic and infrastructural constraints. It is demonstrated that do-it-yourself (DIY) technologies are already wide spread, in par… ▽ More This article illustrates how open hardware solutions are implemented by researchers as a strategy to access technology for cutting-edge research. Specifically, it is discussed what kind of open technologies are most enabling in scientific environments characterized by economic and infrastructural constraints. It is demonstrated that do-it-yourself (DIY) technologies are already wide spread, in particular in countries with lower science funding, which in turn is the basis for the development of open technologies. Beyond financial accessibility, open hardware can be transformational to the technology access of laboratories through advantages in local production and direct knowledge transfer. Central drivers of the adoption of appropriate technologies in biolabs globally are open sharing, digital fabrication, local production, standard parts use, and detailed documentation. △ Less

Submitted 30 September, 2022; originally announced October 2022.

Journal ref: PLoS Biol 21(1): e3001931 (2023)

AWADA: Attention-Weighted Adversarial Domain Adaptation for Object Detection

Authors: Maximilian Menke, Thomas Wenzel, Andreas Schwung

Abstract: Object detection networks have reached an impressive performance level, yet a lack of suitable data in specific applications often limits it in practice. Typically, additional data sources are utilized to support the training task. In these, however, domain gaps between different data sources pose a challenge in deep learning. GAN-based image-to-image style-transfer is commonly applied to shrink t… ▽ More Object detection networks have reached an impressive performance level, yet a lack of suitable data in specific applications often limits it in practice. Typically, additional data sources are utilized to support the training task. In these, however, domain gaps between different data sources pose a challenge in deep learning. GAN-based image-to-image style-transfer is commonly applied to shrink the domain gap, but is unstable and decoupled from the object detection task. We propose AWADA, an Attention-Weighted Adversarial Domain Adaptation framework for creating a feedback loop between style-transformation and detection task. By constructing foreground object attention maps from object detector proposals, we focus the transformation on foreground object regions and stabilize style-transfer training. In extensive experiments and ablation studies, we show that AWADA reaches state-of-the-art unsupervised domain adaptation object detection performance in the commonly used benchmarks for tasks such as synthetic-to-real, adverse weather and cross-camera adaptation. △ Less

Submitted 31 August, 2022; originally announced August 2022.

Comments: 10 Pages, 4 Figures

MSC Class: 68T45

Adaptive meshfree approximation for linear elliptic partial differential equations with PDE-greedy kernel methods

Authors: Tizian Wenzel, Daniel Winkle, Gabriele Santin, Bernard Haasdonk

Abstract: We consider the meshless approximation for solutions of boundary value problems (BVPs) of elliptic Partial Differential Equations (PDEs) via symmetric kernel collocation. We discuss the importance of the choice of the collocation points, in particular by using greedy kernel methods. We introduce a scale of PDE-greedy selection criteria that generalizes existing techniques, such as the PDE-P -greed… ▽ More We consider the meshless approximation for solutions of boundary value problems (BVPs) of elliptic Partial Differential Equations (PDEs) via symmetric kernel collocation. We discuss the importance of the choice of the collocation points, in particular by using greedy kernel methods. We introduce a scale of PDE-greedy selection criteria that generalizes existing techniques, such as the PDE-P -greedy and the PDE-f -greedy rules for collocation point selection. For these greedy selection criteria we provide bounds on the approximation error in terms of the number of greedily selected points and analyze the corresponding convergence rates. This is achieved by a novel analysis of Kolmogorov widths of special sets of BVP point-evaluation functionals. Especially, we prove that target-data dependent algorithms that make use of the right hand side functions of the BVP exhibit faster convergence rates than the target-data independent PDE-P -greedy. The convergence rate of the PDE-f -greedy possesses a dimension independent rate, which makes it amenable to mitigate the curse of dimensionality. The advantages of these greedy algorithms are highlighted by numerical examples. △ Less

Submitted 1 July, 2024; v1 submitted 28 July, 2022; originally announced July 2022.

What Makes You Hold on to That Old Car? Joint Insights from Machine Learning and Multinomial Logit on Vehicle-level Transaction Decisions

Authors: Ling **, Alina Lazar, Caitlin Brown, Bingrong Sun, Venu Garikapati, Srinath Ravulaparthy, Qianmiao Chen, Alexander Sim, Kesheng Wu, Tin Ho, Thomas Wenzel, C. Anna Spurlock

Abstract: What makes you hold on that old car? While the vast majority of the household vehicles are still powered by conventional internal combustion engines, the progress of adopting emerging vehicle technologies will critically depend on how soon the existing vehicles are transacted out of the household fleet. Leveraging a nationally representative longitudinal data set, the Panel Study of Income Dynamic… ▽ More What makes you hold on that old car? While the vast majority of the household vehicles are still powered by conventional internal combustion engines, the progress of adopting emerging vehicle technologies will critically depend on how soon the existing vehicles are transacted out of the household fleet. Leveraging a nationally representative longitudinal data set, the Panel Study of Income Dynamics, this study examines how household decisions to dispose of or replace a given vehicle are: (1) influenced by the vehicle's attributes, (2) mediated by households' concurrent socio-demographic and economic attributes, and (3) triggered by key life cycle events. Coupled with a newly developed machine learning interpretation tool, TreeExplainer, we demonstrate an innovative use of machine learning models to augment traditional logit modeling to both generate behavioral insights and improve model performance. We find the two gradient-boosting-based methods, CatBoost and LightGBM, are the best performing machine learning models for this problem. The multinomial logistic model can achieve similar performance levels after its model specification is informed by TreeExplainer. Both machine learning and multinomial logit models suggest that while older vehicles are more likely to be disposed of or replaced than newer ones, such probability decreases as the vehicles serve the family longer. We find that married families, families with higher education levels, homeowners, and older families tend to keep their vehicles longer. Life events such as childbirth, residential relocation, and change of household composition and income are found to increase vehicle disposal and/or replacement. We provide additional insights on the timing of vehicle replacement or disposal, in particular, the presence of children and childbirth events are more strongly associated with vehicle replacement among younger parents. △ Less

Submitted 13 May, 2022; originally announced May 2022.

A new certified hierarchical and adaptive RB-ML-ROM surrogate model for parametrized PDEs

Authors: B. Haasdonk, H. Kleikamp, M. Ohlberger, F. Schindler, T. Wenzel

Abstract: We present a new surrogate modeling technique for efficient approximation of input-output maps governed by parametrized PDEs. The model is hierarchical as it is built on a full order model (FOM), reduced order model (ROM) and machine-learning (ML) model chain. The model is adaptive in the sense that the ROM and ML model are adapted on-the-fly during a sequence of parametric requests to the model.… ▽ More We present a new surrogate modeling technique for efficient approximation of input-output maps governed by parametrized PDEs. The model is hierarchical as it is built on a full order model (FOM), reduced order model (ROM) and machine-learning (ML) model chain. The model is adaptive in the sense that the ROM and ML model are adapted on-the-fly during a sequence of parametric requests to the model. To allow for a certification of the model hierarchy, as well as to control the adaptation process, we employ rigorous a posteriori error estimates for the ROM and ML models. In particular, we provide an example of an ML-based model that allows for rigorous analytical quality statements. We demonstrate the efficiency of the modeling chain on a Monte Carlo and a parameter-optimization example. Here, the ROM is instantiated by Reduced Basis Methods and the ML model is given by a neural network or a VKOGA kernel model. △ Less

Submitted 2 December, 2022; v1 submitted 28 April, 2022; originally announced April 2022.

Comments: 27 pages, 5 figures

MSC Class: 65N30; 65M60; 68T07

Stability of convergence rates: Kernel interpolation on non-Lipschitz domains

Authors: Tizian Wenzel, Gabriele Santin, Bernard Haasdonk

Abstract: Error estimates for kernel interpolation in Reproducing Kernel Hilbert Spaces (RKHS) usually assume quite restrictive properties on the shape of the domain, especially in the case of infinitely smooth kernels like the popular Gaussian kernel. In this paper we leverage an analysis of greedy kernel algorithms to prove that it is possible to obtain convergence results (in the number of interpolatio… ▽ More Error estimates for kernel interpolation in Reproducing Kernel Hilbert Spaces (RKHS) usually assume quite restrictive properties on the shape of the domain, especially in the case of infinitely smooth kernels like the popular Gaussian kernel. In this paper we leverage an analysis of greedy kernel algorithms to prove that it is possible to obtain convergence results (in the number of interpolation points) for kernel interpolation for arbitrary domains $Ω\subset \mathbb{R}^d$, thus allowing for non-Lipschitz domains including e.g. cusps and irregular boundaries. Especially we show that, when going to a smaller domain $\tildeΩ \subset Ω\subset \mathbb{R}^d$, the convergence rate does not deteriorate - i.e. the convergence rates are stable with respect to going to a subset. The impact of this result is explained on the examples of kernels of finite as well as infinite smoothness like the Gaussian kernel. A comparison to approximation in Sobolev spaces is drawn, where the shape of the domain $Ω$ has an impact on the approximation properties. Numerical experiments illustrate and confirm the experiments. △ Less

Submitted 12 July, 2023; v1 submitted 23 March, 2022; originally announced March 2022.

Harnessing the Benefits of Open Electronics in Science

Authors: Michael Oellermann, Jolle W. Jolles, Diego Ortiz, Rui Seabra, Tobias Wenzel, Hannah Wilson, Richelle Tanner

Abstract: Freely and openly shared low-cost electronic applications, known as open electronics, have sparked a new open-source movement, with much un-tapped potential to advance scientific research. Initially designed to appeal to electronic hobbyists, open electronics have formed a global community of "makers" and inventors and are increasingly used in science and industry. Here, we review the current bene… ▽ More Freely and openly shared low-cost electronic applications, known as open electronics, have sparked a new open-source movement, with much un-tapped potential to advance scientific research. Initially designed to appeal to electronic hobbyists, open electronics have formed a global community of "makers" and inventors and are increasingly used in science and industry. Here, we review the current benefits of open electronics for scientific research and guide academics to enter this emerging field. We discuss how electronic applications, from the experimental to the theoretical sciences, can help (I) individual researchers by increasing the customization, efficiency, and scalability of experiments, while improving data quantity and quality; (II) scientific institutions by improving access and maintenance of high-end technologies, visibility and interdisciplinary collaboration potential; and (III) the scientific community by improving transparency and reproducibility, hel** decouple research capacity from funding, increasing innovation, and improving collaboration potential among researchers and the public. Open electronics are powerful tools to increase creativity, democratization, and reproducibility of research and thus offer practical solutions to overcome significant barriers in science. △ Less

Submitted 30 June, 2021; originally announced June 2021.

Comments: 20 pages, 3 figure, 2 tables

Enrichment of gut microbiome strains for cultivation-free genome sequencing using droplet microfluidics

Authors: Anna Pryszlak, Tobias Wenzel, Kiley West Seitz, Falk Hildebrand, Ece Kartal, Marco Raffaele Cosenza, Vladimir Benes, Peer Bork, Christoph Merten

Abstract: We report a droplet microfluidic method to target and sort individual cells directly from complex microbiome samples, and to prepare these cells for bulk whole genome sequencing without cultivation. We characterize this approach by recovering bacteria spiked into human stool samples at a ratio as low as 1:250 and by successfully enriching endogenous Bacteroides vulgatus to the level required for d… ▽ More We report a droplet microfluidic method to target and sort individual cells directly from complex microbiome samples, and to prepare these cells for bulk whole genome sequencing without cultivation. We characterize this approach by recovering bacteria spiked into human stool samples at a ratio as low as 1:250 and by successfully enriching endogenous Bacteroides vulgatus to the level required for de-novo assembly of high-quality genomes. While microbiome strains are increasingly demanded for biomedical applications, the vast majority of species and strains are uncultivated and without reference genomes. We address this shortcoming by encapsulating complex microbiome samples directly into microfluidic droplets and amplify a target-specific genomic fragment using a custom molecular TaqMan probe. We separate those positive droplets by droplet sorting, selectively enriching single target strain cells. Finally, we present a protocol to purify the genomic DNA while specifically removing amplicons and cell debris for high-quality genome sequencing. △ Less

Submitted 2 June, 2021; originally announced June 2021.

Comments: 18 pages incl. references, 4 main figures and one supplementary figure

Journal ref: Cell Reports Methods 12/2021

Analysis of target data-dependent greedy kernel algorithms: Convergence rates for $f$-, $f \cdot P$- and $f/P$-greedy

Authors: Tizian Wenzel, Gabriele Santin, Bernard Haasdonk

Abstract: Data-dependent greedy algorithms in kernel spaces are known to provide fast converging interpolants, while being extremely easy to implement and efficient to run. Despite this experimental evidence, no detailed theory has yet been presented. This situation is unsatisfactory especially when compared to the case of the data-independent $P$-greedy algorithm, for which optimal convergence rates are av… ▽ More Data-dependent greedy algorithms in kernel spaces are known to provide fast converging interpolants, while being extremely easy to implement and efficient to run. Despite this experimental evidence, no detailed theory has yet been presented. This situation is unsatisfactory especially when compared to the case of the data-independent $P$-greedy algorithm, for which optimal convergence rates are available, despite its performances being usually inferior to the ones of target data-dependent algorithms. In this work we fill this gap by first defining a new scale of greedy algorithms for interpolation that comprises all the existing ones in a unique analysis, where the degree of dependency of the selection criterion on the functional data is quantified by a real parameter. We then prove new convergence rates where this degree is taken into account and we show that, possibly up to a logarithmic factor, target data-dependent selection strategies provide faster convergence. In particular, for the first time we obtain convergence rates for target data adaptive interpolation that are faster than the ones given by uniform points, without the need of any special assumption on the target function. The rates are confirmed by a number of examples. These results are made possible by a new analysis of greedy algorithms in general Hilbert spaces. △ Less

Submitted 16 May, 2021; originally announced May 2021.

Universality and Optimality of Structured Deep Kernel Networks

Authors: Tizian Wenzel, Gabriele Santin, Bernard Haasdonk

Abstract: Kernel based methods yield approximation models that are flexible, efficient and powerful. In particular, they utilize fixed feature maps of the data, being often associated to strong analytical results that prove their accuracy. On the other hand, the recent success of machine learning methods has been driven by deep neural networks (NNs). They achieve a significant accuracy on very high-dimensio… ▽ More Kernel based methods yield approximation models that are flexible, efficient and powerful. In particular, they utilize fixed feature maps of the data, being often associated to strong analytical results that prove their accuracy. On the other hand, the recent success of machine learning methods has been driven by deep neural networks (NNs). They achieve a significant accuracy on very high-dimensional data, in that they are able to learn also efficient data representations or data-based feature maps. In this paper, we leverage a recent deep kernel representer theorem to connect the two approaches and understand their interplay. In particular, we show that the use of special types of kernels yield models reminiscent of neural networks that are founded in the same theoretical framework of classical kernel methods, while enjoying many computational properties of deep neural networks. Especially the introduced Structured Deep Kernel Networks (SDKNs) can be viewed as neural networks with optimizable activation functions obeying a representer theorem. Analytic properties show their universal approximation properties in different asymptotic regimes of unbounded number of centers, width and depth. Especially in the case of unbounded depth, the constructions is asymptotically better than corresponding constructions for ReLU neural networks, which is made possible by the flexibility of kernel approximation △ Less

Submitted 15 May, 2021; originally announced May 2021.

A full order, reduced order and machine learning model pipeline for efficient prediction of reactive flows

Authors: Pavel Gavrilenko, Bernard Haasdonk, Oleg Iliev, Mario Ohlberger, Felix Schindler, Pavel Toktaliev, Tizian Wenzel, Maha Youssef

Abstract: We present an integrated approach for the use of simulated data from full order discretization as well as projection-based Reduced Basis reduced order models for the training of machine learning approaches, in particular Kernel Methods, in order to achieve fast, reliable predictive models for the chemical conversion rate in reactive flows with varying transport regimes. We present an integrated approach for the use of simulated data from full order discretization as well as projection-based Reduced Basis reduced order models for the training of machine learning approaches, in particular Kernel Methods, in order to achieve fast, reliable predictive models for the chemical conversion rate in reactive flows with varying transport regimes. △ Less

Submitted 29 April, 2022; v1 submitted 6 April, 2021; originally announced April 2021.

Comments: 9 pages, 1 table; Previously this version appeared as arXiv:2110.12388v2 which was submitted as a new work by accident

Structured Deep Kernel Networks for Data-Driven Closure Terms of Turbulent Flows

Authors: Tizian Wenzel, Marius Kurz, Andrea Beck, Gabriele Santin, Bernard Haasdonk

Abstract: Standard kernel methods for machine learning usually struggle when dealing with large datasets. We review a recently introduced Structured Deep Kernel Network (SDKN) approach that is capable of dealing with high-dimensional and huge datasets - and enjoys typical standard machine learning approximation properties. We extend the SDKN to combine it with standard machine learning modules and compare i… ▽ More Standard kernel methods for machine learning usually struggle when dealing with large datasets. We review a recently introduced Structured Deep Kernel Network (SDKN) approach that is capable of dealing with high-dimensional and huge datasets - and enjoys typical standard machine learning approximation properties. We extend the SDKN to combine it with standard machine learning modules and compare it with Neural Networks on the scientific challenge of data-driven prediction of closure terms of turbulent flows. We show experimentally that the SDKNs are capable of dealing with large datasets and achieve near-perfect accuracy on the given application. △ Less

Submitted 25 March, 2021; originally announced March 2021.

Bosch Deep Learning Hardware Benchmark

Authors: Armin Runge, Thomas Wenzel, Dimitrios Bariamis, Benedikt Sebastian Staffler, Lucas Rego Drumond, Michael Pfeiffer

Abstract: The widespread use of Deep Learning (DL) applications in science and industry has created a large demand for efficient inference systems. This has resulted in a rapid increase of available Hardware Accelerators (HWAs) making comparison challenging and laborious. To address this, several DL hardware benchmarks have been proposed aiming at a comprehensive comparison for many models, tasks, and hardw… ▽ More The widespread use of Deep Learning (DL) applications in science and industry has created a large demand for efficient inference systems. This has resulted in a rapid increase of available Hardware Accelerators (HWAs) making comparison challenging and laborious. To address this, several DL hardware benchmarks have been proposed aiming at a comprehensive comparison for many models, tasks, and hardware platforms. Here, we present our DL hardware benchmark which has been specifically developed for inference on embedded HWAs and tasks required for autonomous driving. In addition to previous benchmarks, we propose a new granularity level to evaluate common submodules of DL models, a twofold benchmark procedure that accounts for hardware and model optimizations done by HWA manufacturers, and an extended set of performance indicators that can help to identify a mismatch between a HWA and the DL models used in our benchmark. △ Less

Submitted 24 August, 2020; originally announced August 2020.

Comments: Presented in MLBench: Workshop on Benchmarking Machine Learning Workloads (https://sites.google.com/g.harvard.edu/mlbench/home)

Biomechanical surrogate modelling using stabilized vectorial greedy kernel methods

Authors: Bernard Haasdonk, Tizian Wenzel, Gabriele Santin, Syn Schmitt

Abstract: Greedy kernel approximation algorithms are successful techniques for sparse and accurate data-based modelling and function approximation. Based on a recent idea of stabilization of such algorithms in the scalar output case, we here consider the vectorial extension built on VKOGA. We introduce the so called $γ$-restricted VKOGA, comment on analytical properties and present numerical evaluation on d… ▽ More Greedy kernel approximation algorithms are successful techniques for sparse and accurate data-based modelling and function approximation. Based on a recent idea of stabilization of such algorithms in the scalar output case, we here consider the vectorial extension built on VKOGA. We introduce the so called $γ$-restricted VKOGA, comment on analytical properties and present numerical evaluation on data from a clinically relevant application, the modelling of the human spine. The experiments show that the new stabilized algorithms result in improved accuracy and stability over the non-stabilized algorithms. △ Less

Submitted 28 April, 2020; v1 submitted 27 April, 2020; originally announced April 2020.

Journal ref: Numerical Mathematics and Advanced Applications ENUMATH 2019

Standardisation of practices in Open Source Hardware

Authors: Jérémy Bonvoisin, Jenny Molloy, Martin Haeuer, Tobias Wenzel

Abstract: Standardisation is an important component in the maturation of any field of technology. It contributes to the formation of a recognisable identity and enables interactions with a wider community. This article reviews past and current standardisation initiatives in the field of Open Source Hardware (OSH). While early initiatives focused on aspects such as licencing, intellectual property and docume… ▽ More Standardisation is an important component in the maturation of any field of technology. It contributes to the formation of a recognisable identity and enables interactions with a wider community. This article reviews past and current standardisation initiatives in the field of Open Source Hardware (OSH). While early initiatives focused on aspects such as licencing, intellectual property and documentation formats, recent efforts extend to ways for users to exercise their rights under open licences and to keep OSH projects discoverable and accessible online. We specifically introduce two standards that are currently being released and call for early users and contributors, the DIN SPEC 3105 and the Open Know How Manifest Specification. Finally, we reflect on challenges around standardisation in the community and relevant areas for future development such as an open tool chain, modularity and hardware specific interface standards. △ Less

Submitted 15 April, 2020; originally announced April 2020.

Comments: 9 Pages without abstract and references (else 13), no figures

Journal ref: Journal of Open Hardware, 4(1), p.2 (2020)

A novel class of stabilized greedy kernel approximation algorithms: Convergence, stability & uniform point distribution

Authors: Tizian Wenzel, Gabriele Santin, Bernard Haasdonk

Abstract: Kernel based methods provide a way to reconstruct potentially high-dimensional functions from meshfree samples, i.e., sampling points and corresponding target values. A crucial ingredient for this to be successful is the distribution of the sampling points. Since the computation of an optimal selection of sampling points may be an infeasible task, one promising option is to use greedy methods. A… ▽ More Kernel based methods provide a way to reconstruct potentially high-dimensional functions from meshfree samples, i.e., sampling points and corresponding target values. A crucial ingredient for this to be successful is the distribution of the sampling points. Since the computation of an optimal selection of sampling points may be an infeasible task, one promising option is to use greedy methods. Although these methods may be very effective, depending on the specific greedy criterion the chosen points might quickly lead to instabilities in the computation. To circumvent this problem, we introduce and investigate a new class of \textit{stabilized} greedy kernel algorithms, which can be used to create a scale of new selection strategies. We analyze these algorithms, and in particular we prove convergence results and quantify in a precise way the distribution of the selected points. These results allow to prove, in the case of certain Sobolev kernels, that the algorithms have optimal stability and optimal convergence rates, including for functions outside the native space of the kernel. The results also apply to the case of the usual $P$-greedy algorithm, significantly improving state-of-the-art results available in the literature. Illustrative experiments are presented that support the theoretical findings. △ Less

Submitted 11 November, 2019; originally announced November 2019.

Journal ref: Journal of Approximation Theory Volume 262, February 2021

Porous translucent electrodes enhance current generation from photosynthetic biofilms

Authors: Tobias Wenzel, Daniel Haertter, Paolo Bombelli, Christopher J. Howe, Ullrich Steiner

Abstract: We tested the enhancement of electrical current generated from photosynthetically active bacteria by use of electrodes with porosity on the nano- and micrometer length-scale. For two cyanobacteria on structured indium-tin-oxide electrodes, current generation was increased by two orders of magnitude and the photo-response was substantially faster compared to non-porous anodes. These properties high… ▽ More We tested the enhancement of electrical current generated from photosynthetically active bacteria by use of electrodes with porosity on the nano- and micrometer length-scale. For two cyanobacteria on structured indium-tin-oxide electrodes, current generation was increased by two orders of magnitude and the photo-response was substantially faster compared to non-porous anodes. These properties highlight porosity as an important design strategy for electrochemical bio-interfaces. The role of porosity on different length scales was studied systematically which revealed that the main performance enhancement was caused by the increased surface area of the electrodes. More complex microstructured architectures which spanned biofilms as translucent 3D scaffolds provided additional advantage in the presence of microbial direct electron transfer (DET). The absence of a clear DET contribution in both studied cyanobacteria, Synechocystis and Nostoc, raises questions about the role of conductive cellular components previously found in both organisms. △ Less

Submitted 25 December, 2017; originally announced December 2017.

Comments: 11 pages manuscript and 6 pages supplementary material, 18 figures overall

Microrheology of DNA Hydrogels

Authors: Zhongyang Xing, Alessio Caciagli, Tianyang Cao, Iliya Stoev, Mykolas Zupkauskas, Thomas O'Neill, Tobias Wenzel, Robin Lamboll, Dongsheg Liu, Erika Eiser

Abstract: A key objective in DNA-based material science is understanding and precisely controlling the mechanical properties of DNA hydrogels. We perform microrheology measurements using diffusing-wave spectroscopy (DWS) to investigate the viscoelastic behavior of a hydrogel made of Y-shaped DNA nano-stars over a wide range of frequencies and temperatures. Results show a clear liquid-to-equilibrium-gel tran… ▽ More A key objective in DNA-based material science is understanding and precisely controlling the mechanical properties of DNA hydrogels. We perform microrheology measurements using diffusing-wave spectroscopy (DWS) to investigate the viscoelastic behavior of a hydrogel made of Y-shaped DNA nano-stars over a wide range of frequencies and temperatures. Results show a clear liquid-to-equilibrium-gel transition as the temperature cycles up and down across the melting-temperature region for which the Y-DNA bind to each other. These first measurements reveal the crossover of the elastic G'(ω) and loss modulus G'(ω) when the DNA-hydrogel formed at low temperatures is heated to a fluid phase of DNA nano-stars well above the melt temperature Tm. We show that the crossover relates to the life-time of the DNA-bond and also that percolation coincides with the systems' Tm. The approach demonstrated here can be easily extended to more complicated DNA hydrogel systems and provides guidance for the future design of such transient, semi-flexible networks that can be adapted to the application of molecular sensing and controlled release. △ Less

Submitted 22 December, 2017; v1 submitted 21 December, 2017; originally announced December 2017.

Civil Asset Forfeiture: A Judicial Perspective

Authors: Leslie Barrett, Wayne Krug, Zefu Lu, Karin D. Martin, Roberto Martin, Alexandra Ortan, Anu Pradhan, Alexander Sherman, Michael W. Sherman, Ryon Smey, Trent Wenzel

Abstract: Civil Asset Forfeiture (CAF) is a longstanding and controversial legal process viewed on the one hand as a powerful tool for combating drug crimes and on the other hand as a violation of the rights of US citizens. Data used to support both sides of the controversy to date has come from government sources representing records of the events at the time of occurrence. Court dockets represent litigati… ▽ More Civil Asset Forfeiture (CAF) is a longstanding and controversial legal process viewed on the one hand as a powerful tool for combating drug crimes and on the other hand as a violation of the rights of US citizens. Data used to support both sides of the controversy to date has come from government sources representing records of the events at the time of occurrence. Court dockets represent litigation events initiated following the forfeiture, however, and can thus provide a new perspective on the CAF legal process. This paper will show new evidence supporting existing claims about the growth of the practice and bias in its application based on the quantitative analysis of data derived from these court cases. △ Less

Submitted 5 October, 2017; originally announced October 2017.

Comments: Presented at the Data For Good Exchange 2017

Near-field examination of perovskite-based superlenses and superlens-enhanced probe-object coupling

Authors: Susanne C. Kehr, Yongmin M. Liu, L. W. Martin, P. Yu, M. Gajek, S. -Y. Yang, C. -H. Yang, M. T. Wenzel, R. Jacob, H. -G. von Ribbeck, M. Helm, X. Zhang, L. M. Eng, R. Ramesh

Abstract: A planar slab of negative index material works as a superlens with sub-diffraction-limited imaging resolution, since propagating waves are focused and, moreover, evanescent waves are reconstructed in the image plane. Here, we demonstrate a superlens for electric evanescent fields with low losses using perovskites in the mid-infrared regime. The combination of near-field microscopy with a tunable f… ▽ More A planar slab of negative index material works as a superlens with sub-diffraction-limited imaging resolution, since propagating waves are focused and, moreover, evanescent waves are reconstructed in the image plane. Here, we demonstrate a superlens for electric evanescent fields with low losses using perovskites in the mid-infrared regime. The combination of near-field microscopy with a tunable free-electron laser allows us to address precisely the polariton modes, which are critical for super-resolution imaging. We spectrally study the lateral and vertical distributions of evanescent waves around the image plane of such a lens, and achieve imaging resolution of wavelength/14 at the superlensing wavelength. Interestingly, at certain distances between the probe and sample surface, we observe a maximum of these evanescent fields. Comparisons with numerical simulations indicate that this maximum originates from an enhanced coupling between probe and object, which might be applicable for multifunctional circuits, infrared spectroscopy, and thermal sensors. △ Less

Submitted 25 March, 2011; originally announced March 2011.

Comments: 20 pages, 6 figures, published as open access article in Nature Communications (see http://www.nature.com/ncomms/)

Journal ref: Nat. Commun. 2:249 (2011)