Showing 1–50 of 61 results for author: Karlsson, J

A parallel framework for graphical optimal transport

Authors: Jiaojiao Fan, Isabel Haasler, Qinsheng Zhang, Johan Karlsson, Yongxin Chen

Abstract: We study multi-marginal optimal transport (MOT) problems where the underlying cost has a graphical structure. These graphical multi-marginal optimal transport problems have found applications in several domains including traffic flow control and regression problems in the Wasserstein space. MOT problem can be approached through two aspects: a single big MOT problem, or coupled minor OT problems. I… ▽ More We study multi-marginal optimal transport (MOT) problems where the underlying cost has a graphical structure. These graphical multi-marginal optimal transport problems have found applications in several domains including traffic flow control and regression problems in the Wasserstein space. MOT problem can be approached through two aspects: a single big MOT problem, or coupled minor OT problems. In this paper, we focus on the latter approach and demonstrate it has efficiency gain from the parallelization. For tree-structured MOT problems, we introduce a novel parallelizable algorithm that significantly reduces computational complexity. Additionally, we adapt this algorithm for general graphs, employing the modified junction trees to enable parallel updates. Our contributions, validated through numerical experiments, offer new avenues for MOT applications and establish benchmarks in computational efficiency. △ Less

Submitted 16 June, 2024; originally announced June 2024.

Computation of Robust Option Prices via Structured Multi-Marginal Martingale Optimal Transport

Authors: Linn Engström, Sigrid Källblad, Johan Karlsson

Abstract: We introduce an efficient computational framework for solving a class of multi-marginal martingale optimal transport problems, which includes many robust pricing problems of large financial interest. Such problems are typically computationally challenging due to the martingale constraint, however, by extending the state space we can identify them with problems that exhibit a certain sequential mar… ▽ More We introduce an efficient computational framework for solving a class of multi-marginal martingale optimal transport problems, which includes many robust pricing problems of large financial interest. Such problems are typically computationally challenging due to the martingale constraint, however, by extending the state space we can identify them with problems that exhibit a certain sequential martingale structure. Our method exploits such structures in combination with entropic regularisation, enabling fast computation of optimal solutions and allowing us to solve problems with a large number of marginals. We demonstrate the method by using it for computing robust price bounds for different options, such as lookback options and Asian options. △ Less

Submitted 14 June, 2024; originally announced June 2024.

MSC Class: 49M29; 60G42; 90C08; 91G20

Towards Out-of-Distribution Detection for breast cancer classification in Point-of-Care Ultrasound Imaging

Authors: Jennie Karlsson, Marisa Wodrich, Niels Christian Overgaard, Freja Sahlin, Kristina Lång, Anders Heyden, Ida Arvidsson

Abstract: Deep learning has shown to have great potential in medical applications. In critical domains as such, it is of high interest to have trustworthy algorithms which are able to tell when reliable assessments cannot be guaranteed. Detecting out-of-distribution (OOD) samples is a crucial step towards building a safe classifier. Following a previous study, showing that it is possible to classify breast… ▽ More Deep learning has shown to have great potential in medical applications. In critical domains as such, it is of high interest to have trustworthy algorithms which are able to tell when reliable assessments cannot be guaranteed. Detecting out-of-distribution (OOD) samples is a crucial step towards building a safe classifier. Following a previous study, showing that it is possible to classify breast cancer in point-of-care ultrasound images, this study investigates OOD detection using three different methods: softmax, energy score and deep ensembles. All methods are tested on three different OOD data sets. The results show that the energy score method outperforms the softmax method, performing well on two of the data sets. The ensemble method is the most robust, performing the best at detecting OOD samples for all three OOD data sets. △ Less

Submitted 29 February, 2024; originally announced February 2024.

A cutting plane algorithm for globally solving low dimensional k-means clustering problems

Authors: Martin Ryner, Jan Kronqvist, Johan Karlsson

Abstract: Clustering is one of the most fundamental tools in data science and machine learning, and k-means clustering is one of the most common such methods. There is a variety of approximate algorithms for the k-means problem, but computing the globally optimal solution is in general NP-hard. In this paper we consider the k-means problem for instances with low dimensional data and formulate it as a struct… ▽ More Clustering is one of the most fundamental tools in data science and machine learning, and k-means clustering is one of the most common such methods. There is a variety of approximate algorithms for the k-means problem, but computing the globally optimal solution is in general NP-hard. In this paper we consider the k-means problem for instances with low dimensional data and formulate it as a structured concave assignment problem. This allows us to exploit the low dimensional structure and solve the problem to global optimality within reasonable time for large data sets with several clusters. The method builds on iteratively solving a small concave problem and a large linear programming problem. This gives a sequence of feasible solutions along with bounds which we show converges to zero optimality gap. The paper combines methods from global optimization theory to accelerate the procedure, and we provide numerical results on their performance. △ Less

Submitted 21 February, 2024; originally announced February 2024.

Comments: 12 pages, 3 figures

MSC Class: 90C26 (Primary) 90C27 (Secondary) ACM Class: G.1.6

Globally solving the Gromov-Wasserstein problem for point clouds in low dimensional Euclidean spaces

Authors: Martin Ryner, Jan Kronqvist, Johan Karlsson

Abstract: This paper presents a framework for computing the Gromov-Wasserstein problem between two sets of points in low dimensional spaces, where the discrepancy is the squared Euclidean norm. The Gromov-Wasserstein problem is a generalization of the optimal transport problem that finds the assignment between two sets preserving pairwise distances as much as possible. This can be used to quantify the simil… ▽ More This paper presents a framework for computing the Gromov-Wasserstein problem between two sets of points in low dimensional spaces, where the discrepancy is the squared Euclidean norm. The Gromov-Wasserstein problem is a generalization of the optimal transport problem that finds the assignment between two sets preserving pairwise distances as much as possible. This can be used to quantify the similarity between two formations or shapes, a common problem in AI and machine learning. The problem can be formulated as a Quadratic Assignment Problem (QAP), which is in general computationally intractable even for small problems. Our framework addresses this challenge by reformulating the QAP as an optimization problem with a low-dimensional domain, leveraging the fact that the problem can be expressed as a concave quadratic optimization problem with low rank. The method scales well with the number of points, and it can be used to find the global solution for large-scale problems with thousands of points. We compare the computational complexity of our approach with state-of-the-art methods on synthetic problems and apply it to a near-symmetrical problem which is of particular interest in computational biology. △ Less

Submitted 18 July, 2023; originally announced July 2023.

Comments: 20 pages, 5 figures

MSC Class: 90C26

The Kontsevich-Segal Criterion in the No-Boundary State Constrains Inflation

Authors: Thomas Hertog, Oliver Janssen, Joel Karlsson

Abstract: We show that the Kontsevich-Segal (KS) criterion, applied to the complex saddles that specify the semiclassical no-boundary wave function, acts as a selection mechanism on inflationary scalar field potentials. Completing the observable phase of slow-roll inflation with a no-boundary origin, the KS criterion effectively bounds the tensor-to-scalar ratio of cosmic microwave background fluctuations t… ▽ More We show that the Kontsevich-Segal (KS) criterion, applied to the complex saddles that specify the semiclassical no-boundary wave function, acts as a selection mechanism on inflationary scalar field potentials. Completing the observable phase of slow-roll inflation with a no-boundary origin, the KS criterion effectively bounds the tensor-to-scalar ratio of cosmic microwave background fluctuations to be less than 0.08, in line with current observations. We trace the failure of complex saddles to meet the KS criterion to the development of a tachyon in their spectrum of perturbations. △ Less

Submitted 9 November, 2023; v1 submitted 23 May, 2023; originally announced May 2023.

Comments: Dedicated to the memory of Jim Hartle

Journal ref: Phys. Rev. Lett. 131, 191501 (2023)

Mean field type control with species dependent dynamics via structured tensor optimization

Authors: Axel Ringh, Isabel Haasler, Yongxin Chen, Johan Karlsson

Abstract: In this work we consider mean field type control problems with multiple species that have different dynamics. We formulate the discretized problem using a new type of entropy-regularized multimarginal optimal transport problems where the cost is a decomposable structured tensor. A novel algorithm for solving such problems is derived, using this structure and leveraging recent results in entropy-re… ▽ More In this work we consider mean field type control problems with multiple species that have different dynamics. We formulate the discretized problem using a new type of entropy-regularized multimarginal optimal transport problems where the cost is a decomposable structured tensor. A novel algorithm for solving such problems is derived, using this structure and leveraging recent results in entropy-regularized optimal transport. The algorithm is then demonstrated on a numerical example in robot coordination problem for search and rescue, where three different types of robots are used to cover a given area at minimal cost. △ Less

Submitted 24 May, 2023; originally announced May 2023.

Comments: 6 pages; 4 figures

The complete Kaluza-Klein spectra of $\mathcal{N} = 1$ and $\mathcal{N} = 0$ M-theory on $AdS_4 \times (\text{squashed } S^7)$

Authors: Joel Karlsson, Bengt E. W. Nilsson

Abstract: The squashed seven-sphere operator spectrum is completed by deriving the spectrum of the spin-3/2 operator. The implications of the results for the $AdS_4$ $\mathcal{N} = 1$ supermultiplets obtained from compactification of eleven-dimensional supergravity are analysed. The weak $G_2$ holonomy plays an important role when solving the eigenvalue equations on the squashed sphere. Here, a novel and mo… ▽ More The squashed seven-sphere operator spectrum is completed by deriving the spectrum of the spin-3/2 operator. The implications of the results for the $AdS_4$ $\mathcal{N} = 1$ supermultiplets obtained from compactification of eleven-dimensional supergravity are analysed. The weak $G_2$ holonomy plays an important role when solving the eigenvalue equations on the squashed sphere. Here, a novel and more universal algebraic approach to the whole eigenvalue problem on coset manifolds is provided. Having obtained full control of all the operator spectra, we can finally determine the irreps $D(E_0, s)$ for all supermultiplets in the left-squashed vacuum. This includes an analysis of possible boundary conditions. By performing an orientation flip on the seven-sphere, we also obtain the full spectrum for the non-supersymmetric right-squashed compactification which is of interest in the swampland context and in particular for the $AdS$ swampland conjecture. Here, a number of boundary condition ambiguities arise making the analysis of dual marginal operators somewhat involved. This work is a direct continuation of [1] and [2]. △ Less

Submitted 9 February, 2024; v1 submitted 1 May, 2023; originally announced May 2023.

Comments: 88 pages, 8 figures, 20 tables; v2: additional comments included

Visual Detection of Personal Protective Equipment and Safety Gear on Industry Workers

Authors: Jonathan Karlsson, Fredrik Strand, Josef Bigun, Fernando Alonso-Fernandez, Kevin Hernandez-Diaz, Felix Nilsson

Abstract: Workplace injuries are common in today's society due to a lack of adequately worn safety equipment. A system that only admits appropriately equipped personnel can be created to improve working conditions. The goal is thus to develop a system that will improve workers' safety using a camera that will detect the usage of Personal Protective Equipment (PPE). To this end, we collected and labeled appr… ▽ More Workplace injuries are common in today's society due to a lack of adequately worn safety equipment. A system that only admits appropriately equipped personnel can be created to improve working conditions. The goal is thus to develop a system that will improve workers' safety using a camera that will detect the usage of Personal Protective Equipment (PPE). To this end, we collected and labeled appropriate data from several public sources, which have been used to train and evaluate several models based on the popular YOLOv4 object detector. Our focus, driven by a collaborating industrial partner, is to implement our system into an entry control point where workers must present themselves to obtain access to a restricted area. Combined with facial identity recognition, the system would ensure that only authorized people wearing appropriate equipment are granted access. A novelty of this work is that we increase the number of classes to five objects (hardhat, safety vest, safety gloves, safety glasses, and hearing protection), whereas most existing works only focus on one or two classes, usually hardhats or vests. The AI model developed provides good detection accuracy at a distance of 3 and 5 meters in the collaborative environment where we aim at operating (mAP of 99/89%, respectively). The small size of some objects or the potential occlusion by body parts have been identified as potential factors that are detrimental to accuracy, which we have counteracted via data augmentation and crop** of the body before applying PPE detection. △ Less

Submitted 9 December, 2022; originally announced December 2022.

Comments: Accepted for publication at ICPRAM

Microscopics of de Sitter Entropy from Precision Holography

Authors: Nikolay Bobev, Thomas Hertog, Junho Hong, Joel Karlsson, Valentin Reys

Abstract: We calculate quantum corrections to the entropy of four-dimensional de Sitter space induced by higher-derivative terms in the gravitational action and by one-loop effects. Employing the intertwinement in semiclassical gravity of Euclidean de Sitter and anti-de Sitter saddles, we embed effective de Sitter gravity theories in M-theory and express the entropy in terms of the regularized Euclidean ant… ▽ More We calculate quantum corrections to the entropy of four-dimensional de Sitter space induced by higher-derivative terms in the gravitational action and by one-loop effects. Employing the intertwinement in semiclassical gravity of Euclidean de Sitter and anti-de Sitter saddles, we embed effective de Sitter gravity theories in M-theory and express the entropy in terms of the regularized Euclidean anti-de Sitter action on an auxiliary $\mathrm{EAdS}_4 \times S^7/\mathbb{Z}_k$ background. We conjecture that the partition function of the holographically dual 3d ABJM CFT determines the explicit form of the corrections to the de Sitter entropy. This includes a logarithmic term, the coefficient of which, we show, agrees with an independent one-loop calculation around the $-S^4 \times S^7/\mathbb{Z}_k$ Euclidean de Sitter saddle. This provides evidence that the microscopic degrees of freedom behind the entropy of four-dimensional de Sitter space in gravitational theories with a holographic dual description are encapsulated by the path integral of the Euclidean CFT on the three-sphere. △ Less

Submitted 9 February, 2024; v1 submitted 10 November, 2022; originally announced November 2022.

Comments: 11 pages; v2: additional comments included

Journal ref: Phys. Rev. X 13, 041056 (2023)

Orthogonalization of data via Gromov-Wasserstein type feedback for clustering and visualization

Authors: Martin Ryner, Johan Karlsson

Abstract: In this paper we propose an adaptive approach for clustering and visualization of data by an orthogonalization process. Starting with the data points being represented by a Markov process using the diffusion map framework, the method adaptively increase the orthogonality of the clusters by applying a feedback mechanism inspired by the Gromov-Wasserstein distance. This mechanism iteratively increas… ▽ More In this paper we propose an adaptive approach for clustering and visualization of data by an orthogonalization process. Starting with the data points being represented by a Markov process using the diffusion map framework, the method adaptively increase the orthogonality of the clusters by applying a feedback mechanism inspired by the Gromov-Wasserstein distance. This mechanism iteratively increases the spectral gap and refines the orthogonality of the data to achieve a clustering with high specificity. By using the diffusion map framework and representing the relation between data points using transition probabilities, the method is robust with respect to both the underlying distance, noise in the data and random initialization. We prove that the method converges globally to a unique fixpoint for certain parameter values. We also propose a related approach where the transition probabilities in the Markov process are required to be doubly stochastic, in which case the method generates a minimizer to a nonconvex optimization problem. We apply the method on cryo-electron microscopy image data from biopharmaceutical manufacturing where we can confirm biologically relevant insights related to therapeutic efficacy. We consider an example with morphological variations of gene packaging and confirm that the method produces biologically meaningful clustering results consistent with human expert classification. △ Less

Submitted 25 July, 2022; originally announced July 2022.

Comments: 19 pages, 3 figures

Graph-structured tensor optimization for nonlinear density control and mean field games

Authors: Axel Ringh, Isabel Haasler, Yongxin Chen, Johan Karlsson

Abstract: In this work we develop a numerical method for solving a type of convex graph-structured tensor optimization problems. This type of problems, which can be seen as a generalization of multi-marginal optimal transport problems with graph-structured costs, appear in many applications. Examples are unbalanced optimal transport and multi-species potential mean field games, where the latter is a class o… ▽ More In this work we develop a numerical method for solving a type of convex graph-structured tensor optimization problems. This type of problems, which can be seen as a generalization of multi-marginal optimal transport problems with graph-structured costs, appear in many applications. Examples are unbalanced optimal transport and multi-species potential mean field games, where the latter is a class of nonlinear density control problems. The method we develop is based on coordinate ascent in a Lagrangian dual, and under mild assumptions we prove that the algorithm converges globally. Moreover, under a set of stricter assumptions, the algorithm converges R-linearly. To perform the coordinate ascent steps one has to compute projections of the tensor, and doing so by brute force is in general not computationally feasible. Nevertheless, for certain graph structures it is possible to derive efficient methods for computing these projections, and here we specifically consider the graph structure that occurs in multi-species potential mean field games. We also illustrate the methodology on a numerical example from this problem class. △ Less

Submitted 22 March, 2024; v1 submitted 10 December, 2021; originally announced December 2021.

Comments: 27 pages. Revision: among other things, the section on Convex dynamic network flow problems has been removed, and the section on Multi-species potential mean field games has been expanded

Compactifications of String/M-Theory and the Swampland: A Study of the AdS$_\text{4}$ Mass Spectrum of Eleven-Dimensional Supergravity on the Squashed Seven-Sphere

Authors: Joel Karlsson

Abstract: The landscape of possible four-dimensional low-energy effective theories arising from compactifications of string/M-theory seems vast. This might lead one to believe that any consistent-looking effective field theory coupled to gravity can be obtained as a low-energy limit of string theory. However, a set of "swampland" conjectures suggests that this is not true and that, in fact, there is an even… ▽ More The landscape of possible four-dimensional low-energy effective theories arising from compactifications of string/M-theory seems vast. This might lead one to believe that any consistent-looking effective field theory coupled to gravity can be obtained as a low-energy limit of string theory. However, a set of "swampland" conjectures suggests that this is not true and that, in fact, there is an even larger set of effective field theories that cannot be obtained in this way. In particular, the AdS instability swampland conjecture asserts that nonsupersymmetric anti-de Sitter vacua are unstable. These swampland criteria can have implications for, for instance, low-energy physics and cosmology. M-theory is a nonperturbative unification of all superstring theories. Its low-energy limit, eleven-dimensional supergravity, admits two compactifications on the squashed seven-sphere. One of the solutions has one unbroken supersymmetry ($\mathcal{N} = 1$) while the other has none ($\mathcal{N} = 0$). Due to the AdS instability swampland conjecture, the latter should be unstable. However, this has not been demonstrated explicitly. To study the stability of the $\mathcal{N} = 0$ vacuum, we investigate the mass spectrum of the theory. The main advancement compared to previous attempts is the realisation that all mass operators in the Freund-Rubin compactification are related to a universal Laplacian, allowing us to relate Weyl tensor terms to group invariants. One limitation of the group-theoretical method we employ is that it can lead to false roots. This is remedied, at least in part, by demanding that the fields form supermultiplets in the $\mathcal{N} = 1$ case. Although we arrive at an eigenvalue spectrum for all operators of interest, there is a hint that the results may be incomplete. Thus, we do not reach a decisive conclusion regarding the investigated type of instability. △ Less

Submitted 29 December, 2021; v1 submitted 17 October, 2021; originally announced October 2021.

Comments: 179 pages, MSc Thesis at Chalmers University of Technology, Gothenburg, Sweden, v2: references added

Quantifying and Computing Covariance Uncertainty

Authors: Filip Elvander, Johan Karlsson, Toon van Waterschoot

Abstract: In this work, we consider the problem of bounding the values of a covariance function corresponding to a continuous-time stationary stochastic process or signal. Specifically, for two signals whose covariance functions agree on a finite discrete set of time-lags, we consider the maximal possible discrepancy of the covariance functions for real-valued time-lags outside this discrete grid. Computing… ▽ More In this work, we consider the problem of bounding the values of a covariance function corresponding to a continuous-time stationary stochastic process or signal. Specifically, for two signals whose covariance functions agree on a finite discrete set of time-lags, we consider the maximal possible discrepancy of the covariance functions for real-valued time-lags outside this discrete grid. Computing this uncertainty corresponds to solving an infinite dimensional non-convex problem. However, we herein prove that the maximal objective value may be bounded from above by a finite dimensional convex optimization problem, allowing for efficient computation by standard methods. Furthermore, we empirically observe that for the case of signals whose spectra are supported on an interval, this upper bound is sharp, i.e., provides an exact quantification of the covariance uncertainty. △ Less

Submitted 6 October, 2021; originally announced October 2021.

On the complexity of the optimal transport problem with graph-structured cost

Authors: Jiaojiao Fan, Isabel Haasler, Johan Karlsson, Yongxin Chen

Abstract: Multi-marginal optimal transport (MOT) is a generalization of optimal transport to multiple marginals. Optimal transport has evolved into an important tool in many machine learning applications, and its multi-marginal extension opens up for addressing new challenges in the field of machine learning. However, the usage of MOT has been largely impeded by its computational complexity which scales exp… ▽ More Multi-marginal optimal transport (MOT) is a generalization of optimal transport to multiple marginals. Optimal transport has evolved into an important tool in many machine learning applications, and its multi-marginal extension opens up for addressing new challenges in the field of machine learning. However, the usage of MOT has been largely impeded by its computational complexity which scales exponentially in the number of marginals. Fortunately, in many applications, such as barycenter or interpolation problems, the cost function adheres to structures, which has recently been exploited for develo** efficient computational methods. In this work we derive computational bounds for these methods. With $m$ marginal distributions supported on $n$ points, we provide a $ \mathcal{\tilde O}(d(G)m n^2ε^{-2})$ bound for a $ε$-accuracy when the problem is associated with a tree with diameter $d(G)$. For the special case of the Wasserstein barycenter problem, which corresponds to a star-shaped tree, our bound is in alignment with the existing complexity bound for it. △ Less

Submitted 4 December, 2021; v1 submitted 1 October, 2021; originally announced October 2021.

Mixed-Spectrum Signals -- Discrete Approximations and Variance Expressions for Covariance Estimates

Authors: Filip Elvander, Johan Karlsson

Abstract: The estimation of the covariance function of a stochastic process, or signal, is of integral importance for a multitude of signal processing applications. In this work, we derive closed-form expressions for the variance of covariance estimates for mixed-spectrum signals, i.e., spectra containing both absolutely continuous and singular parts. The results cover both finite-sample and asymptotic regi… ▽ More The estimation of the covariance function of a stochastic process, or signal, is of integral importance for a multitude of signal processing applications. In this work, we derive closed-form expressions for the variance of covariance estimates for mixed-spectrum signals, i.e., spectra containing both absolutely continuous and singular parts. The results cover both finite-sample and asymptotic regimes, allowing for assessing the exact speed of convergence of estimates to their expectations, as well as their limiting behavior. As is shown, such covariance estimates may converge even for non-ergodic processes. Furthermore, we consider approximating signals with arbitrary spectral densities by sequences of singular spectrum, i.e., sinusoidal, processes, and derive the limiting behavior of covariance estimates as both the sample size and the number of sinusoidal components tend to infinity. We show that the asymptotic regime variance can be described by a time-frequency resolution product, with dramatically different behavior depending on how the sinusoidal approximation is constructed. In a few numerical examples we illustrate the theory and the corresponding implications for direction of arrival estimation. △ Less

Submitted 4 October, 2021; v1 submitted 28 June, 2021; originally announced June 2021.

Scalable computation of dynamic flow problems via multi-marginal graph-structured optimal transport

Authors: Isabel Haasler, Axel Ringh, Yongxin Chen, Johan Karlsson

Abstract: In this work, we develop a new framework for dynamic network flow problems based on optimal transport theory. We show that the dynamic multi-commodity minimum-cost network flow problem can be formulated as a multi-marginal optimal transport problem, where the cost function and the constraints on the marginals are associated with a graph structure. By exploiting these structures and building on rec… ▽ More In this work, we develop a new framework for dynamic network flow problems based on optimal transport theory. We show that the dynamic multi-commodity minimum-cost network flow problem can be formulated as a multi-marginal optimal transport problem, where the cost function and the constraints on the marginals are associated with a graph structure. By exploiting these structures and building on recent advances in optimal transport theory, we develop an efficient method for such entropy-regularized optimal transport problems. In particular, the graph structure is utilized to efficiently compute the projections needed in the corresponding Sinkhorn iterations, and we arrive at a scheme that is both highly computationally efficient and easy to implement. To illustrate the performance of our algorithm, we compare it with a state-of-the-art Linear programming (LP) solver. We achieve good approximations to the solution at least one order of magnitude faster than the LP solver. Finally, we showcase the methodology on a traffic routing problem with a large number of commodities. △ Less

Submitted 28 June, 2021; originally announced June 2021.

Comments: 29 pages, 10 figures

VidHarm: A Clip Based Dataset for Harmful Content Detection

Authors: Johan Edstedt, Amanda Berg, Michael Felsberg, Johan Karlsson, Francisca Benavente, Anette Novak, Gustav Grund Pihlgren

Abstract: Automatically identifying harmful content in video is an important task with a wide range of applications. However, there is a lack of professionally labeled open datasets available. In this work VidHarm, an open dataset of 3589 video clips from film trailers annotated by professionals, is presented. An analysis of the dataset is performed, revealing among other things the relation between clip an… ▽ More Automatically identifying harmful content in video is an important task with a wide range of applications. However, there is a lack of professionally labeled open datasets available. In this work VidHarm, an open dataset of 3589 video clips from film trailers annotated by professionals, is presented. An analysis of the dataset is performed, revealing among other things the relation between clip and trailer level annotations. Audiovisual models are trained on the dataset and an in-depth study of modeling choices conducted. The results show that performance is greatly improved by combining the visual and audio modality, pre-training on large-scale video recognition datasets, and class balanced sampling. Lastly, biases of the trained models are investigated using discrimination probing. VidHarm is openly available, and further details are available at: https://vidharm.github.io △ Less

Submitted 2 September, 2022; v1 submitted 15 June, 2021; originally announced June 2021.

Predicting regional COVID-19 hospital admissions in Sweden using mobility data

Authors: Philip Gerlee, Julia Karlsson, Ingrid Fritzell, Thomas Brezicka, Armin Spreco, Toomas Timpka, Anna Jöud, Torbjörn Lundh

Abstract: The transmission of COVID-19 is dependent on social contacts, the rate of which have varied during the pandemic due to mandated and voluntary social distancing. Changes in transmission dynamics eventually affect hospital admissions and we have used this connection in order to model and predict regional hospital admissions in Sweden during the COVID-19 pandemic. We use an SEIR-model for each region… ▽ More The transmission of COVID-19 is dependent on social contacts, the rate of which have varied during the pandemic due to mandated and voluntary social distancing. Changes in transmission dynamics eventually affect hospital admissions and we have used this connection in order to model and predict regional hospital admissions in Sweden during the COVID-19 pandemic. We use an SEIR-model for each region in Sweden in which the infectivity is assumed to depend on mobility data in terms of public transport utilisation and mobile phone usage. The results show that the model can capture the timing of the first and beginning of the second wave of the pandemic. Further, we show that for two major regions of Sweden models with public transport data outperform models using mobile phone usage. The model assumes a three week delay from disease transmission to hospitalisation which makes it possible to use current mobility data to predict future admissions. △ Less

Submitted 4 January, 2021; originally announced January 2021.

MSC Class: 92B05; 37N25; 92D30

On analytic interpolation with non-classical constraints for solving problems in robust control

Authors: Axel Ringh, Johan Karlsson, Anders Lindquist

Abstract: In this work we consider robust stabilization of uncertain dynamical systems and show that this can be achieved by solving a non-classically constrained analytic interpolation problem. In particular, this non-classical constraint confines the range of the interpolant, when evaluated on the imaginary axis, to a frequency-dependent set. By considering a sufficient condition for when this interpolati… ▽ More In this work we consider robust stabilization of uncertain dynamical systems and show that this can be achieved by solving a non-classically constrained analytic interpolation problem. In particular, this non-classical constraint confines the range of the interpolant, when evaluated on the imaginary axis, to a frequency-dependent set. By considering a sufficient condition for when this interpolation problem has a solution, we derive an approximate solution algorithm that can also be used for controller synthesis. Finally, the theory is illustrated on a numerical example with a plant with uncertain gain, phase, and output delay. △ Less

Submitted 26 October, 2020; originally announced October 2020.

Comments: 8 pages, 2 figures

MSC Class: 47N70; 93B52; 30E05

Incremental inference of collective graphical models

Authors: Rahul Singh, Isabel Haasler, Qinsheng Zhang, Johan Karlsson, Yongxin Chen

Abstract: We consider incremental inference problems from aggregate data for collective dynamics. In particular, we address the problem of estimating the aggregate marginals of a Markov chain from noisy aggregate observations in an incremental (online) fashion. We propose a sliding window Sinkhorn belief propagation (SW-SBP) algorithm that utilizes a sliding window filter of the most recent noisy aggregate… ▽ More We consider incremental inference problems from aggregate data for collective dynamics. In particular, we address the problem of estimating the aggregate marginals of a Markov chain from noisy aggregate observations in an incremental (online) fashion. We propose a sliding window Sinkhorn belief propagation (SW-SBP) algorithm that utilizes a sliding window filter of the most recent noisy aggregate observations along with encoded information from discarded observations. Our algorithm is built upon the recently proposed multi-marginal optimal transport based SBP algorithm that leverages standard belief propagation and Sinkhorn algorithm to solve inference problems from aggregate data. We demonstrate the performance of our algorithm on applications such as inferring population flow from aggregate observations. △ Less

Submitted 26 June, 2020; originally announced June 2020.

Multi-marginal optimal transport and probabilistic graphical models

Authors: Isabel Haasler, Rahul Singh, Qinsheng Zhang, Johan Karlsson, Yongxin Chen

Abstract: We study multi-marginal optimal transport problems from a probabilistic graphical model perspective. We point out an elegant connection between the two when the underlying cost for optimal transport allows a graph structure. In particular, an entropy regularized multi-marginal optimal transport is equivalent to a Bayesian marginal inference problem for probabilistic graphical models with the addit… ▽ More We study multi-marginal optimal transport problems from a probabilistic graphical model perspective. We point out an elegant connection between the two when the underlying cost for optimal transport allows a graph structure. In particular, an entropy regularized multi-marginal optimal transport is equivalent to a Bayesian marginal inference problem for probabilistic graphical models with the additional requirement that some of the marginal distributions are specified. This relation on the one hand extends the optimal transport as well as the probabilistic graphical model theories, and on the other hand leads to fast algorithms for multi-marginal optimal transport by leveraging the well-developed algorithms in Bayesian inference. Several numerical examples are provided to highlight the results. △ Less

Submitted 24 June, 2020; originally announced June 2020.

Comments: 24 pages, 9 figures

MSC Class: 62F15; 49Q22; 90Cxx; 94A15

A Frequency-Multiplexed Coherent Electro-Optic Memory in Rare Earth Doped Nanoparticles

Authors: Alexandre Fossati, Shu** Liu, Jenny Karlsson, Akio Ikesue, Alexandre Tallaire, Alban Ferrier, Diana Serrano, Philippe Goldner

Abstract: Quantum memories for light are essential components in quantum technologies like long-distance quantum communication and distributed quantum computing. Recent studies have shown that long optical and spin coherence lifetimes can be observed in rare earth doped nanoparticles, opening exciting possibilities over bulk materials e.g. for enhancing coupling to light and other quantum systems, and mater… ▽ More Quantum memories for light are essential components in quantum technologies like long-distance quantum communication and distributed quantum computing. Recent studies have shown that long optical and spin coherence lifetimes can be observed in rare earth doped nanoparticles, opening exciting possibilities over bulk materials e.g. for enhancing coupling to light and other quantum systems, and material design. Here, we report on coherent light storage in Eu$^{3+}$:Y$_2$O$_3$ nanoparticles using the Stark Echo Modulation Memory (SEMM) quantum protocol. We first measure a nearly constant Stark coefficient of 50 kHz/(V/cm) across a bandwidth of 15 GHz, which is promising for broadband operation. Storage of light using SEMM is then demonstrated for times up to 40 $μ$s. Pulses with two different frequencies are also stored, confirming frequency-multiplexing capability, and are used to demonstrate the memory high phase fidelity. △ Less

Submitted 17 June, 2020; originally announced June 2020.

Comments: 20 pages, 5 figures

M$^2$-Spectral Estimation: A Flexible Approach Ensuring Rational Solutions

Authors: Bin Zhu, Augusto Ferrante, Johan Karlsson, Mattia Zorzi

Abstract: This paper concerns a spectral estimation problem for multivariate (i.e., vector-valued) signals defined on a multidimensional domain, abbreviated as M$^2$. The problem is posed as solving a finite number of trigonometric moment equations for a nonnegative matricial measure, which is well known as the \emph{covariance extension problem} in the literature of systems and control. This inverse proble… ▽ More This paper concerns a spectral estimation problem for multivariate (i.e., vector-valued) signals defined on a multidimensional domain, abbreviated as M$^2$. The problem is posed as solving a finite number of trigonometric moment equations for a nonnegative matricial measure, which is well known as the \emph{covariance extension problem} in the literature of systems and control. This inverse problem and its various generalizations have been extensively studied in the past three decades, and they find applications in diverse fields such as modeling and system identification, signal and image processing, robust control, circuit theory, etc. In this paper, we address the challenging M$^2$ version of the problem, and elaborate on a solution technique via convex optimization with the $τ$-divergence family. As a major contribution of this work, we show that by properly choosing the parameter of the divergence index, the optimal spectrum is a rational function, that is, the solution is a spectral density which can be represented by a finite-dimensional system, as desired in many practical applications. △ Less

Submitted 12 October, 2021; v1 submitted 30 April, 2020; originally announced April 2020.

Comments: 20 Pages in SIAM template, no figures

MSC Class: 42A70; 30E05; 47A57; 60G12

Journal ref: SIAM J. Control Optimization, vol. 59, no. 4, pp. 2977-2996, 2021

Multi-marginal Optimal Transport with a Tree-structured cost and the Schrödinger Bridge Problem

Authors: Isabel Haasler, Axel Ringh, Yongxin Chen, Johan Karlsson

Abstract: The optimal transport problem has recently developed into a powerful framework for various applications in estimation and control. Many of the recent advances in the theory and application of optimal transport are based on regularizing the problem with an entropy term, which connects it to the Schrödinger bridge problem and thus to stochastic optimal control. Moreover, the entropy regularization m… ▽ More The optimal transport problem has recently developed into a powerful framework for various applications in estimation and control. Many of the recent advances in the theory and application of optimal transport are based on regularizing the problem with an entropy term, which connects it to the Schrödinger bridge problem and thus to stochastic optimal control. Moreover, the entropy regularization makes the otherwise computationally demanding optimal transport problem feasible even for large scale settings. This has lead to an accelerated development of optimal transport based methods in a broad range of fields. Many of these applications have a underlying graph structure, for instance information fusion and tracking problems can be described by trees. In this work we consider multi-marginal optimal transport problems with a cost function that decouples according to a tree structure. The entropy regularized multi-marginal optimal transport problem can be viewed as a generalization of the Schrödinger bridge problem with the same tree-structure, and by utilizing these connections we extend the computational methods for the classical optimal transport problem in order to solve structured multi-marginal optimal transport problems in an efficient manner. In particular, the algorithm requires only matrix-vector multiplications of relatively small dimensions. We show that the multi-marginal regularization introduces less diffusion, compared to the commonly used pairwise regularization, and is therefore more suitable for many applications. Numerical examples illustrate this, and we finally apply the proposed framework for tracking of an ensemble of indistinguishable agents. △ Less

Submitted 11 March, 2021; v1 submitted 15 April, 2020; originally announced April 2020.

Comments: 27 pages, 16 figures

Inference with Aggregate Data: An Optimal Transport Approach

Authors: Rahul Singh, Isabel Haasler, Qinsheng Zhang, Johan Karlsson, Yongxin Chen

Abstract: We consider inference (filtering) problems over probabilistic graphical models with aggregate data generated by a large population of individuals. We propose a new efficient belief propagation type algorithm over tree-structured graphs with polynomial computational complexity as well as a global convergence guarantee. This is in contrast to previous methods that either exhibit prohibitive complexi… ▽ More We consider inference (filtering) problems over probabilistic graphical models with aggregate data generated by a large population of individuals. We propose a new efficient belief propagation type algorithm over tree-structured graphs with polynomial computational complexity as well as a global convergence guarantee. This is in contrast to previous methods that either exhibit prohibitive complexity as the population grows or do not guarantee convergence. Our method is based on optimal transport, or more specifically, multi-marginal optimal transport theory. In particular, we consider an inference problem with aggregate observations, that can be seen as a structured multi-marginal optimal transport problem where the cost function decomposes according to the underlying graph. Consequently, the celebrated Sinkhorn/iterative scaling algorithm for multi-marginal optimal transport can be leveraged together with the standard belief propagation algorithm to establish an efficient inference scheme which we call Sinkhorn belief propagation (SBP). We further specialize the SBP algorithm to cases associated with hidden Markov models due to their significance in control and estimation. We demonstrate the performance of our algorithm on applications such as inferring population flow from aggregate observations. We also show that in the special case where the observations are generated by a single individual, our algorithm naturally reduces to the standard belief propagation algorithm. △ Less

Submitted 2 October, 2020; v1 submitted 30 March, 2020; originally announced March 2020.

Comments: 14 pages, 12 figures

MSC Class: 62F15; 62M05; 93E10

Smart Resource Management for Data Streaming using an Online Bin-packing Strategy

Authors: Oliver Stein, Ben Blamey, Johan Karlsson, Alan Sabirsh, Ola Spjuth, Andreas Hellander, Salman Toor

Abstract: Data stream processing frameworks provide reliable and efficient mechanisms for executing complex workflows over large datasets. A common challenge for the majority of currently available streaming frameworks is efficient utilization of resources. Most frameworks use static or semi-static settings for resource utilization that work well for established use cases but lead to marginal improvements f… ▽ More Data stream processing frameworks provide reliable and efficient mechanisms for executing complex workflows over large datasets. A common challenge for the majority of currently available streaming frameworks is efficient utilization of resources. Most frameworks use static or semi-static settings for resource utilization that work well for established use cases but lead to marginal improvements for unseen scenarios. Another pressing issue is the efficient processing of large individual objects such as images and matrices typical for scientific datasets. HarmonicIO has proven to be a good solution for streams of relatively large individual objects, as demonstrated in a benchmark comparison with the Spark and Kafka streaming frameworks. We here present an extension of the HarmonicIO framework based on the online bin-packing algorithm, to allow for efficient utilization of resources. Based on a real world use case from large-scale microscopy pipelines, we compare results of the new system to Spark's auto-scaling mechanism. △ Less

Submitted 29 January, 2020; originally announced January 2020.

An analytic interpolation approach to stability margins with emphasis on time delay

Authors: Axel Ringh, Johan Karlsson, Anders Lindquist

Abstract: Unlike the situation with gain and phase margins in robust stabilization, the problem to determine an exact maximum delay margin is still an open problem, although extensive work has been done to establish upper and lower bounds. The problem is that the corresponding constraints in the Nyquist plot are frequency dependent, and encircling the point $s=-1$ has to be done at sufficiently low frequenc… ▽ More Unlike the situation with gain and phase margins in robust stabilization, the problem to determine an exact maximum delay margin is still an open problem, although extensive work has been done to establish upper and lower bounds. The problem is that the corresponding constraints in the Nyquist plot are frequency dependent, and encircling the point $s=-1$ has to be done at sufficiently low frequencies, as the possibility to do so closes at higher frequencies. In this paper we present a new method for determining a sharper lower bound by introducing a frequency-dependent shift. The problem of finding such a bound simultaneously with gain and phase margin constraints is also considered. In all these problems we take an analytic interpolation approach. △ Less

Submitted 26 October, 2020; v1 submitted 18 December, 2019; originally announced December 2019.

Comments: 16 pages, 10 figures. Revision

MSC Class: 47N70; 93B52; 30E05

Using infrared gas sensors in an in-vitro dynamic gut model for detecting short-chain fatty-acids: Technical Report

Authors: Martin Längkvist, Amy Loutfi, Igancio Rangel, Johnny Karlsson, Robert Jan Brummer

Abstract: Short-chain fatty acids (SCFAs), including acetate, propionate and butyrate, are organic fatty-acids that are produced when indigested carbohydrates are fermented in the colon by gut-bacteria. Butyrate is especially considered a beneficial compound in relation to gut health and the maintenance of colonic homeostasis. Little is known about butyrate production and the current measurement methods of… ▽ More Short-chain fatty acids (SCFAs), including acetate, propionate and butyrate, are organic fatty-acids that are produced when indigested carbohydrates are fermented in the colon by gut-bacteria. Butyrate is especially considered a beneficial compound in relation to gut health and the maintenance of colonic homeostasis. Little is known about butyrate production and the current measurement methods of fecal samples are not representative and there is a strong unmet need to measure SCFAs in-vivo to further understand their role and effect on colonic function in human gut health and disease. The general aim of the project is to develop a novel sensor based on infrared technology that is capable of online detecting short chain fatty acids (SCFA; e.g. acetate, propionate and butyrate) and other small biomolecules (e.g. ammonium) produced in bioreactors. Whereas currently such levels of small biomolecules are usually not detected online due to practical constraints (sampling-analysis-processing of data), reliable online detection could significantly decrease analysis costs. Further, it would allow to perform online quality control of the bioreactors and allow to e.g. detect deviating values at an early stage. Hence, one can react much faster tackling certain problems which will further improve the quality of each experiment. Using machine learning algorithms to process the sensor signals, the results from testing in a so-called artificial gut setup are described in this technical report. △ Less

Submitted 21 August, 2019; originally announced September 2019.

Comments: Technical Report

M$^2$-Spectral Estimation: A Relative Entropy Approach

Authors: Bin Zhu, Augusto Ferrante, Johan Karlsson, Mattia Zorzi

Abstract: This paper deals with M$^2$-signals, namely multivariate (or vector-valued) signals defined over a multidimensional domain. In particular, we propose an optimization technique to solve the covariance extension problem for stationary random vector fields. The multidimensional Itakura-Saito distance is employed as an optimization criterion to select the solution among the spectra satisfying a finite… ▽ More This paper deals with M$^2$-signals, namely multivariate (or vector-valued) signals defined over a multidimensional domain. In particular, we propose an optimization technique to solve the covariance extension problem for stationary random vector fields. The multidimensional Itakura-Saito distance is employed as an optimization criterion to select the solution among the spectra satisfying a finite number of moment constraints. In order to avoid technicalities that may happen on the boundary of the feasible set, we deal with the discrete version of the problem where the multidimensional integrals are approximated by Riemann sums. The spectrum solution is also discrete, which occurs naturally when the underlying random field is periodic. We show that a solution to the discrete problem exists, is unique and depends smoothly on the problem data. Therefore, we have a well-posed problem whose solution can be tuned in a smooth manner. Finally, we have applied our theory to the target parameter estimation problem in an integrated system of automotive modules. Simulation results show that our spectral estimator has promising performance. △ Less

Submitted 16 September, 2020; v1 submitted 26 August, 2019; originally announced August 2019.

Comments: 17 pages in Automatica double-column template, 6 figures. Provisionally accepted as Regular Paper in Automatica

MSC Class: 30E05

Fusion of Sensors Data in Automotive Radar Systems: A Spectral Estimation Approach

Authors: Bin Zhu, Augusto Ferrante, Johan Karlsson, Mattia Zorzi

Abstract: To accurately estimate locations and velocities of surrounding targets (cars) is crucial for advanced driver assistance systems based on radar sensors. In this paper we derive methods for fusing data from multiple radar sensors in order to improve the accuracy and robustness of such estimates. First we pose the target estimation problem as a multivariate multidimensional spectral estimation proble… ▽ More To accurately estimate locations and velocities of surrounding targets (cars) is crucial for advanced driver assistance systems based on radar sensors. In this paper we derive methods for fusing data from multiple radar sensors in order to improve the accuracy and robustness of such estimates. First we pose the target estimation problem as a multivariate multidimensional spectral estimation problem. The problem is multivariate since each radar sensor gives rise to a measurement channel. Then we investigate how the use of the cross-spectra affects target estimates. We see that the use of the magnitude of the cross-spectrum significantly improves the accuracy of the target estimates, whereas an attempt to compensate the phase lag of the cross-spectrum only gives marginal improvement. This paper may be viewed as a first step towards applying high-resolution methods that builds on multidimensional multivariate spectral estimation for sensor fusion. △ Less

Submitted 7 August, 2019; originally announced August 2019.

Comments: 6 pages in IEEE conference template; accepted for presentation in CDC 2019

Estimating ensemble flows on a hidden Markov chain

Authors: Isabel Haasler, Axel Ringh, Yongxin Chen, Johan Karlsson

Abstract: We propose a new framework to estimate the evolution of an ensemble of indistinguishable agents on a hidden Markov chain using only aggregate output data. This work can be viewed as an extension of the recent developments in optimal mass transport and Schrödinger bridges to the finite state space hidden Markov chain setting. The flow of the ensemble is estimated by solving a maximum likelihood pro… ▽ More We propose a new framework to estimate the evolution of an ensemble of indistinguishable agents on a hidden Markov chain using only aggregate output data. This work can be viewed as an extension of the recent developments in optimal mass transport and Schrödinger bridges to the finite state space hidden Markov chain setting. The flow of the ensemble is estimated by solving a maximum likelihood problem, which has a convex formulation at the infinite-particle limit, and we develop a fast numerical algorithm for it. We illustrate in two numerical examples how this framework can be used to track the flow of identical and indistinguishable dynamical systems. △ Less

Submitted 28 January, 2020; v1 submitted 22 May, 2019; originally announced May 2019.

Comments: 8 pages, 4 figures

Multi-Marginal Optimal Mass Transport with Partial Information

Authors: Filip Elvander, Isabel Haasler, Andreas Jakobsson, Johan Karlsson

Abstract: During recent decades, there has been a substantial development in optimal mass transport theory and methods. In this work, we consider multi-marginal problems wherein only partial information of each marginal is available, which is a setup common in many inverse problems in, e.g., imaging and spectral estimation. By considering an entropy regularized approximation of the original transport proble… ▽ More During recent decades, there has been a substantial development in optimal mass transport theory and methods. In this work, we consider multi-marginal problems wherein only partial information of each marginal is available, which is a setup common in many inverse problems in, e.g., imaging and spectral estimation. By considering an entropy regularized approximation of the original transport problem, we propose an algorithm corresponding to a block-coordinate ascent of the dual problem, where Newton's algorithm is used to solve the sub-problems. In order to make this computationally tractable for large-scale settings, we utilize the tensor structure that arises in practical problems, allowing for computing projections of the multi-marginal transport plan using only matrix-vector operations of relatively small matrices. As illustrating examples, we apply the resulting method to tracking and barycenter problems in spatial spectral estimation. In particular, we show that the optimal mass transport framework allows for fusing information from different time steps, as well as from different sensor arrays, also when the sensor arrays are not jointly calibrated. Furthermore, we show that by incorporating knowledge of underlying dynamics in tracking scenarios, one may arrive at accurate spectral estimates, as well as faithful reconstructions of spectra corresponding to unobserved time points. △ Less

Submitted 9 May, 2019; originally announced May 2019.

Reinforcement Learning with Probabilistic Guarantees for Autonomous Driving

Authors: Maxime Bouton, Jesper Karlsson, Alireza Nakhaei, Kikuo Fujimura, Mykel J. Kochenderfer, Jana Tumova

Abstract: Designing reliable decision strategies for autonomous urban driving is challenging. Reinforcement learning (RL) has been used to automatically derive suitable behavior in uncertain environments, but it does not provide any guarantee on the performance of the resulting policy. We propose a generic approach to enforce probabilistic guarantees on an RL agent. An exploration strategy is derived prior… ▽ More Designing reliable decision strategies for autonomous urban driving is challenging. Reinforcement learning (RL) has been used to automatically derive suitable behavior in uncertain environments, but it does not provide any guarantee on the performance of the resulting policy. We propose a generic approach to enforce probabilistic guarantees on an RL agent. An exploration strategy is derived prior to training that constrains the agent to choose among actions that satisfy a desired probabilistic specification expressed with linear temporal logic (LTL). Reducing the search space to policies satisfying the LTL formula helps training and simplifies reward design. This paper outlines a case study of an intersection scenario involving multiple traffic participants. The resulting policy outperforms a rule-based heuristic approach in terms of efficiency while exhibiting strong guarantees on safety. △ Less

Submitted 29 May, 2019; v1 submitted 15 April, 2019; originally announced April 2019.

Journal ref: Workshop on Safety Risk and Uncertainty in Reinforcement Learning, Conference on Uncertainty in Artificial Intelligence (UAI), 2018

Automatic Target Recognition Using Discrimination Based on Optimal Transport

Authors: Ali Sadeghian, Deoksu Lim, Johan Karlsson, Jian Li

Abstract: The use of distances based on optimal transportation has recently shown promise for discrimination of power spectra. In particular, spectral estimation methods based on l1 regularization as well as covariance based methods can be shown to be robust with respect to such distances. These transportation distances provide a geometric framework where geodesics corresponds to smooth transition of spectr… ▽ More The use of distances based on optimal transportation has recently shown promise for discrimination of power spectra. In particular, spectral estimation methods based on l1 regularization as well as covariance based methods can be shown to be robust with respect to such distances. These transportation distances provide a geometric framework where geodesics corresponds to smooth transition of spectral mass, and have been useful for tracking. In this paper, we investigate the use of these distances for automatic target recognition. We study the use of the Monge-Kantorovich distance compared to the standard l2 distance for classifying civilian vehicles based on SAR images. We use a version of the Monge-Kantorovich distance that applies also for the case where the spectra may have different total mass, and we formulate the optimization problem as a minimum flow problem that can be computed using efficient algorithms. △ Less

Submitted 6 April, 2019; originally announced April 2019.

Journal ref: 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Adapting The Secretary Hiring Problem for Optimal Hot-Cold Tier Placement under Top-$K$ Workloads

Authors: Ben Blamey, Fredrik Wrede, Johan Karlsson, Andreas Hellander, Salman Toor

Abstract: Top-K queries are an established heuristic in information retrieval. This paper presents an approach for optimal tiered storage allocation under stream processing workloads using this heuristic: those requiring the analysis of only the top-$K$ ranked most relevant, or most interesting, documents from a fixed-length stream, stream window, or batch job. In this workflow, documents are analyzed relev… ▽ More Top-K queries are an established heuristic in information retrieval. This paper presents an approach for optimal tiered storage allocation under stream processing workloads using this heuristic: those requiring the analysis of only the top-$K$ ranked most relevant, or most interesting, documents from a fixed-length stream, stream window, or batch job. In this workflow, documents are analyzed relevance with a user-specified interestingness function, on which they are ranked, the top-$K$ being selected (and hence stored) for further processing. This workflow allows human in the loop systems, including supervised machine learning, to prioritize documents. This scenario bears similarity to the classic Secretary Hiring Problem (SHP), and the expected rate of document writes, and document lifetime, can be modelled as a function of document index. We present parameter-based algorithms for storage tier placement, minimizing document storage and transport costs. We show that optimal parameter values are a function of these costs. It is possible to model application IO behaviour a priori for this class of workloads. When combined with tiered storage, the tractability of the probabilistic model of IO makes it easy to optimize tier allocation, yielding simple analytic solutions. This contrasts with (often complex) existing work on tiered storage optimization, which is either tightly coupled to specific use cases, or requires active monitoring of application IO load (a reactive approach) -- ill-suited to long-running or one-off operations common in the scientific computing domain.We validate our model with a trace-driven simulation of a bio-chemical model exploration, and give worked examples for two cloud storage case studies. △ Less

Submitted 12 March, 2019; v1 submitted 22 January, 2019; originally announced January 2019.

Non-Coherent Sensor Fusion via Entropy Regularized Optimal Mass Transport

Authors: Filip Elvander, Isabel Haasler, Andreas Jakobsson, Johan Karlsson

Abstract: This work presents a method for information fusion in source localization applications. The method utilizes the concept of optimal mass transport in order to construct estimates of the spatial spectrum using a convex barycenter formulation. We introduce an entropy regularization term to the convex objective, which allows for low-complexity iterations of the solution algorithm and thus makes the pr… ▽ More This work presents a method for information fusion in source localization applications. The method utilizes the concept of optimal mass transport in order to construct estimates of the spatial spectrum using a convex barycenter formulation. We introduce an entropy regularization term to the convex objective, which allows for low-complexity iterations of the solution algorithm and thus makes the proposed method applicable also to higher-dimensional problems. We illustrate the proposed method's inherent robustness to misalignment and miscalibration of the sensor arrays using numerical examples of localization in two dimensions. △ Less

Submitted 19 November, 2018; v1 submitted 25 October, 2018; originally announced October 2018.

Data-driven nonsmooth optimization

Authors: Sebastian Banert, Axel Ringh, Jonas Adler, Johan Karlsson, Ozan Öktem

Abstract: In this work, we consider methods for solving large-scale optimization problems with a possibly nonsmooth objective function. The key idea is to first specify a class of optimization algorithms using a generic iterative scheme involving only linear operations and applications of proximal operators. This scheme contains many modern primal-dual first-order solvers like the Douglas-Rachford and hybri… ▽ More In this work, we consider methods for solving large-scale optimization problems with a possibly nonsmooth objective function. The key idea is to first specify a class of optimization algorithms using a generic iterative scheme involving only linear operations and applications of proximal operators. This scheme contains many modern primal-dual first-order solvers like the Douglas-Rachford and hybrid gradient methods as special cases. Moreover, we show convergence to an optimal point for a new method which also belongs to this class. Next, we interpret the generic scheme as a neural network and use unsupervised training to learn the best set of parameters for a specific class of objective functions while imposing a fixed number of iterations. In contrast to other approaches of "learning to optimize", we present an approach which learns parameters only in the set of convergent schemes. As use cases, we consider optimization problems arising in tomographic reconstruction and image deconvolution, and in particular a family of total variation regularization problems. △ Less

Submitted 2 August, 2018; originally announced August 2018.

Comments: 33 pages, 7 figures

MSC Class: 90C25 (Primary) 68T05; 47H05 (Secondary)

Journal ref: SIAM Journal on Optimization, 30(1), 102-131, 2020

Modeling collective behaviors: A moment-based approach

Authors: Silun Zhang, Axel Ringh, Xiaoming Hu, Johan Karlsson

Abstract: In this work we introduce an approach for modeling and analyzing collective behavior of a group of agents using moments. We represent the group of agents via their distribution and derive a method to estimate the dynamics of the moments. We use this to predict the evolution of the distribution of agents by first computing the moment trajectories and then use this to reconstruct the distribution of… ▽ More In this work we introduce an approach for modeling and analyzing collective behavior of a group of agents using moments. We represent the group of agents via their distribution and derive a method to estimate the dynamics of the moments. We use this to predict the evolution of the distribution of agents by first computing the moment trajectories and then use this to reconstruct the distribution of the agents. In the latter an inverse problem is solved in order to reconstruct a nominal distribution and to recover the macro-scale properties of the group of agents. The proposed method is applicable for several types of multi-agent systems, e.g., leader-follower systems. We derive error bounds for the moment trajectories and describe how to take these error bounds into account for computing the moment dynamics. The convergence of the moment dynamics is also analyzed for cases with monomial moments. To illustrate the theory, two numerical examples are given. In the first we consider a multi-agent system with interactions and compare the proposed methods for several types of moments. In the second example we apply the framework to a leader-follower problem for modeling pedestrian crowd dynamics. △ Less

Submitted 29 April, 2020; v1 submitted 8 April, 2018; originally announced April 2018.

Comments: 15 pages, 13 figures

Journal ref: IEEE Transactions on Automatic Control 2020

Lower bounds on the maximum delay margin by analytic interpolation

Authors: Axel Ringh, Johan Karlsson, Anders Lindquist

Abstract: We study the delay margin problem in the context of recent works by T. Qi, J. Zhu, and J. Chen, where a sufficient condition for the maximal delay margin is formulated in terms of an interpolation problem obtained after introducing a rational approximation. Instead we omit the approximation step and solve the same problem directly using techniques from function theory and analytic interpolation. F… ▽ More We study the delay margin problem in the context of recent works by T. Qi, J. Zhu, and J. Chen, where a sufficient condition for the maximal delay margin is formulated in terms of an interpolation problem obtained after introducing a rational approximation. Instead we omit the approximation step and solve the same problem directly using techniques from function theory and analytic interpolation. Furthermore, we introduce a constant shift in the domain of the interpolation problem. In this way we are able to improve on their lower bound for the maximum delay margin. △ Less

Submitted 30 August, 2018; v1 submitted 26 March, 2018; originally announced March 2018.

Comments: 7 pages, minor revision, accepted for 57th IEEE Conference on Decision and Control (CDC 2018)

MSC Class: 47N70; 93B52; 30E05;

State tracking of linear ensembles via optimal mass transport

Authors: Yongxin Chen, Johan Karlsson

Abstract: We consider the problems of tracking an ensemble of indistinguishable agents with linear dynamics based only on output measurements. In this setting, the dynamics of the agents can be modeled by distribution flows in the state space and the measurements correspond to distributions in the output space. In this paper we formulate the corresponding state estimation problem using optimal mass transpor… ▽ More We consider the problems of tracking an ensemble of indistinguishable agents with linear dynamics based only on output measurements. In this setting, the dynamics of the agents can be modeled by distribution flows in the state space and the measurements correspond to distributions in the output space. In this paper we formulate the corresponding state estimation problem using optimal mass transport theory with prior linear dynamics, and the optimal solution gives an estimate of the state trajectories of the ensemble. For general distributions of systems this can be formulated as a convex optimization problem which is computationally feasible with when the number of state dimensions is low. In the case where the marginal distributions are Gaussian, the problem is reformulated as a semidefinite programming and can be efficiently solved for tracking systems with a large number of states. △ Less

Submitted 6 March, 2018; originally announced March 2018.

Comments: 6 pages, 6 figures

MSC Class: 93Exx; 62Mxx; 60Gxx

All-optical control of long-lived nuclear spins in rare-earth doped nanoparticles

Authors: D. Serrano, J. Karlsson, A. Fossati, A. Ferrier, P. Goldner

Abstract: Nanoscale systems offer key capabilities for quantum technologies that include single qubit control and readout, multiple qubit gate operation, extremely sensitive and localized sensing and imaging, as well as the ability to build hybrid quantum systems. To fully exploit these functionalities, multiple degrees of freedom are highly desirable: in this respect, nanoscale systems that coherently coup… ▽ More Nanoscale systems offer key capabilities for quantum technologies that include single qubit control and readout, multiple qubit gate operation, extremely sensitive and localized sensing and imaging, as well as the ability to build hybrid quantum systems. To fully exploit these functionalities, multiple degrees of freedom are highly desirable: in this respect, nanoscale systems that coherently couple to light and possess spins, allow for storage of photonic qubits or light-matter entanglement together with processing capabilities. In addition, all-optical control of spins can be possible for faster gate operations and higher spatial selectivity compared to direct RF excitation. Such systems are therefore of high interest for quantum communications and processing. However, an outstanding challenge is to preserve properties, and especially optical and spin coherence lifetimes, at the nanoscale. Indeed, interactions with surfaces related perturbations strongly increase as sizes decrease, although the smallest objects present the highest flexibility for integration with other systems. Here, we demonstrate optically controlled nuclear spins with long coherence lifetimes (T2) in rare earth doped nanoparticles. We observed spins echoes and measured T2 of 2.9 +/- 0.3 ms at 5 K and under a magnetic field of 9 mT, a value comparable to those obtained in bulk single crystals. Moreover, we achieve, for the first time, spin T2 extension using all-optical spin dynamical decoupling and observe high fidelity between excitation and echo phases. Rare-earth doped nanoparticles are thus the only reported nano-materials in which optically controlled spins with millisecond coherence lifetimes have been observed. These results open the way to providing quantum light-atom-spin interfaces with long storage time within hybrid architectures. △ Less

Submitted 10 November, 2017; originally announced November 2017.

Interpolation and Extrapolation of Toeplitz Matrices via Optimal Mass Transport

Authors: Filip Elvander, Andreas Jakobsson, Johan Karlsson

Abstract: In this work, we propose a novel method for quantifying distances between Toeplitz structured covariance matrices. By exploiting the spectral representation of Toeplitz matrices, the proposed distance measure is defined based on an optimal mass transport problem in the spectral domain. This may then be interpreted in the covariance domain, suggesting a natural way of interpolating and extrapolatin… ▽ More In this work, we propose a novel method for quantifying distances between Toeplitz structured covariance matrices. By exploiting the spectral representation of Toeplitz matrices, the proposed distance measure is defined based on an optimal mass transport problem in the spectral domain. This may then be interpreted in the covariance domain, suggesting a natural way of interpolating and extrapolating Toeplitz matrices, such that the positive semi-definiteness and the Toeplitz structure of these matrices are preserved. The proposed distance measure is also shown to be contractive with respect to both additive and multiplicative noise, and thereby allows for a quantification of the decreased distance between signals when these are corrupted by noise. Finally, we illustrate how this approach can be used for several applications in signal processing. In particular, we consider interpolation and extrapolation of Toeplitz matrices, as well as clustering problems and tracking of slowly varying stochastic processes. △ Less

Submitted 29 May, 2019; v1 submitted 10 November, 2017; originally announced November 2017.

Journal ref: IEEE Transactions on Signal Processing, vol. 66, no. 20, (2018), pp. 5285 - 5298

Learning to solve inverse problems using Wasserstein loss

Authors: Jonas Adler, Axel Ringh, Ozan Öktem, Johan Karlsson

Abstract: We propose using the Wasserstein loss for training in inverse problems. In particular, we consider a learned primal-dual reconstruction scheme for ill-posed inverse problems using the Wasserstein distance as loss function in the learning. This is motivated by miss-alignments in training data, which when using standard mean squared error loss could severely degrade reconstruction quality. We prove… ▽ More We propose using the Wasserstein loss for training in inverse problems. In particular, we consider a learned primal-dual reconstruction scheme for ill-posed inverse problems using the Wasserstein distance as loss function in the learning. This is motivated by miss-alignments in training data, which when using standard mean squared error loss could severely degrade reconstruction quality. We prove that training with the Wasserstein loss gives a reconstruction operator that correctly compensates for miss-alignments in certain cases, whereas training with the mean squared error gives a smeared reconstruction. Moreover, we demonstrate these effects by training a reconstruction algorithm using both mean squared error and optimal transport loss for a problem in computerized tomography. △ Less

Submitted 30 October, 2017; originally announced October 2017.

Comments: 11 pages, 3 figures

Multidimensional Rational Covariance Extension with Approximate Covariance Matching

Authors: Axel Ringh, Johan Karlsson, Anders Lindquist

Abstract: In our companion paper "Multidimensional rational covariance extension with applications to spectral estimation and image compression" we discussed the multidimensional rational covariance extension problem (RCEP), which has important applications in image processing, and spectral estimation in radar, sonar, and medical imaging. This is an inverse problem where a power spectrum with a rational abs… ▽ More In our companion paper "Multidimensional rational covariance extension with applications to spectral estimation and image compression" we discussed the multidimensional rational covariance extension problem (RCEP), which has important applications in image processing, and spectral estimation in radar, sonar, and medical imaging. This is an inverse problem where a power spectrum with a rational absolutely continuous part is reconstructed from a finite set of moments. However, in most applications these moments are determined from observed data and are therefore only approximate, and RCEP may not have a solution. In this paper we extend the results to handle approximate covariance matching. We consider two problems, one with a soft constraint and the other one with a hard constraint, and show that they are connected via a homeomorphism. We also demonstrate that the problems are well-posed and illustrate the theory by examples in spectral estimation and texture generation. △ Less

Submitted 6 February, 2018; v1 submitted 26 April, 2017; originally announced April 2017.

Comments: 31 pages (single column). Revision: minor corrections

MSC Class: 42A70; 30E05; 49N45; 90C25; 62M15; 74E25

Journal ref: SIAM Journal on Control and Optimization, 56 (2), 913-944, 2018

Generalized Sinkhorn iterations for regularizing inverse problems using optimal mass transport

Authors: Johan Karlsson, Axel Ringh

Abstract: The optimal mass transport problem gives a geometric framework for optimal allocation, and has recently gained significant interest in application areas such as signal processing, image processing, and computer vision. Even though it can be formulated as a linear programming problem, it is in many cases intractable for large problems due to the vast number of variables. A recent development to add… ▽ More The optimal mass transport problem gives a geometric framework for optimal allocation, and has recently gained significant interest in application areas such as signal processing, image processing, and computer vision. Even though it can be formulated as a linear programming problem, it is in many cases intractable for large problems due to the vast number of variables. A recent development to address this builds on an approximation with an entropic barrier term and solves the resulting optimization problem using Sinkhorn iterations. In this work we extend this methodology to a class of inverse problems. In particular we show that Sinkhorn-type iterations can be used to compute the proximal operator of the transport problem for large problems. A splitting framework is then used to solve inverse problems where the optimal mass transport cost is used for incorporating a priori information. We illustrate the method on problems in computerized tomography. In particular we consider a limited-angle computerized tomography problem, where a priori information is used to compensate for missing measurements. △ Less

Submitted 28 August, 2017; v1 submitted 7 December, 2016; originally announced December 2016.

Comments: 25 pages (single column)

MSC Class: 49N45; 90C25; 94A08

Journal ref: SIAM Journal on Imaging Sciences, 10(4), 1935-1962, 2017

Sylvester-based preconditioning for the waveguide eigenvalue problem

Authors: Emil Ringh, Giampaolo Mele, Johan Karlsson, Elias Jarlebring

Abstract: We consider a nonlinear eigenvalue problem (NEP) arising from absorbing boundary conditions in the study of a partial differential equation (PDE) describing a waveguide. We propose a new computational approach for this large scale NEP based on residual inverse iteration (Resinv) with preconditioned iterative solves. Similar to many preconditioned iterative methods for discretized PDEs, this approa… ▽ More We consider a nonlinear eigenvalue problem (NEP) arising from absorbing boundary conditions in the study of a partial differential equation (PDE) describing a waveguide. We propose a new computational approach for this large scale NEP based on residual inverse iteration (Resinv) with preconditioned iterative solves. Similar to many preconditioned iterative methods for discretized PDEs, this approach requires the construction of an accurate and efficient preconditioner. For the waveguide eigenvalue problem, the associated linear system can be formulated as a generalized Sylvester equation. The equation is approximated by a low-rank correction of a Sylvester equation, which we use as a preconditioner. The action of the preconditioner is efficiently computed using the matrix equation version of the Sherman-Morrison-Woodbury (SMW) formula. We show how the preconditioner can be integrated into Resinv. The results are illustrated by applying the method to large-scale problems. △ Less

Submitted 21 October, 2016; originally announced October 2016.

MSC Class: 35P30; 65F08; 65F15; 65F30

High resolution transient and permanent spectral hole burning in Ce$^{3+}$:Y$_2$SiO$_5$ at liquid helium temperatures

Authors: Jenny Karlsson, Adam N. Nilsson, Diana Serrano, Andreas Walther, Lars Rippe, Stefan Kröll, Philippe Goldner, Alban Ferrier

Abstract: We perform hole burning with a low drift stabilized laser within the zero phonon line of the 4f-5d transition in Ce$^{3+}$:Y$_2$SiO$_5$ at 2K. The narrowest spectral holes appear for small applied magnetic fields and are $6\pm4$ MHz wide (FWHM). This puts an upper bound on the homogeneous linewidth of the transition to $3\pm2$ MHz, which is close to lifetime limited. The spin level relaxation time… ▽ More We perform hole burning with a low drift stabilized laser within the zero phonon line of the 4f-5d transition in Ce$^{3+}$:Y$_2$SiO$_5$ at 2K. The narrowest spectral holes appear for small applied magnetic fields and are $6\pm4$ MHz wide (FWHM). This puts an upper bound on the homogeneous linewidth of the transition to $3\pm2$ MHz, which is close to lifetime limited. The spin level relaxation time is measured to $72\pm21$ ms with a magnetic field of 10 mT. A slow permanent hole burning mechanism is observed. If the excitation frequency is not changed the fluorescence intensity is reduced by more than 50$\%$ after a couple of minutes of continuous excitation. The spectral hole created by the permanent hole burning has a width in the tens of MHz range, which indicates that a trap** mechanism occurs via the 5d-state. △ Less

Submitted 8 April, 2016; originally announced April 2016.

Journal ref: Phys. Rev. B 93, 224304 (2016)

Robust Optimal Power Distribution for Hyperthermia Cancer Treatment

Authors: Nafiseh Shariati, Dave Zachariah, Johan Karlsson, Mats Bengtsson

Abstract: We consider an optimization problem for spatial power distribution generated by an array of transmitting elements. Using ultrasound hyperthermia cancer treatment as a motivating example, the signal design problem consists of optimizing the power distribution across the tumor and healthy tissue regions, respectively. The models used in the optimization problem are, however, invariably subject to er… ▽ More We consider an optimization problem for spatial power distribution generated by an array of transmitting elements. Using ultrasound hyperthermia cancer treatment as a motivating example, the signal design problem consists of optimizing the power distribution across the tumor and healthy tissue regions, respectively. The models used in the optimization problem are, however, invariably subject to errors. deposition as well as inefficient treatment. To combat such unknown model errors, we formulate a robust signal design framework that can take the uncertainty into account using a worst-case approach. This leads to a semi-infinite programming (SIP) robust design problem which we reformulate as a tractable convex problem, potentially has a wider range of applications. △ Less

Submitted 18 October, 2015; originally announced October 2015.

Comments: 7 pages, 4 figures, 1 table

The role of the time-arrow in mean-square estimation of stochastic processes

Authors: Yongxin Chen, Johan Karlsson, Tryphon T. Georgiou

Abstract: The purpose of this paper is to explain a certain dichotomy between the information that the past and future values of a multivariate stochastic process carry about the present. More specifically, vector-valued, second-order stochastic processes may be deterministic in one time-direction and not the other. This phenomenon, which is absent in scalar-valued processes, is deeply rooted in the geometr… ▽ More The purpose of this paper is to explain a certain dichotomy between the information that the past and future values of a multivariate stochastic process carry about the present. More specifically, vector-valued, second-order stochastic processes may be deterministic in one time-direction and not the other. This phenomenon, which is absent in scalar-valued processes, is deeply rooted in the geometry of the shift-operator. The exposition and the examples we discuss are based on the work of Douglas, Shapiro and Shields on cyclic vectors of the backward shift and relate to classical ideas going back to Wiener and Kolmogorov. We focus on rank-one stochastic processes for which we present a characterization of all regular processes that are deterministic in the reverse time-direction. The paper builds on examples and the goal is to provide pertinent insights to a control engineering audience. △ Less

Submitted 29 July, 2015; originally announced July 2015.

Comments: 6 pages