Showing 1–29 of 29 results for author: Thunberg, J

Channel Orthogonalization with Reconfigurable Surfaces: General Models, Theoretical Limits, and Effective Configuration

Authors: Juan Vidal Alegría, Johan Thunberg, Ove Edfors

Abstract: We envision a future in which multi-antenna technology effectively exploits the spatial domain as a set of non-interfering orthogonal resources, allowing for flexible resource allocation and efficient modulation/demodulation. Reconfigurable intelligent surface (RIS) has emerged as a promising technology which allows sha** the propagation environment for improved performance. This paper studies t… ▽ More We envision a future in which multi-antenna technology effectively exploits the spatial domain as a set of non-interfering orthogonal resources, allowing for flexible resource allocation and efficient modulation/demodulation. Reconfigurable intelligent surface (RIS) has emerged as a promising technology which allows sha** the propagation environment for improved performance. This paper studies the ability of three extended types of reconfigurable surface (RS), including the recently proposed beyond diagonal RIS (BD-RIS), to achieve perfectly orthogonal channels in a general multi-user multiple-input multiple-output (MU-MIMO) scenario. We propose practical implementations for the three types of RS consisting of passive components, and obtain the corresponding restrictions on their reconfigurability. We then use these restrictions to derive closed-form conditions for achieving arbitrary (orthogonal) channels. We also study the problem of optimal orthogonal channel selection for achieving high channel gain without active amplification at the RS, and we propose some methods with satisfying performance. Finally, we provide efficient channel estimation and RS configuration techniques such that all the computation, including the channel selection, may be performed at the base station (BS). The numerical results showcase the potential and practicality of RS channel orthogonalization, thus taking a step towards orthogonal spatial domain multiplexing (OSDM). △ Less

Submitted 22 March, 2024; originally announced March 2024.

Comments: 13 pages, 4 figures. This work has been submitted to the IEEE for possible publication, copyright information may be affected upon publication

Hybrid Precoder Design for Angle-of-Departure Estimation with Limited-Resolution Phase Shifters

Authors: Hui** Huang, Musa Furkan Keskin, Henk Wymeersch, Xuesong Cai, Linlong Wu, Johan Thunberg, Fredrik Tufvesson

Abstract: Hybrid analog-digital beamforming stands out as a key enabler for future communication systems with a massive number of antennas. In this paper, we investigate the hybrid precoder design problem for angle-of-departure (AoD) estimation, where we take into account the practical constraint on the limited resolution of phase shifters. Our goal is to design a radio-frequency (RF) precoder and a base-ba… ▽ More Hybrid analog-digital beamforming stands out as a key enabler for future communication systems with a massive number of antennas. In this paper, we investigate the hybrid precoder design problem for angle-of-departure (AoD) estimation, where we take into account the practical constraint on the limited resolution of phase shifters. Our goal is to design a radio-frequency (RF) precoder and a base-band (BB) precoder to estimate AoD of the user with a high accuracy. To this end, we propose a two-step strategy where we first obtain the fully digital precoder that minimizes the angle error bound, and then the resulting digital precoder is decomposed into an RF precoder and a BB precoder, based on the alternating optimization and the alternating direction method of multipliers. Besides, we derive the quantization error upper bound and analyse the convergence behavior of the proposed algorithm. Numerical results demonstrate the superior performance of the proposed method over state-of-the-art baselines. △ Less

Submitted 26 December, 2023; originally announced December 2023.

Non-Negative Spherical Relaxations for Universe-Free Multi-Matching and Clustering

Authors: Johan Thunberg, Florian Bernard

Abstract: We propose a novel non-negative spherical relaxation for optimization problems over binary matrices with injectivity constraints, which in particular has applications in multi-matching and clustering. We relax respective binary matrix constraints to the (high-dimensional) non-negative sphere. To optimize our relaxed problem, we use a conditional power iteration method to iteratively improve the ob… ▽ More We propose a novel non-negative spherical relaxation for optimization problems over binary matrices with injectivity constraints, which in particular has applications in multi-matching and clustering. We relax respective binary matrix constraints to the (high-dimensional) non-negative sphere. To optimize our relaxed problem, we use a conditional power iteration method to iteratively improve the objective function, while at same time swee** over a continuous scalar parameter that is (indirectly) related to the universe size (or number of clusters). Opposed to existing procedures that require to fix the integer universe size before optimization, our method automatically adjusts the analogous continuous parameter. Furthermore, while our approach shares similarities with spectral multi-matching and spectral clustering, our formulation has the strong advantage that we do not rely on additional post-processing procedures to obtain binary results. Our method shows compelling results in various multi-matching and clustering settings, even when compared to methods that use the ground truth universe size (or number of clusters). △ Less

Submitted 20 October, 2023; originally announced October 2023.

Comments: Published at Scandinavian Conference on Image Analysis (SCIA) 2023

Sparse Quadratic Optimisation over the Stiefel Manifold with Application to Permutation Synchronisation

Authors: Florian Bernard, Daniel Cremers, Johan Thunberg

Abstract: We address the non-convex optimisation problem of finding a sparse matrix on the Stiefel manifold (matrices with mutually orthogonal columns of unit length) that maximises (or minimises) a quadratic objective function. Optimisation problems on the Stiefel manifold occur for example in spectral relaxations of various combinatorial problems, such as graph matching, clustering, or permutation synchro… ▽ More We address the non-convex optimisation problem of finding a sparse matrix on the Stiefel manifold (matrices with mutually orthogonal columns of unit length) that maximises (or minimises) a quadratic objective function. Optimisation problems on the Stiefel manifold occur for example in spectral relaxations of various combinatorial problems, such as graph matching, clustering, or permutation synchronisation. Although sparsity is a desirable property in such settings, it is mostly neglected in spectral formulations since existing solvers, e.g. based on eigenvalue decomposition, are unable to account for sparsity while at the same time maintaining global optimality guarantees. We fill this gap and propose a simple yet effective sparsity-promoting modification of the Orthogonal Iteration algorithm for finding the dominant eigenspace of a matrix. By doing so, we can guarantee that our method finds a Stiefel matrix that is globally optimal with respect to the quadratic objective function, while in addition being sparse. As a motivating application we consider the task of permutation synchronisation, which can be understood as a constrained clustering problem that has particular relevance for matching multiple images or 3D shapes in computer vision, computer graphics, and beyond. We demonstrate that the proposed approach outperforms previous methods in this domain. △ Less

Submitted 30 September, 2021; originally announced October 2021.

Comments: To appear at NeurIPS 2021

Isometric Multi-Shape Matching

Authors: Maolin Gao, Zorah Lähner, Johan Thunberg, Daniel Cremers, Florian Bernard

Abstract: Finding correspondences between shapes is a fundamental problem in computer vision and graphics, which is relevant for many applications, including 3D reconstruction, object tracking, and style transfer. The vast majority of correspondence methods aim to find a solution between pairs of shapes, even if multiple instances of the same class are available. While isometries are often studied in shape… ▽ More Finding correspondences between shapes is a fundamental problem in computer vision and graphics, which is relevant for many applications, including 3D reconstruction, object tracking, and style transfer. The vast majority of correspondence methods aim to find a solution between pairs of shapes, even if multiple instances of the same class are available. While isometries are often studied in shape correspondence problems, they have not been considered explicitly in the multi-matching setting. This paper closes this gap by proposing a novel optimisation formulation for isometric multi-shape matching. We present a suitable optimisation algorithm for solving our formulation and provide a convergence and complexity analysis. Our algorithm obtains multi-matchings that are by construction provably cycle-consistent. We demonstrate the superior performance of our method on various datasets and set the new state-of-the-art in isometric multi-shape matching. △ Less

Submitted 3 April, 2024; v1 submitted 4 December, 2020; originally announced December 2020.

Higher-order Projected Power Iterations for Scalable Multi-Matching

Authors: Florian Bernard, Johan Thunberg, Paul Swoboda, Christian Theobalt

Abstract: The matching of multiple objects (e.g. shapes or images) is a fundamental problem in vision and graphics. In order to robustly handle ambiguities, noise and repetitive patterns in challenging real-world settings, it is essential to take geometric consistency between points into account. Computationally, the multi-matching problem is difficult. It can be phrased as simultaneously solving multiple (… ▽ More The matching of multiple objects (e.g. shapes or images) is a fundamental problem in vision and graphics. In order to robustly handle ambiguities, noise and repetitive patterns in challenging real-world settings, it is essential to take geometric consistency between points into account. Computationally, the multi-matching problem is difficult. It can be phrased as simultaneously solving multiple (NP-hard) quadratic assignment problems (QAPs) that are coupled via cycle-consistency constraints. The main limitations of existing multi-matching methods are that they either ignore geometric consistency and thus have limited robustness, or they are restricted to small-scale problems due to their (relatively) high computational cost. We address these shortcomings by introducing a Higher-order Projected Power Iteration method, which is (i) efficient and scales to tens of thousands of points, (ii) straightforward to implement, (iii) able to incorporate geometric consistency, (iv) guarantees cycle-consistent multi-matchings, and (iv) comes with theoretical convergence guarantees. Experimentally we show that our approach is superior to existing methods. △ Less

Submitted 14 March, 2019; v1 submitted 26 November, 2018; originally announced November 2018.

A state-space approach to sparse dynamic network reconstruction

Authors: Zuogong Yue, Johan Thunberg, Lennart Ljung, Jorge Goncalves

Abstract: Dynamic network reconstruction has been shown to be challenging due to the requirements on sparse network structures and network identifiability. The direct parametric method (e.g., using ARX models) requires a large amount of parameters in model selection. Amongst the parametric models, only a restricted class can easily be used to address network sparsity without rendering the optimization probl… ▽ More Dynamic network reconstruction has been shown to be challenging due to the requirements on sparse network structures and network identifiability. The direct parametric method (e.g., using ARX models) requires a large amount of parameters in model selection. Amongst the parametric models, only a restricted class can easily be used to address network sparsity without rendering the optimization problem intractable. To overcome these problems, this paper presents a state-space-based method, which significantly reduces the number of unknown parameters in model selection. Furthermore, we avoid various difficulties arising in gradient computation by using the Expectation Minimization (EM) algorithm instead. To enhance network sparsity, the prior distribution is constructed by using the Sparse Bayesian Learning (SBL) approach in the M-step. To solve the SBL problem, another EM algorithm is embedded, where we impose conditions on network identifiability in each iteration. In a sum, this paper provides a solution to reconstruct dynamic networks that avoids the difficulties inherent to gradient computation and simplifies the model selection. △ Less

Submitted 21 November, 2018; originally announced November 2018.

Comments: 7 pages; preprint for CDC 2018 review

High-dimensional Kuramoto models on Stiefel manifolds synchronize complex networks almost globally

Authors: Johan Markdahl, Johan Thunberg, Jorge Goncalves

Abstract: The Kuramoto model of coupled phase oscillators is often used to describe synchronization phenomena in nature. Some applications, e.g., quantum synchronization and rigid-body attitude synchronization, involve high-dimensional Kuramoto models where each oscillator lives on the n-sphere or SO(n). These manifolds are special cases of the compact, real Stiefel manifold St(p,n). Using tools from optimi… ▽ More The Kuramoto model of coupled phase oscillators is often used to describe synchronization phenomena in nature. Some applications, e.g., quantum synchronization and rigid-body attitude synchronization, involve high-dimensional Kuramoto models where each oscillator lives on the n-sphere or SO(n). These manifolds are special cases of the compact, real Stiefel manifold St(p,n). Using tools from optimization and control theory, we prove that the generalized Kuramoto model on St(p,n) converges to a synchronized state for any connected graph and from almost all initial conditions provided (p,n) satisfies p<=2n/3-1 and all oscillator frequencies are equal. This result could not have been predicted based on knowledge of the Kuramoto model in complex networks over the circle. In that case, almost global synchronization is graph dependent; it applies if the network is acyclic or sufficiently dense. This paper hence identifies a property that distinguishes many high-dimensional generalizations of the Kuramoto models from the original model. △ Less

Submitted 13 March, 2022; v1 submitted 26 July, 2018; originally announced July 2018.

A Lifting method for analyzing distributed synchronization on the unit sphere

Authors: Johan Thunberg, Johan Markdahl, Florian Bernard, Jorge Goncalves

Abstract: This paper introduces a new lifting method for analyzing convergence of continuous-time distributed synchronization/consensus systems on the unit sphere. Points on the d-dimensional unit sphere are lifted to the (d+1)-dimensional Euclidean space. The consensus protocol on the unit sphere is the classical one, where agents move toward weighted averages of their neighbors in their respective tangent… ▽ More This paper introduces a new lifting method for analyzing convergence of continuous-time distributed synchronization/consensus systems on the unit sphere. Points on the d-dimensional unit sphere are lifted to the (d+1)-dimensional Euclidean space. The consensus protocol on the unit sphere is the classical one, where agents move toward weighted averages of their neighbors in their respective tangent planes. Only local and relative state information is used. The directed interaction graph topologies are allowed to switch as a function of time. The dynamics of the lifted variables are governed by a nonlinear consensus protocol for which the weights contain ratios of the norms of state variables. We generalize previous convergence results for hemispheres. For a large class of consensus protocols defined for switching uniformly quasi-strongly connected time-varying graphs, we show that the consensus manifold is uniformly asymptotically stable relative to closed balls contained in a hemisphere. Compared to earlier projection based approaches used in this context such as the gnomonic projection, which is defined for hemispheres only, the lifting method applies globally. With that, the hope is that this method can be useful for future investigations on global convergence. △ Less

Submitted 7 June, 2018; v1 submitted 7 May, 2018; originally announced May 2018.

Comments: 11 pages, 4 figures

Synchronisation of Partial Multi-Matchings via Non-negative Factorisations

Authors: Florian Bernard, Johan Thunberg, Jorge Goncalves, Christian Theobalt

Abstract: In this work we study permutation synchronisation for the challenging case of partial permutations, which plays an important role for the problem of matching multiple objects (e.g. images or shapes). The term synchronisation refers to the property that the set of pairwise matchings is cycle-consistent, i.e. in the full matching case all compositions of pairwise matchings over cycles must be equal… ▽ More In this work we study permutation synchronisation for the challenging case of partial permutations, which plays an important role for the problem of matching multiple objects (e.g. images or shapes). The term synchronisation refers to the property that the set of pairwise matchings is cycle-consistent, i.e. in the full matching case all compositions of pairwise matchings over cycles must be equal to the identity. Motivated by clustering and matrix factorisation perspectives of cycle-consistency, we derive an algorithm to tackle the permutation synchronisation problem based on non-negative factorisations. In order to deal with the inherent non-convexity of the permutation synchronisation problem, we use an initialisation procedure based on a novel rotation scheme applied to the solution of the spectral relaxation. Moreover, this rotation scheme facilitates a convenient Euclidean projection to obtain a binary solution after solving our relaxed problem. In contrast to state-of-the-art methods, our approach is guaranteed to produce cycle-consistent results. We experimentally demonstrate the efficacy of our method and show that it achieves better results compared to existing methods. △ Less

Submitted 25 March, 2019; v1 submitted 16 March, 2018; originally announced March 2018.

Towards Almost Global Synchronization on the Stiefel Manifold

Authors: Johan Markdahl, Johan Thunberg, Jorge Goncalves

Abstract: A graph $\mathcal{G}$ is referred to as $\mathsf{S}^1$-synchronizing if, roughly speaking, the Kuramoto-like model whose interaction topology is given by $\mathcal{G}$ synchronizes almost globally. The Kuramoto model evolves on the unit circle, \ie the $1$-sphere $\mathsf{S}^1$. This paper concerns generalizations of the Kuramoto-like model and the concept of synchronizing graphs on the Stiefel ma… ▽ More A graph $\mathcal{G}$ is referred to as $\mathsf{S}^1$-synchronizing if, roughly speaking, the Kuramoto-like model whose interaction topology is given by $\mathcal{G}$ synchronizes almost globally. The Kuramoto model evolves on the unit circle, \ie the $1$-sphere $\mathsf{S}^1$. This paper concerns generalizations of the Kuramoto-like model and the concept of synchronizing graphs on the Stiefel manifold $\mathsf{St}(p,n)$. Previous work on state-space oscillators have largely been influenced by results and techniques that pertain to the $\mathsf{S}^1$-case. It has recently been shown that all connected graphs are $\mathsf{S}^n$-synchronizing for all $n\geq2$. The previous point of departure may thus have been overly conservative. The $n$-sphere is a special case of the Stiefel manifold, namely $\mathsf{St}(1,n+1)$. As such, it is natural to ask for the extent to which the results on $\mathsf{S}^{n}$ can be extended to the Stiefel manifold. This paper shows that all connected graphs are $\mathsf{St}(p,n)$-synchronizing provided the pair $(p,n)$ satisfies $p\leq \tfrac{2n}{3}-1$. △ Less

Submitted 24 July, 2018; v1 submitted 14 March, 2018; originally announced March 2018.

Experimental design trade-offs for gene regulatory network inference: an in silico study of the yeast Saccharomyces cerevisiae cell cycle

Authors: Johan Markdahl, Nicolo Colombo, Johan Thunberg, Jorge Goncalves

Abstract: Time-series of high throughput gene sequencing data intended for gene regulatory network (GRN) inference are often short due to the high costs of sampling cell systems. Moreover, experimentalists lack a set of quantitative guidelines that prescribe the minimal number of samples required to infer a reliable GRN model. We study the temporal resolution of data vs quality of GRN inference in order to… ▽ More Time-series of high throughput gene sequencing data intended for gene regulatory network (GRN) inference are often short due to the high costs of sampling cell systems. Moreover, experimentalists lack a set of quantitative guidelines that prescribe the minimal number of samples required to infer a reliable GRN model. We study the temporal resolution of data vs quality of GRN inference in order to ultimately overcome this deficit. The evolution of a Markovian jump process model for the Ras/cAMP/PKA pathway of proteins and metabolites in the G1 phase of the Saccharomyces cerevisiae cell cycle is sampled at a number of different rates. For each time-series we infer a linear regression model of the GRN using the LASSO method. The inferred network topology is evaluated in terms of the area under the precision-recall curve AUPR. By plotting the AUPR against the number of samples, we show that the trade-off has a, roughly speaking, sigmoid shape. An optimal number of samples corresponds to values on the ridge of the sigmoid. △ Less

Submitted 14 December, 2017; originally announced December 2017.

Dynamic controllers for column synchronization of rotation matrices: a QR-factorization approach

Authors: Johan Thunberg, Johan Markdahl, Jorge Goncalves

Abstract: In the multi-agent systems setting, this paper addresses continuous-time distributed synchronization of columns of rotation matrices. More precisely, k specific columns shall be synchronized and only the corresponding k columns of the relative rotations between the agents are assumed to be available for the control design. When one specific column is considered, the problem is equivalent to synchr… ▽ More In the multi-agent systems setting, this paper addresses continuous-time distributed synchronization of columns of rotation matrices. More precisely, k specific columns shall be synchronized and only the corresponding k columns of the relative rotations between the agents are assumed to be available for the control design. When one specific column is considered, the problem is equivalent to synchronization on the (d-1)-dimensional unit sphere and when all the columns are considered, the problem is equivalent to synchronization on SO(d). We design dynamic control laws for these synchronization problems. The control laws are based on the introduction of auxiliary variables in combination with a QR-factorization approach. The benefit of this QR-factorization approach is that we can decouple the dynamics for the k columns from the remaining d-k ones. Under the control scheme, the closed loop system achieves almost global convergence to synchronization for quasi-strong interaction graph topologies. △ Less

Submitted 8 January, 2018; v1 submitted 11 August, 2017; originally announced August 2017.

Comments: 10 pages, 2 figures

Finite-time attitude synchronization with distributed discontinuous protocols

Authors: Jieqiang Wei, Silun Zhang, Antonio Adaldo, Johan Thunberg, Xiaoming Hu, Karl H. Johansson

Abstract: The finite-time attitude synchronization problem is considered in this paper, where the rotation of each rigid body is expressed using the axis-angle representation. Two discontinuous and distributed controllers using the vectorized signum function are proposed, which guarantee almost global and local convergence, respectively. Filippov solutions and non-smooth analysis techniques are adopted to h… ▽ More The finite-time attitude synchronization problem is considered in this paper, where the rotation of each rigid body is expressed using the axis-angle representation. Two discontinuous and distributed controllers using the vectorized signum function are proposed, which guarantee almost global and local convergence, respectively. Filippov solutions and non-smooth analysis techniques are adopted to handle the discontinuities. Sufficient conditions are provided to guarantee finite-time convergence and boundedness of the solutions. Simulation examples are provided to verify the performances of the control protocols designed in this paper. △ Less

Submitted 8 May, 2017; originally announced May 2017.

Comments: arXiv admin note: text overlap with arXiv:1704.03190

Distributed methods for synchronization of orthogonal matrices over graphs

Authors: Johan Thunberg, Florian Bernard, Jorge Goncalves

Abstract: This paper addresses the problem of synchronizing orthogonal matrices over directed graphs. For synchronized transformations (or matrices), composite transformations over loops equal the identity. We formulate the synchronization problem as a least-squares optimization problem with nonlinear constraints. The synchronization problem appears as one of the key components in applications ranging from… ▽ More This paper addresses the problem of synchronizing orthogonal matrices over directed graphs. For synchronized transformations (or matrices), composite transformations over loops equal the identity. We formulate the synchronization problem as a least-squares optimization problem with nonlinear constraints. The synchronization problem appears as one of the key components in applications ranging from 3D-localization to image registration. The main contributions of this work can be summarized as the introduction of two novel algorithms; one for symmetric graphs and one for graphs that are possibly asymmetric. Under general conditions, the former has guaranteed convergence to the solution of a spectral relaxation to the synchronization problem. The latter is stable for small step sizes when the graph is quasi-strongly connected. The proposed methods are verified in numerical simulations. △ Less

Submitted 7 April, 2017; v1 submitted 25 January, 2017; originally announced January 2017.

Comments: 18 pages, 2 figures

Dynamic Network Reconstruction from Heterogeneous Datasets

Authors: Zuogong Yue, Johan Thunberg, Wei Pan, Lennart Ljung, Jorge Goncalves

Abstract: Performing multiple experiments is common when learning internal mechanisms of complex systems. These experiments can include perturbations to parameters or external disturbances. A challenging problem is to efficiently incorporate all collected data simultaneously to infer the underlying dynamic network. This paper addresses the reconstruction of dynamic networks from heterogeneous datasets under… ▽ More Performing multiple experiments is common when learning internal mechanisms of complex systems. These experiments can include perturbations to parameters or external disturbances. A challenging problem is to efficiently incorporate all collected data simultaneously to infer the underlying dynamic network. This paper addresses the reconstruction of dynamic networks from heterogeneous datasets under the assumption that underlying networks share the same Boolean structure across all experiments. Parametric models for dynamical structure functions are derived to describe causal interactions between measured variables. Multiple datasets are integrated into one regression problem with additional demands of group sparsity to assure network sparsity and structure consistency. To acquire structured group sparsity, we propose a sampling-based method, together with extended versions of l1 methods and sparse Bayesian learning. The performance of the proposed methods is benchmarked in numerical simulation. In summary, this paper presents efficient methods on network reconstruction from multiple experiments, and reveals practical experience that could guide applications. △ Less

Submitted 24 August, 2020; v1 submitted 6 December, 2016; originally announced December 2016.

Comments: 19 pages, 7 pages of appendices, supplementary version of the Automatica submission

A Combinatorial Solution to Non-Rigid 3D Shape-to-Image Matching

Authors: Florian Bernard, Frank R. Schmidt, Johan Thunberg, Daniel Cremers

Abstract: We propose a combinatorial solution for the problem of non-rigidly matching a 3D shape to 3D image data. To this end, we model the shape as a triangular mesh and allow each triangle of this mesh to be rigidly transformed to achieve a suitable matching to the image. By penalising the distance and the relative rotation between neighbouring triangles our matching compromises between image and shape i… ▽ More We propose a combinatorial solution for the problem of non-rigidly matching a 3D shape to 3D image data. To this end, we model the shape as a triangular mesh and allow each triangle of this mesh to be rigidly transformed to achieve a suitable matching to the image. By penalising the distance and the relative rotation between neighbouring triangles our matching compromises between image and shape information. In this paper, we resolve two major challenges: Firstly, we address the resulting large and NP-hard combinatorial problem with a suitable graph-theoretic approach. Secondly, we propose an efficient discretisation of the unbounded 6-dimensional Lie group SE(3). To our knowledge this is the first combinatorial formulation for non-rigid 3D shape-to-image matching. In contrast to existing local (gradient descent) optimisation methods, we obtain solutions that do not require a good initialisation and that are within a bound of the optimal solution. We evaluate the proposed method on the two problems of non-rigid 3D shape-to-shape and non-rigid 3D shape-to-image registration and demonstrate that it provides promising results. △ Less

Submitted 18 May, 2017; v1 submitted 16 November, 2016; originally announced November 2016.

Comments: 10 pages, 7 figures

Journal ref: CVPR 2017

Almost global consensus on the n-sphere

Authors: Johan Markdahl, Johan Thunberg, Jorge Goncalves

Abstract: This paper establishes novel results regarding the global convergence properties of a large class of consensus protocols for multi-agent systems that evolve in continuous time on the n-dimensional unit sphere or n-sphere. For any connected, undirected graph and all n in N\{1}, each protocol in said class is shown to yield almost global consensus. The feedback laws are negative gradients of Lyapuno… ▽ More This paper establishes novel results regarding the global convergence properties of a large class of consensus protocols for multi-agent systems that evolve in continuous time on the n-dimensional unit sphere or n-sphere. For any connected, undirected graph and all n in N\{1}, each protocol in said class is shown to yield almost global consensus. The feedback laws are negative gradients of Lyapunov functions and one instance generates the canonical intrinsic gradient descent protocol. This convergence result sheds new light on the general problem of consensus on Riemannian manifolds; the n-sphere for n in N\{1} differs from the circle and SO(3) where the corresponding protocols fail to generate almost global consensus. Moreover, we derive a novel consensus protocol on SO(3) by combining two almost globally convergent protocols on the n-sphere for n in {1,2}. Theoretical and simulation results suggest that the combined protocol yields almost global consensus on SO(3). △ Less

Submitted 12 September, 2017; v1 submitted 15 September, 2016; originally announced September 2016.

Toward a closed-loop subcutaneous delivery of L-DOPA

Authors: Marouen Ben Guebila, Johan Thunberg

Abstract: L-DOPA has been the gold standard treatment for Parkinson's disease since 50 years. Being the direct biochemical precursor of dopamine, L-DOPA is effectively converted in the brain, but two major phenomena reduce its therapeutic action: i) competition with amino acids in the gut wall and in the blood brain barrier and ii) its fast kinetics (absorption, distribution, metabolism, and elimination). C… ▽ More L-DOPA has been the gold standard treatment for Parkinson's disease since 50 years. Being the direct biochemical precursor of dopamine, L-DOPA is effectively converted in the brain, but two major phenomena reduce its therapeutic action: i) competition with amino acids in the gut wall and in the blood brain barrier and ii) its fast kinetics (absorption, distribution, metabolism, and elimination). Continuous administration of L-DOPA, such as jejunal pumps, have addressed the issue of fast absorption. Considering a subcutaneous delivery of L-DOPA allows to bypass the gastrointestinal tract and avoid competition with dietary amino acids. Remains the competition at the blood barrier between amino acids and L-DOPA, which we address by proposing a closed-loop controlled, continuous subcutaneous delivery pump. In the proof-of-concept format, the delivery strategy evaluated on comprehensive model of L-DOPA kinetics, holds the promise of improving the treatment of late-stage Parkinson's disease patients. △ Less

Submitted 24 August, 2016; originally announced August 2016.

Identification of Sparse Continuous-Time Linear Systems with Low Sampling Rate: Optimization Approaches

Authors: Zuogong Yue, Johan Thunberg, Lennart Ljung, Jorge Goncalves

Abstract: This paper addresses identification of sparse linear and noise-driven continuous-time state-space systems, i.e., the right-hand sides in the dynamical equations depend only on a subset of the states. The key assumption in this study, is that the sample rate is not high enough to directly infer the continuous time system from the data. This assumption is relevant in applications where sampling is e… ▽ More This paper addresses identification of sparse linear and noise-driven continuous-time state-space systems, i.e., the right-hand sides in the dynamical equations depend only on a subset of the states. The key assumption in this study, is that the sample rate is not high enough to directly infer the continuous time system from the data. This assumption is relevant in applications where sampling is expensive or requires human intervention (e.g., biomedicine applications). We propose an iterative optimization scheme with $l_1$-regularization, where the search directions are restricted those that decrease prediction error in each iteration. We provide numerical examples illustrating the proposed method; the method outperforms the least squares estimation for large noise. △ Less

Submitted 17 April, 2018; v1 submitted 30 May, 2016; originally announced May 2016.

Comments: It has been merged into the arXiv article 1605.08590. No longer needed to keep it. And it's not well prepared

Systems Aliasing in Dynamic Network Reconstruction: Issues on Low Sampling Frequencies

Authors: Zuogon Yue, Johan Thunberg, Lennart Ljung, Ye Yuan, Jorge Goncalves

Abstract: Network reconstruction of dynamical continuous-time (CT) systems is motivated by applications in many fields. Due to experimental limitations, especially in biology, data could be sampled at low frequencies, leading to significant challenges in network inference. We introduce the concept of "system aliasing" and characterize the minimal sampling frequency that allows reconstruction of CT systems f… ▽ More Network reconstruction of dynamical continuous-time (CT) systems is motivated by applications in many fields. Due to experimental limitations, especially in biology, data could be sampled at low frequencies, leading to significant challenges in network inference. We introduce the concept of "system aliasing" and characterize the minimal sampling frequency that allows reconstruction of CT systems from low sampled data. A test criterion is also proposed to check whether system aliasing is presented. With no system aliasing, the paper provides an algorithm to reconstruct dynamic network from data in the presence of noise. In addition, when there is system aliasing we perform studies that add additional prior information of the system such as sparsity. This paper opens new directions in modelling of network systems where samples have significant costs. Such tools are essential to process the available data in applications subject to current experimental limitations. △ Less

Submitted 29 October, 2018; v1 submitted 27 May, 2016; originally announced May 2016.

Comments: 14 pages. arXiv admin note: substantial text overlap with arXiv:1605.06973

Inverse Problems for Matrix Exponential in System Identification: System Aliasing

Authors: Zuogon Yue, Johan Thunberg, Jorge Goncalves

Abstract: This note addresses identification of the $A$-matrix in continuous time linear dynamical systems on state-space form. If this matrix is partially known or known to have a sparse structure, such knowledge can be used to simplify the identification. We begin by introducing some general conditions for solvability of the inverse problems for matrix exponential. Next, we introduce "system aliasing" as… ▽ More This note addresses identification of the $A$-matrix in continuous time linear dynamical systems on state-space form. If this matrix is partially known or known to have a sparse structure, such knowledge can be used to simplify the identification. We begin by introducing some general conditions for solvability of the inverse problems for matrix exponential. Next, we introduce "system aliasing" as an issue in the identification of slow sampled systems. Such aliasing give rise to non-unique matrix logarithms. As we show, by imposing additional conditions on and prior knowledge about the $A$-matrix, the issue of system aliasing can, at least partially, be overcome. Under conditions on the sparsity and the norm of the $A$-matrix, it is identifiable up to a finite equivalence class. △ Less

Submitted 23 May, 2016; originally announced May 2016.

Comments: 7 pages

Shape-aware Surface Reconstruction from Sparse 3D Point-Clouds

Authors: Florian Bernard, Luis Salamanca, Johan Thunberg, Alexander Tack, Dennis Jentsch, Hans Lamecker, Stefan Zachow, Frank Hertel, Jorge Goncalves, Peter Gemmar

Abstract: The reconstruction of an object's shape or surface from a set of 3D points plays an important role in medical image analysis, e.g. in anatomy reconstruction from tomographic measurements or in the process of aligning intra-operative navigation and preoperative planning data. In such scenarios, one usually has to deal with sparse data, which significantly aggravates the problem of reconstruction. H… ▽ More The reconstruction of an object's shape or surface from a set of 3D points plays an important role in medical image analysis, e.g. in anatomy reconstruction from tomographic measurements or in the process of aligning intra-operative navigation and preoperative planning data. In such scenarios, one usually has to deal with sparse data, which significantly aggravates the problem of reconstruction. However, medical applications often provide contextual information about the 3D point data that allow to incorporate prior knowledge about the shape that is to be reconstructed. To this end, we propose the use of a statistical shape model (SSM) as a prior for surface reconstruction. The SSM is represented by a point distribution model (PDM), which is associated with a surface mesh. Using the shape distribution that is modelled by the PDM, we formulate the problem of surface reconstruction from a probabilistic perspective based on a Gaussian Mixture Model (GMM). In order to do so, the given points are interpreted as samples of the GMM. By using mixture components with anisotropic covariances that are "oriented" according to the surface normals at the PDM points, a surface-based fitting is accomplished. Estimating the parameters of the GMM in a maximum a posteriori manner yields the reconstruction of the surface from the given data points. We compare our method to the extensively used Iterative Closest Points method on several different anatomical datasets/SSMs (brain, femur, tibia, hip, liver) and demonstrate superior accuracy and robustness on sparse data. △ Less

Submitted 15 February, 2017; v1 submitted 26 February, 2016; originally announced February 2016.

Consensus and Formation Control on SE(3) for Switching Topologies

Authors: Johan Thunberg, Xiaoming Hu, Jorge Goncalves

Abstract: This paper addresses the consensus problem and the formation problem on SE(3) in multi-agent systems with directed and switching interconnection topologies. Several control laws are introduced for the consensus problem. By a simple transformation, it is shown that the proposed control laws can be used for the formation problem. The design is first conducted on the kinematic level, where the veloci… ▽ More This paper addresses the consensus problem and the formation problem on SE(3) in multi-agent systems with directed and switching interconnection topologies. Several control laws are introduced for the consensus problem. By a simple transformation, it is shown that the proposed control laws can be used for the formation problem. The design is first conducted on the kinematic level, where the velocities are the control laws. Then, for rigid bodies in space, the design is conducted on the dynamic level, where the torques and the forces are the control laws. On the kinematic level, first two control laws are introduced that explicitly use Euclidean transformations, then separate control laws are defined for the rotations and the translations. In the special case of purely rotational motion, the consensus problem is referred to as consensus on SO(3) or attitude synchronization. In this problem, for a broad class of local representations or parameterizations of SO(3), including the Axis-Angle Representation, the Rodrigues Parameters and the Modified Rodrigues Parameters, two types of control laws are presented that look structurally the same for any choice of local representation. For these two control laws we provide conditions on the initial rotations and the connectivity of the graph such that the system reaches consensus on SO(3). Among the contributions of this paper, there are conditions for when exponential rate of convergence occur. A theorem is provided showing that for any choice of local representation for the rotations, there is a change of coordinates such that the transformed system has a well known structure. △ Less

Submitted 1 November, 2015; originally announced November 2015.

Comments: 17 pages, 5 figures

Linear Shape Deformation Models with Local Support Using Graph-based Structured Matrix Factorisation

Authors: Florian Bernard, Peter Gemmar, Frank Hertel, Jorge Goncalves, Johan Thunberg

Abstract: Representing 3D shape deformations by linear models in high-dimensional space has many applications in computer vision and medical imaging, such as shape-based interpolation or segmentation. Commonly, using Principal Components Analysis a low-dimensional (affine) subspace of the high-dimensional shape space is determined. However, the resulting factors (the most dominant eigenvectors of the covari… ▽ More Representing 3D shape deformations by linear models in high-dimensional space has many applications in computer vision and medical imaging, such as shape-based interpolation or segmentation. Commonly, using Principal Components Analysis a low-dimensional (affine) subspace of the high-dimensional shape space is determined. However, the resulting factors (the most dominant eigenvectors of the covariance matrix) have global support, i.e. changing the coefficient of a single factor deforms the entire shape. In this paper, a method to obtain deformation factors with local support is presented. The benefits of such models include better flexibility and interpretability as well as the possibility of interactively deforming shapes locally. For that, based on a well-grounded theoretical motivation, we formulate a matrix factorisation problem employing sparsity and graph-based regularisation terms. We demonstrate that for brain shapes our method outperforms the state of the art in local support models with respect to generalisation ability and sparse shape reconstruction, whereas for human body shapes our method gives more realistic deformations. △ Less

Submitted 11 May, 2016; v1 submitted 28 October, 2015; originally announced October 2015.

Comments: Please cite CVPR 2016 version

Optimal output consensus for linear systems: A topology free approach

Authors: Johan Thunberg, Xiaoming Hu

Abstract: In this paper, for any homogeneous system of agents with linear continuous time dynamics, we formulate an optimal control problem. In this problem a convex cost functional of the control signals of the agents shall be minimized, while the outputs of the agents shall coincide at some given finite time. This is an instance of the rendezvous or finite time consensus problem. We solve this problem wit… ▽ More In this paper, for any homogeneous system of agents with linear continuous time dynamics, we formulate an optimal control problem. In this problem a convex cost functional of the control signals of the agents shall be minimized, while the outputs of the agents shall coincide at some given finite time. This is an instance of the rendezvous or finite time consensus problem. We solve this problem without any constraints on the communication topology and provide a solution as an explicit feedback control law for the case when the dynamics of the agents is output controllable. It turns out that the communication graph topology induced by the solution is complete. Based on this solution for the finite time consensus problem, we provide a solution to the case of infinite time horizon. Furthermore, we investigate under what circumstances it is possible to express the controller as a feedback control law of the output instead of the states. △ Less

Submitted 14 October, 2015; originally announced October 2015.

Comments: 8 pages

On Transitive Consistency for Linear Invertible Transformations between Euclidean Coordinate Systems

Authors: Johan Thunberg, Florian Bernard, Jorge Goncalves

Abstract: Transitive consistency is an intrinsic property for collections of linear invertible transformations between Euclidean coordinate frames. In practice, when the transformations are estimated from data, this property is lacking. This work addresses the problem of synchronizing transformations that are not transitively consistent. Once the transformations have been synchronized, they satisfy the tran… ▽ More Transitive consistency is an intrinsic property for collections of linear invertible transformations between Euclidean coordinate frames. In practice, when the transformations are estimated from data, this property is lacking. This work addresses the problem of synchronizing transformations that are not transitively consistent. Once the transformations have been synchronized, they satisfy the transitive consistency condition - a transformation from frame $A$ to frame $C$ is equal to the composite transformation of first transforming A to B and then transforming B to C. The coordinate frames correspond to nodes in a graph and the transformations correspond to edges in the same graph. Two direct or centralized synchronization methods are presented for different graph topologies; the first one for quasi-strongly connected graphs, and the second one for connected graphs. As an extension of the second method, an iterative Gauss-Newton method is presented, which is later adapted to the case of affine and Euclidean transformations. Two distributed synchronization methods are also presented for orthogonal matrices, which can be seen as distributed versions of the two direct or centralized methods; they are similar in nature to standard consensus protocols used for distributed averaging. When the transformations are orthogonal matrices, a bound on the optimality gap can be computed. Simulations show that the gap is almost right, even for noise large in magnitude. This work also contributes on a theoretical level by providing linear algebraic relationships for transitively consistent transformations. One of the benefits of the proposed methods is their simplicity - basic linear algebraic methods are used, e.g., the Singular Value Decomposition (SVD). For a wide range of parameter settings, the methods are numerically validated. △ Less

Submitted 2 September, 2015; originally announced September 2015.

Comments: 25 pages

A Solution for Multi-Alignment by Transformation Synchronisation

Authors: Florian Bernard, Johan Thunberg, Peter Gemmar, Frank Hertel, Andreas Husch, Jorge Goncalves

Abstract: The alignment of a set of objects by means of transformations plays an important role in computer vision. Whilst the case for only two objects can be solved globally, when multiple objects are considered usually iterative methods are used. In practice the iterative methods perform well if the relative transformations between any pair of objects are free of noise. However, if only noisy relative tr… ▽ More The alignment of a set of objects by means of transformations plays an important role in computer vision. Whilst the case for only two objects can be solved globally, when multiple objects are considered usually iterative methods are used. In practice the iterative methods perform well if the relative transformations between any pair of objects are free of noise. However, if only noisy relative transformations are available (e.g. due to missing data or wrong correspondences) the iterative methods may fail. Based on the observation that the underlying noise-free transformations can be retrieved from the null space of a matrix that can directly be obtained from pairwise alignments, this paper presents a novel method for the synchronisation of pairwise transformations such that they are transitively consistent. Simulations demonstrate that for noisy transformations, a large proportion of missing data and even for wrong correspondence assignments the method delivers encouraging results. △ Less

Submitted 14 April, 2015; v1 submitted 30 October, 2014; originally announced October 2014.

Comments: Accepted for CVPR 2015 (please cite CVPR version)

Convergence Tools for Consensus in Multi-Agent Systems with Switching Topologies

Authors: Johan Thunberg, Xiaoming Hu

Abstract: We present two main theorems along the lines of Lyapunov's second method that guarantee asymptotic state consensus in multi-agent systems of agents in R^m with switching interconnection topologies. The two theorems complement each other in the sense that the first one is formulated in terms of the states of the agents in the multi-agent system, whereas the second one is formulated in terms of the… ▽ More We present two main theorems along the lines of Lyapunov's second method that guarantee asymptotic state consensus in multi-agent systems of agents in R^m with switching interconnection topologies. The two theorems complement each other in the sense that the first one is formulated in terms of the states of the agents in the multi-agent system, whereas the second one is formulated in terms of the pairwise states for each pair of agents in the multi-agent system. In the first theorem, under the assumption that the interconnection topology is uniformly strongly connected and the agents are contained in a compact set, a strong form of attractiveness of the consensus set is assured. In the second theorem, under the weaker assumption that the interconnection topology is uniformly quasi strongly connected, the consensus set is guaranteed to be uniformly asymptotically stable. △ Less

Submitted 1 April, 2014; v1 submitted 20 November, 2013; originally announced November 2013.

Comments: 28 pages, 3 figures