-
Binary segmentation of medical images using implicit spline representations and deep learning
Authors:
Oliver J. D. Barrowclough,
Georg Muntingh,
Varatharajan Nainamalai,
Ivar Stangeby
Abstract:
We propose a novel approach to image segmentation based on combining implicit spline representations with deep convolutional neural networks. This is done by predicting the control points of a bivariate spline function whose zero-set represents the segmentation boundary. We adapt several existing neural network architectures and design novel loss functions that are tailored towards providing impli…
▽ More
We propose a novel approach to image segmentation based on combining implicit spline representations with deep convolutional neural networks. This is done by predicting the control points of a bivariate spline function whose zero-set represents the segmentation boundary. We adapt several existing neural network architectures and design novel loss functions that are tailored towards providing implicit spline curve approximations. The method is evaluated on a congenital heart disease computed tomography medical imaging dataset. Experiments are carried out by measuring performance in various standard metrics for different networks and loss functions. We determine that splines of bidegree $(1,1)$ with $128\times128$ coefficient resolution performed optimally for $512\times 512$ resolution CT images. For our best network, we achieve an average volumetric test Dice score of almost 92%, which reaches the state of the art for this congenital heart disease dataset.
△ Less
Submitted 19 March, 2021; v1 submitted 25 February, 2021;
originally announced February 2021.
-
Real-time processing of high-resolution video and 3D model-based tracking for remote towers
Authors:
Oliver J. D. Barrowclough,
Sverre Briseid,
Georg Muntingh,
Torbjørn Viksand
Abstract:
High quality video data is a core component in emerging remote tower operations as it inherently contains a huge amount of information on which an air traffic controller can base decisions. Various digital technologies also have the potential to exploit this data to bring enhancements, including tracking ground movements by relating events in the video view to their positions in 3D space. The tota…
▽ More
High quality video data is a core component in emerging remote tower operations as it inherently contains a huge amount of information on which an air traffic controller can base decisions. Various digital technologies also have the potential to exploit this data to bring enhancements, including tracking ground movements by relating events in the video view to their positions in 3D space. The total resolution of remote tower setups with multiple cameras often exceeds 25 million RGB pixels and is captured at 30 frames per second or more. It is thus a challenge to efficiently process all the data in such a way as to provide relevant real-time enhancements to the controller. In this paper we discuss how a number of improvements can be implemented efficiently on a single workstation by decoupling processes and utilizing hardware for parallel computing. We also highlight how decoupling the processes in this way increases resilience of the software solution in the sense that failure of a single component does not impair the function of the other components.
△ Less
Submitted 15 January, 2020; v1 submitted 8 October, 2019;
originally announced October 2019.
-
Void Filling of Digital Elevation Models with Deep Generative Models
Authors:
Konstantinos Gavriil,
Georg Muntingh,
Oliver J. D. Barrowclough
Abstract:
In recent years, advances in machine learning algorithms, cheap computational resources, and the availability of big data have spurred the deep learning revolution in various application domains. In particular, supervised learning techniques in image analysis have led to superhuman performance in various tasks, such as classification, localization, and segmentation, while unsupervised learning tec…
▽ More
In recent years, advances in machine learning algorithms, cheap computational resources, and the availability of big data have spurred the deep learning revolution in various application domains. In particular, supervised learning techniques in image analysis have led to superhuman performance in various tasks, such as classification, localization, and segmentation, while unsupervised learning techniques based on increasingly advanced generative models have been applied to generate high-resolution synthetic images indistinguishable from real images.
In this paper we consider a state-of-the-art machine learning model for image inpainting, namely a Wasserstein Generative Adversarial Network based on a fully convolutional architecture with a contextual attention mechanism. We show that this model can successfully be transferred to the setting of digital elevation models (DEMs) for the purpose of generating semantically plausible data for filling voids. Training, testing and experimentation is done on GeoTIFF data from various regions in Norway, made openly available by the Norwegian Map** Authority.
△ Less
Submitted 26 February, 2019; v1 submitted 30 November, 2018;
originally announced November 2018.
-
Reverse engineering of CAD models via clustering and approximate implicitization
Authors:
Andrea Raffo,
Oliver J. D. Barrowclough,
Georg Muntingh
Abstract:
In applications like computer aided design, geometric models are often represented numerically as polynomial splines or NURBS, even when they originate from primitive geometry. For purposes such as redesign and isogeometric analysis, it is of interest to extract information about the underlying geometry through reverse engineering. In this work we develop a novel method to determine these primitiv…
▽ More
In applications like computer aided design, geometric models are often represented numerically as polynomial splines or NURBS, even when they originate from primitive geometry. For purposes such as redesign and isogeometric analysis, it is of interest to extract information about the underlying geometry through reverse engineering. In this work we develop a novel method to determine these primitive shapes by combining clustering analysis with approximate implicitization. The proposed method is automatic and can recover algebraic hypersurfaces of any degree in any dimension. In exact arithmetic, the algorithm returns exact results. All the required parameters, such as the implicit degree of the patches and the number of clusters of the model, are inferred using numerical approaches in order to obtain an algorithm that requires as little manual input as possible. The effectiveness, efficiency and robustness of the method are shown both in a theoretical analysis and in numerical examples implemented in Python.
△ Less
Submitted 19 April, 2020; v1 submitted 17 October, 2018;
originally announced October 2018.
-
Approximate Implicitization of Triangular Bézier Surfaces
Authors:
Oliver J. D. Barrowclough,
Tor Dokken
Abstract:
We discuss how Dokken's methods of approximate implicitization can be applied to triangular Bézier surfaces in both the original and weak forms. The matrices $\mathbf{D}$ and $\mathbf{M}$ that are fundamental to the respective forms of approximate implicitization are shown to be constructed essentially by repeated multiplication of polynomials and by matrix multiplication. A numerical approach to…
▽ More
We discuss how Dokken's methods of approximate implicitization can be applied to triangular Bézier surfaces in both the original and weak forms. The matrices $\mathbf{D}$ and $\mathbf{M}$ that are fundamental to the respective forms of approximate implicitization are shown to be constructed essentially by repeated multiplication of polynomials and by matrix multiplication. A numerical approach to weak approximate implicitization is also considered and we show that symmetries within this algorithm can be exploited to reduce the computation time of $\mathbf{M}.$ Explicit examples are presented to compare the methods and to demonstrate properties of the approximations.
△ Less
Submitted 5 July, 2017;
originally announced July 2017.
-
Fast Approximate Implicitization of Envelope Curves using Chebyshev Polynomials
Authors:
Oliver J D Barrowclough,
Bert Jüttler,
Tino Schulz
Abstract:
Consider a rational family of planar rational curves in a certain region of interest. We are interested in finding an approximation to the implicit representation of the envelope. Since exact implicitization methods tend to be very costly, we employ an adaptation of approximate implicitization to envelope computation. Moreover, by utilizing an orthogonal basis in the construction process, the comp…
▽ More
Consider a rational family of planar rational curves in a certain region of interest. We are interested in finding an approximation to the implicit representation of the envelope. Since exact implicitization methods tend to be very costly, we employ an adaptation of approximate implicitization to envelope computation. Moreover, by utilizing an orthogonal basis in the construction process, the computational times can be shortened and the numerical condition improved. We provide an example to illustrate the performance of our approach.
△ Less
Submitted 5 July, 2017;
originally announced July 2017.
-
Direct interactive visualization of locally refined spline volumes for scalar and vector fields
Authors:
Franz G. Fuchs,
Oliver J. D. Barrowclough,
Jon M. Hjelmervik,
Heidi E. I. Dahl
Abstract:
We present a novel approach enabling interactive visualization of volumetric Locally Refined B-splines (LR-splines). To this end we propose a highly efficient algorithm for direct visualization of scalar and vector fields given by an LR-spline. In both cases, our main contribution to achieve interactive frame rates is an acceleration structure for fast element look-up and a change of basis for eff…
▽ More
We present a novel approach enabling interactive visualization of volumetric Locally Refined B-splines (LR-splines). To this end we propose a highly efficient algorithm for direct visualization of scalar and vector fields given by an LR-spline. In both cases, our main contribution to achieve interactive frame rates is an acceleration structure for fast element look-up and a change of basis for efficient evaluation. To further improve the efficiency, we present a heuristic for adaptive sampling distance for the numerical integration. A comparison with existing adaptive approaches is performed. The algorithms are designed to fully utilize modern graphics processing unit (GPU) capabilities. Important applications where LR-spline volumes emerge are given for instance by approximation of large-scale simulation and sensor data, and Isogeometric Analysis (IGA). We showcase interactive rendering achieved by our approach on different representative use cases, stemming from simulations of wind flow around a telescope, Magnetic Resonance (MR) imaging of a human brain, and simulations of a fluidized bed used for mixing and coating particles in industrial processes.
△ Less
Submitted 14 March, 2018; v1 submitted 4 July, 2017;
originally announced July 2017.
-
A basis for the implicit representation of planar rational cubic Bézier curves
Authors:
Oliver J. D. Barrowclough
Abstract:
We present an approach to finding the implicit equation of a planar rational parametric cubic curve, by defining a new basis for the representation. The basis, which contains only four cubic bivariate polynomials, is defined in terms of the Bézier control points of the curve. An explicit formula for the coefficients of the implicit curve is given. Moreover, these coefficients lead to simple expres…
▽ More
We present an approach to finding the implicit equation of a planar rational parametric cubic curve, by defining a new basis for the representation. The basis, which contains only four cubic bivariate polynomials, is defined in terms of the Bézier control points of the curve. An explicit formula for the coefficients of the implicit curve is given. Moreover, these coefficients lead to simple expressions which describe aspects of the geometric behaviour of the curve. In particular, we present an explicit barycentric formula for the position of the double point, in terms of the Bézier control points of the curve. We also give conditions for when an unwanted singularity occurs in the region of interest. Special cases in which the method fails, such as when three of the control points are collinear, or when two points coincide, will be discussed separately.
△ Less
Submitted 27 May, 2016;
originally announced May 2016.
-
Approximate implicitization using linear algebra
Authors:
Oliver J. D. Barrowclough,
Tor Dokken
Abstract:
In this paper we consider a family of algorithms for approximate implicitization of rational parametric curves and surfaces. The main approximation tool in all of the approaches is the singular value decomposition, and they are therefore well suited to floating point implementation in computer aided geometric design (CAGD) systems. We unify the approaches under the names of commonly known polynomi…
▽ More
In this paper we consider a family of algorithms for approximate implicitization of rational parametric curves and surfaces. The main approximation tool in all of the approaches is the singular value decomposition, and they are therefore well suited to floating point implementation in computer aided geometric design (CAGD) systems. We unify the approaches under the names of commonly known polynomial basis functions, and consider various theoretical and practical aspects of the algorithms. We offer new methods for a least squares approach to approximate implicitization using orthogonal polynomials, which tend to be faster and more numerically stable than some existing algorithms. We propose several simple propositions relating the properties of the polynomial bases to their implicit approximation properties.
△ Less
Submitted 27 May, 2016;
originally announced May 2016.
