Showing 1–27 of 27 results for author: Achim, A

RKFNet: A Novel Neural Network Aided Robust Kalman Filter

Authors: Pengcheng Hao, Oktay Karakus, Alin Achim

Abstract: Driven by the filtering challenges in linear systems disturbed by non-Gaussian heavy-tailed noise, the robust Kalman filters (RKFs) leveraging diverse heavy-tailed distributions have been introduced. However, the RKFs rely on precise noise models, and large model errors can degrade their filtering performance. Also, the posterior approximation by the employed variational Bayesian (VB) method can f… ▽ More Driven by the filtering challenges in linear systems disturbed by non-Gaussian heavy-tailed noise, the robust Kalman filters (RKFs) leveraging diverse heavy-tailed distributions have been introduced. However, the RKFs rely on precise noise models, and large model errors can degrade their filtering performance. Also, the posterior approximation by the employed variational Bayesian (VB) method can further decrease the estimation precision. Here, we introduce an innovative RKF method, the RKFNet, which combines the heavy-tailed-distribution-based RKF framework with the deep learning (DL) technique and eliminates the need for the precise parameters of the heavy-tailed distributions. To reduce the VB approximation error, the mixing-parameter-based function and the scale matrix are estimated by the incorporated neural network structures. Also, the stable training process is achieved by our proposed unsupervised scheduled sampling (USS) method, where a loss function based on the Student's t (ST) distribution is utilised to overcome the disturbance of the noise outliers and the filtering results of the traditional RKFs are employed as reference sequences. Furthermore, the RKFNet is evaluated against various RKFs and recurrent neural networks (RNNs) under three kinds of heavy-tailed measurement noises, and the simulation results showcase its efficacy in terms of estimation accuracy and efficiency. △ Less

Submitted 25 March, 2024; originally announced March 2024.

Atmospheric Turbulence Removal with Video Sequence Deep Visual Priors

Authors: P. Hill, N. Anantrasirichai, A. Achim, D. R. Bull

Abstract: Atmospheric turbulence poses a challenge for the interpretation and visual perception of visual imagery due to its distortion effects. Model-based approaches have been used to address this, but such methods often suffer from artefacts associated with moving content. Conversely, deep learning based methods are dependent on large and diverse datasets that may not effectively represent any specific c… ▽ More Atmospheric turbulence poses a challenge for the interpretation and visual perception of visual imagery due to its distortion effects. Model-based approaches have been used to address this, but such methods often suffer from artefacts associated with moving content. Conversely, deep learning based methods are dependent on large and diverse datasets that may not effectively represent any specific content. In this paper, we address these problems with a self-supervised learning method that does not require ground truth. The proposed method is not dependent on any dataset outside of the single data sequence being processed but is also able to improve the quality of any input raw sequences or pre-processed sequences. Specifically, our method is based on an accelerated Deep Image Prior (DIP), but integrates temporal information using pixel shuffling and a temporal sliding window. This efficiently learns spatio-temporal priors leading to a system that effectively mitigates atmospheric turbulence distortions. The experiments show that our method improves visual quality results qualitatively and quantitatively. △ Less

Submitted 29 February, 2024; originally announced February 2024.

On the Modelling of Ship Wakes in S-Band SAR Images and an Application to Ship Identification

Authors: Kamirul Kamirul, Odysseas Pappas, Igor G. Rizaev, Alin Achim

Abstract: We present a novel ship wake simulation system for generating S-band Synthetic Aperture Radar (SAR) images, and demonstrate the use of such imagery for the classification of ships based on their wake signatures via a deep learning approach. Ship wakes are modeled through the linear superposition of wind-induced sea elevation and the Kelvin wakes model of a moving ship. Our SAR imaging simulation t… ▽ More We present a novel ship wake simulation system for generating S-band Synthetic Aperture Radar (SAR) images, and demonstrate the use of such imagery for the classification of ships based on their wake signatures via a deep learning approach. Ship wakes are modeled through the linear superposition of wind-induced sea elevation and the Kelvin wakes model of a moving ship. Our SAR imaging simulation takes into account frequency-dependent radar parameters, i.e., the complex dielectric constant ($\varepsilon$) and the relaxation rate ($μ$) of seawater. The former was determined through the Debye model while the latter was estimated for S-band SAR based on pre-existing values for the L, C, and X-bands. The results show good agreement between simulated and real imagery upon visual inspection. The results of implementing different training strategies are also reported, showcasing a notable improvement in accuracy of classifier achieved by integrating real and simulated SAR images during the training. △ Less

Submitted 6 February, 2024; originally announced February 2024.

RoTIR: Rotation-Equivariant Network and Transformers for Fish Scale Image Registration

Authors: Ruixiong Wang, Alin Achim, Renata Raele-Rolfe, Qiao Tong, Dylan Bergen, Chrissy Hammond, Stephen Cross

Abstract: Image registration is an essential process for aligning features of interest from multiple images. With the recent development of deep learning techniques, image registration approaches have advanced to a new level. In this work, we present 'Rotation-Equivariant network and Transformers for Image Registration' (RoTIR), a deep-learning-based method for the alignment of fish scale images captured by… ▽ More Image registration is an essential process for aligning features of interest from multiple images. With the recent development of deep learning techniques, image registration approaches have advanced to a new level. In this work, we present 'Rotation-Equivariant network and Transformers for Image Registration' (RoTIR), a deep-learning-based method for the alignment of fish scale images captured by light microscopy. This approach overcomes the challenge of arbitrary rotation and translation detection, as well as the absence of ground truth data. We employ feature-matching approaches based on Transformers and general E(2)-equivariant steerable CNNs for model creation. Besides, an artificial training dataset is employed for semi-supervised learning. Results show RoTIR successfully achieves the goal of fish scale image registration. △ Less

Submitted 20 January, 2024; originally announced January 2024.

Comments: 7 pages, 4 figures, 2 tables

OCT2Confocal: 3D CycleGAN based Translation of Retinal OCT Images to Confocal Microscopy

Authors: Xin Tian, Nantheera Anantrasirichai, Lindsay Nicholson, Alin Achim

Abstract: Optical coherence tomography (OCT) and confocal microscopy are pivotal in retinal imaging, each presenting unique benefits and limitations. In-vivo OCT offers rapid, non-invasive imaging but can be hampered by clarity issues and motion artifacts. Ex-vivo confocal microscopy provides high-resolution, cellular detailed color images but is invasive and poses ethical concerns and potential tissue dama… ▽ More Optical coherence tomography (OCT) and confocal microscopy are pivotal in retinal imaging, each presenting unique benefits and limitations. In-vivo OCT offers rapid, non-invasive imaging but can be hampered by clarity issues and motion artifacts. Ex-vivo confocal microscopy provides high-resolution, cellular detailed color images but is invasive and poses ethical concerns and potential tissue damage. To bridge these modalities, we developed a 3D CycleGAN framework for unsupervised translation of in-vivo OCT to ex-vivo confocal microscopy images. Applied to our OCT2Confocal dataset, this framework effectively translates between 3D medical data domains, capturing vascular, textural, and cellular details with precision. This marks the first attempt to exploit the inherent 3D information of OCT and translate it into the rich, detailed color domain of confocal microscopy. Assessed through quantitative and qualitative evaluations, the 3D CycleGAN framework demonstrates commendable image fidelity and quality, outperforming existing methods despite the constraints of limited data. This non-invasive generation of retinal confocal images has the potential to further enhance diagnostic and monitoring capabilities in ophthalmology. Our source code and OCT2Confocal dataset are available at https://github.com/xintian-99/OCT2Confocal. △ Less

Submitted 16 February, 2024; v1 submitted 17 November, 2023; originally announced November 2023.

Comments: 4pages, 5 figures

DUBLINE: A Deep Unfolding Network for B-line Detection in Lung Ultrasound Images

Authors: Tianqi Yang, Nantheera Anantrasirichai, Oktay Karakuş, Marco Allinovi, Hatice Ceylan Koydemir, Alin Achim

Abstract: In the context of lung ultrasound, the detection of B-lines, which are indicative of interstitial lung disease and pulmonary edema, plays a pivotal role in clinical diagnosis. Current methods still rely on visual inspection by experts. Vision-based automatic B-line detection methods have been developed, but their performance has yet to improve in terms of both accuracy and computational speed. Thi… ▽ More In the context of lung ultrasound, the detection of B-lines, which are indicative of interstitial lung disease and pulmonary edema, plays a pivotal role in clinical diagnosis. Current methods still rely on visual inspection by experts. Vision-based automatic B-line detection methods have been developed, but their performance has yet to improve in terms of both accuracy and computational speed. This paper presents a novel approach to posing B-line detection as an inverse problem via deep unfolding of the Alternating Direction Method of Multipliers (ADMM). It tackles the challenges of data labelling and model training in lung ultrasound image analysis by harnessing the capabilities of deep neural networks and model-based methods. Our objective is to substantially enhance diagnostic accuracy while ensuring efficient real-time capabilities. The results show that the proposed method runs more than 90 times faster than the traditional model-based method and achieves an F1 score that is 10.6% higher. △ Less

Submitted 11 November, 2023; originally announced November 2023.

Comments: 4 pages, 3 figures, conference

Robust Kalman Filters Based on the Sub-Gaussian $α$-stable Distribution

Authors: Pengcheng Hao, Oktay Karakuş, Alin Achim

Abstract: Motivated by filtering tasks under a linear system with non-Gaussian heavy-tailed noise, various robust Kalman filters (RKFs) based on different heavy-tailed distributions have been proposed. Although the sub-Gaussian $α$-stable (SG$α$S) distribution captures heavy tails well and is applicable in various scenarios, its potential has not yet been explored in RKFs. The main hindrance is that there i… ▽ More Motivated by filtering tasks under a linear system with non-Gaussian heavy-tailed noise, various robust Kalman filters (RKFs) based on different heavy-tailed distributions have been proposed. Although the sub-Gaussian $α$-stable (SG$α$S) distribution captures heavy tails well and is applicable in various scenarios, its potential has not yet been explored in RKFs. The main hindrance is that there is no closed-form expression of its mixing density. This paper proposes a novel RKF framework, RKF-SG$α$S, where the signal noise is assumed to be Gaussian and the heavy-tailed measurement noise is modelled by the SG$α$S distribution. The corresponding joint posterior distribution of the state vector and auxiliary random variables is approximated by the Variational Bayesian (VB) approach. Also, four different minimum mean square error (MMSE) estimators of the scale function are presented. The first two methods are based on the Importance Sampling (IS) and Gauss-Laguerre quadrature (GLQ), respectively. In contrast, the last two estimators combine a proposed Gamma series (GS) based method with the IS and GLQ estimators and hence are called GSIS and GSGL. Besides, the RKF-SG$α$S is compared with the state-of-the-art RKFs under three kinds of heavy-tailed measurement noises, and the simulation results demonstrate its estimation accuracy and efficiency. All the code needed to reproduce the results presented in this work are available at: https://github.com/PengchengH/Robust-Kalman-Filters-Based-on-the-Sub-Gaussian-alpha-stable-Distribution. △ Less

Submitted 26 December, 2023; v1 submitted 13 May, 2023; originally announced May 2023.

A Semi-supervised Learning Approach for B-line Detection in Lung Ultrasound Images

Authors: Tianqi Yang, Nantheera Anantrasirichai, Oktay Karakuş, Marco Allinovi, Alin Achim

Abstract: Studies have proved that the number of B-lines in lung ultrasound images has a strong statistical link to the amount of extravascular lung water, which is significant for hemodialysis treatment. Manual inspection of B-lines requires experts and is time-consuming, whilst modelling automation methods is currently problematic because of a lack of ground truth. Therefore, in this paper, we propose a n… ▽ More Studies have proved that the number of B-lines in lung ultrasound images has a strong statistical link to the amount of extravascular lung water, which is significant for hemodialysis treatment. Manual inspection of B-lines requires experts and is time-consuming, whilst modelling automation methods is currently problematic because of a lack of ground truth. Therefore, in this paper, we propose a novel semi-supervised learning method for the B-line detection task based on contrastive learning. Through multi-level unsupervised learning on unlabelled lung ultrasound images, the features of the artefacts are learnt. In the downstream task, we introduce a fine-tuning process on a small number of labelled images using the EIoU-based loss function. Apart from reducing the data labelling workload, the proposed method shows a superior performance to model-based algorithm with the recall of 91.43%, the accuracy of 84.21% and the F1 score of 91.43%. △ Less

Submitted 23 March, 2023; v1 submitted 25 November, 2022; originally announced November 2022.

Comments: 5 pages, 3 figures, conference

Detection of Parasitic Eggs from Microscopy Images and the emergence of a new dataset

Authors: Perla Mayo, Nantheera Anantrasirichai, Thanarat H. Chalidabhongse, Duangdao Palasuwan, Alin Achim

Abstract: Automatic detection of parasitic eggs in microscopy images has the potential to increase the efficiency of human experts whilst also providing an objective assessment. The time saved by such a process would both help ensure a prompt treatment to patients, and off-load excessive work from experts' shoulders. Advances in deep learning inspired us to exploit successful architectures for detection, ad… ▽ More Automatic detection of parasitic eggs in microscopy images has the potential to increase the efficiency of human experts whilst also providing an objective assessment. The time saved by such a process would both help ensure a prompt treatment to patients, and off-load excessive work from experts' shoulders. Advances in deep learning inspired us to exploit successful architectures for detection, adapting them to tackle a different domain. We propose a framework that exploits two such state-of-the-art models. Specifically, we demonstrate results produced by both a Generative Adversarial Network (GAN) and Faster-RCNN, for image enhancement and object detection respectively, on microscopy images of varying quality. The use of these techniques yields encouraging results, though further improvements are still needed for certain egg types whose detection still proves challenging. As a result, a new dataset has been created and made publicly available, providing an even wider range of classes and variability. △ Less

Submitted 6 March, 2022; originally announced March 2022.

Comments: 7 pages, 3 figures, 1 table

High-resolution Coastline Extraction in SAR Images via MISP-GGD Superpixel Segmentation

Authors: Odysseas Pappas, Nantheera Anantrasirichai, Byron Adams, Alin Achim

Abstract: High accuracy coastline/shoreline extraction from SAR imagery is a crucial step in a number of maritime and coastal monitoring applications. We present a method based on image segmentation using the Generalised Gamma Mixture Model superpixel algorithm (MISP-GGD). MISP-GGD produces superpixels adhering with great accuracy to object edges in the image, such as the coastline. Unsupervised clustering… ▽ More High accuracy coastline/shoreline extraction from SAR imagery is a crucial step in a number of maritime and coastal monitoring applications. We present a method based on image segmentation using the Generalised Gamma Mixture Model superpixel algorithm (MISP-GGD). MISP-GGD produces superpixels adhering with great accuracy to object edges in the image, such as the coastline. Unsupervised clustering of the generated superpixels according to textural and radiometric features allows for generation of a land/water mask from which a highly accurate coastline can be extracted. We present results of our proposed method on a number of SAR images of varying characteristics. △ Less

Submitted 5 March, 2022; originally announced March 2022.

Comments: To appear in proceedings CIE RADAR 2021

Sparse InSAR Data 3D Inpainting for Ground Deformation Detection Along the Rail Corridor

Authors: Odysseas Pappas, Juliet Biggs, David Bull, Alin Achim, Nantheera Anantrasirichai

Abstract: Monitoring of ground movement close to the rail corridor, such as that associated with landslips caused by ground subsidence and/or uplift, is of great interest for the detection and prevention of possible railway faults. Interferometric synthetic-aperture radar (InSAR) data can be used to measure ground deformation, but its use poses distinct challenges, as the data is highly sparse and can be pa… ▽ More Monitoring of ground movement close to the rail corridor, such as that associated with landslips caused by ground subsidence and/or uplift, is of great interest for the detection and prevention of possible railway faults. Interferometric synthetic-aperture radar (InSAR) data can be used to measure ground deformation, but its use poses distinct challenges, as the data is highly sparse and can be particularly noisy. Here we present a scheme for processing and interpolating noisy, sparse InSAR data into a dense spatio-temporal stack, hel** suppress noise and opening up the possibility for treatment with deep learning and other image processing methods. △ Less

Submitted 4 March, 2022; originally announced March 2022.

Comments: in submission to ICIP 2022

Optimal Transport-based Graph Matching for 3D retinal OCT image registration

Authors: Xin Tian, Nantheera Anantrasirichai, Lindsay Nicholson, Alin Achim

Abstract: Registration of longitudinal optical coherence tomography (OCT) images assists disease monitoring and is essential in image fusion applications. Mouse retinal OCT images are often collected for longitudinal study of eye disease models such as uveitis, but their quality is often poor compared with human imaging. This paper presents a novel but efficient framework involving an optimal transport base… ▽ More Registration of longitudinal optical coherence tomography (OCT) images assists disease monitoring and is essential in image fusion applications. Mouse retinal OCT images are often collected for longitudinal study of eye disease models such as uveitis, but their quality is often poor compared with human imaging. This paper presents a novel but efficient framework involving an optimal transport based graph matching (OT-GM) method for 3D mouse OCT image registration. We first perform registration of fundus-like images obtained by projecting all b-scans of a volume on a plane orthogonal to them, hereafter referred to as the x-y plane. We introduce Adaptive Weighted Vessel Graph Descriptors (AWVGD) and 3D Cube Descriptors (CD) to identify the correspondence between nodes of graphs extracted from segmented vessels within the OCT projection images. The AWVGD comprises scaling, translation and rotation, which are computationally efficient, whereas CD exploits 3D spatial and frequency domain information. The OT-GM method subsequently performs the correct alignment in the x-y plane. Finally, registration along the direction orthogonal to the x-y plane (the z-direction) is guided by the segmentation of two important anatomical features peculiar to mouse b-scans, the Internal Limiting Membrane (ILM) and the hyaloid remnant (HR). Both subjective and objective evaluation results demonstrate that our framework outperforms other well-established methods on mouse OCT images within a reasonable execution time. △ Less

Submitted 28 February, 2022; originally announced March 2022.

Sparse regularization with a non-convex penalty for SAR imaging and autofocusing

Authors: Zi-Yao Zhang, Odysseas Pappas, Igor G. Rizaev, Alin Achim

Abstract: In this paper, SAR image reconstruction with joint phase error estimation (autofocusing) is formulated as an inverse problem. An optimization model utilising a sparsity-enforcing Cauchy regularizer is proposed, and an alternating minimization framework is used to solve it, in which the desired image and the phase errors are optimized alternatively. For the image reconstruction sub-problem (f-sub-p… ▽ More In this paper, SAR image reconstruction with joint phase error estimation (autofocusing) is formulated as an inverse problem. An optimization model utilising a sparsity-enforcing Cauchy regularizer is proposed, and an alternating minimization framework is used to solve it, in which the desired image and the phase errors are optimized alternatively. For the image reconstruction sub-problem (f-sub-problem), two methods are presented capable of handling the problem's complex nature, and we thus present two variants of our SAR image autofocusing algorithm. Firstly, we design a complex version of the forward-backward splitting algorithm (CFBA) to solve the f-sub-problem iteratively. For the second variant, the Wirtinger alternating minimization autofocusing (WAMA) method is presented, in which techniques of Wirtinger calculus are utilized to minimize the complex-valued cost function in the f-sub-problem in a direct fashion. For both methods, the phase error estimation sub-problem is solved by simply expanding and observing its cost function. Moreover, the convergence of both algorithms is discussed in detail. By conducting experiments on both simulated scenes and real SAR images, the proposed method is demonstrated to give impressive autofocusing results compared to other state of the art methods. △ Less

Submitted 22 August, 2021; originally announced August 2021.

Current Advances in Computational Lung Ultrasound Imaging: A Review

Authors: Tianqi Yang, Oktay Karakuş, Nantheera Anantrasirichai, Alin Achim

Abstract: In the field of biomedical imaging, ultrasonography has become increasingly widespread, and an important auxiliary diagnostic tool with unique advantages, such as being non-ionising and often portable. This article reviews the state-of-the-art in medical ultrasound image computing and in particular its application in the examination of the lungs. First, we review the current developments in medica… ▽ More In the field of biomedical imaging, ultrasonography has become increasingly widespread, and an important auxiliary diagnostic tool with unique advantages, such as being non-ionising and often portable. This article reviews the state-of-the-art in medical ultrasound image computing and in particular its application in the examination of the lungs. First, we review the current developments in medical ultrasound technology. We then focus on the characteristics of lung ultrasonography and on its ability to diagnose a variety of diseases through the identification of various artefacts. We review medical ultrasound image processing methods by splitting them into two categories: (1) traditional model-based methods, and (2) data driven methods. For the former, we consider inverse problem based methods by focusing in particular on ultrasound image despeckling, deconvolution, and line artefacts detection. Among the data-driven approaches, we discuss various works based on deep/machine learning, which include various effective network architectures implementing supervised, weakly supervised and unsupervised learning. △ Less

Submitted 7 November, 2022; v1 submitted 21 March, 2021; originally announced March 2021.

Comments: 14 pages, 12 figures

SAR Image Autofocusing using Wirtinger calculus and Cauchy regularization

Authors: Zi-Yao Zhang, Odysseas Pappas, Alin Achim

Abstract: In this paper, an optimization model using Cauchy regularization is proposed for simultaneous SAR image reconstruction and autofocusing. A coordinate descent framework in which the desired image and the phase errors are optimized alternatively is designed to solve the model. For the subproblem of estimating the image, we utilize the techniques of Wirtinger calculus to directly minimize the cost fu… ▽ More In this paper, an optimization model using Cauchy regularization is proposed for simultaneous SAR image reconstruction and autofocusing. A coordinate descent framework in which the desired image and the phase errors are optimized alternatively is designed to solve the model. For the subproblem of estimating the image, we utilize the techniques of Wirtinger calculus to directly minimize the cost function which involves complex variables. We also utilise a state-of-the-art, sparsity-enforcing Cauchy regularizer. The proposed method is demonstrated to give impressive autofocusing results by conducting experiments on both simulated scene and real SAR image. △ Less

Submitted 17 December, 2020; originally announced December 2020.

Exploiting the Dual-Tree Complex Wavelet Transform for Ship Wake Detection in SAR Imagery

Authors: Wanli Ma, Alin Achim, Oktay Karakuş

Abstract: In this paper, we analyse synthetic aperture radar (SAR) images of the sea surface using an inverse problem formulation whereby Radon domain information is enhanced in order to accurately detect ship wakes. This is achieved by promoting linear features in the images. For the inverse problem-solving stage, we propose a penalty function, which combines the dual-tree complex wavelet transform (DT-CWT… ▽ More In this paper, we analyse synthetic aperture radar (SAR) images of the sea surface using an inverse problem formulation whereby Radon domain information is enhanced in order to accurately detect ship wakes. This is achieved by promoting linear features in the images. For the inverse problem-solving stage, we propose a penalty function, which combines the dual-tree complex wavelet transform (DT-CWT) with the non-convex Cauchy penalty function. The solution to this inverse problem is based on the forward-backward (FB) splitting algorithm to obtain enhanced images in the Radon domain. The proposed method achieves the best results and leads to significant improvement in terms of various performance metrics, compared to state-of-the-art ship wake detection methods. The accuracy of detecting ship wakes in SAR images with different frequency bands and spatial resolution reaches more than 90%, which clearly demonstrates an accuracy gain of 7% compared to the second-best approach. △ Less

Submitted 11 December, 2020; originally announced December 2020.

Comments: 9 pages, 3 figures

A Simulation Study to Evaluate the Performance of the Cauchy Proximal Operator in Despeckling SAR Images of the Sea Surface

Authors: Oktay Karakuş, Igor Rizaev, Alin Achim

Abstract: The analysis of ocean surface is widely performed using synthetic aperture radar (SAR) imagery as it yields information for wide areas under challenging weather conditions, during day or night, etc. Speckle noise constitutes however the main reason for reduced performance in applications such as classification, ship detection, target tracking and so on. This paper presents an investigation into th… ▽ More The analysis of ocean surface is widely performed using synthetic aperture radar (SAR) imagery as it yields information for wide areas under challenging weather conditions, during day or night, etc. Speckle noise constitutes however the main reason for reduced performance in applications such as classification, ship detection, target tracking and so on. This paper presents an investigation into the despeckling of SAR images of the ocean that include ship wake structures, via sparse regularisation using the Cauchy proximal operator. We propose a closed-form expression for calculating the proximal operator for the Cauchy prior, which makes it applicable in generic proximal splitting algorithms. In our experiments, we simulate SAR images of moving vessels and their wakes. The performance of the proposed method is evaluated in comparison to the L1 and TV norm regularisation functions. The results show a superior performance of the proposed method for all the utilised images generated. △ Less

Submitted 11 December, 2020; originally announced December 2020.

Comments: 6 pages, 2 Figures. This work has been presented in IGARSS 2020

Non-convex Super-resolution of OCT images via sparse representation

Authors: Gabriele Scrivanti, Luca Calatroni, Serena Morigi, Lindsay Nicholson, Alin Achim

Abstract: We propose a non-convex variational model for the super-resolution of Optical Coherence Tomography (OCT) images of the murine eye, by enforcing sparsity with respect to suitable dictionaries learnt from high-resolution OCT data. The statistical characteristics of OCT images motivate the use of α-stable distributions for learning dictionaries, by considering the non-Gaussian case, α=1. The sparsity… ▽ More We propose a non-convex variational model for the super-resolution of Optical Coherence Tomography (OCT) images of the murine eye, by enforcing sparsity with respect to suitable dictionaries learnt from high-resolution OCT data. The statistical characteristics of OCT images motivate the use of α-stable distributions for learning dictionaries, by considering the non-Gaussian case, α=1. The sparsity-promoting cost function relies on a non-convex penalty - Cauchy-based or Minimax Concave Penalty (MCP) - which makes the problem particularly challenging. We propose an efficient algorithm for minimizing the function based on the forward-backward splitting strategy which guarantees at each iteration the existence and uniqueness of the proximal point. Comparisons with standard convex L1-based reconstructions show the better performance of non-convex models, especially in view of further OCT image analysis △ Less

Submitted 22 October, 2020; originally announced October 2020.

Comments: 4 pages, 2 figures, 1 table, 1 algorithm, submitted to ISBI2021

Representation Learning via Cauchy Convolutional Sparse Coding

Authors: Perla Mayo, Oktay Karakuş, Robin Holmes, Alin Achim

Abstract: In representation learning, Convolutional Sparse Coding (CSC) enables unsupervised learning of features by jointly optimising both an \(\ell_2\)-norm fidelity term and a sparsity enforcing penalty. This work investigates using a regularisation term derived from an assumed Cauchy prior for the coefficients of the feature maps of a CSC generative model. The sparsity penalty term resulting from this… ▽ More In representation learning, Convolutional Sparse Coding (CSC) enables unsupervised learning of features by jointly optimising both an \(\ell_2\)-norm fidelity term and a sparsity enforcing penalty. This work investigates using a regularisation term derived from an assumed Cauchy prior for the coefficients of the feature maps of a CSC generative model. The sparsity penalty term resulting from this prior is solved via its proximal operator, which is then applied iteratively, element-wise, on the coefficients of the feature maps to optimise the CSC cost function. The performance of the proposed Iterative Cauchy Thresholding (ICT) algorithm in reconstructing natural images is compared against the common choice of \(\ell_1\)-norm optimised via soft and hard thresholding. ICT outperforms IHT and IST in most of these reconstruction experiments across various datasets, with an average PSNR of up to 11.30 and 7.04 above ISTA and IHT respectively. △ Less

Submitted 8 August, 2020; originally announced August 2020.

Comments: 19 pages, 9 figures, journal draft

A Generalized Gaussian Extension to the Rician Distribution for SAR Image Modeling

Authors: Oktay Karakuş, Ercan E. Kuruoglu, Alin Achim

Abstract: In this paper, we present a novel statistical model, $\textit{the generalized-Gaussian-Rician}$ (GG-Rician) distribution, for the characterization of synthetic aperture radar (SAR) images. Since accurate statistical models lead to better results in applications such as target tracking, classification, or despeckling, characterizing SAR images of various scenes including urban, sea surface, or agri… ▽ More In this paper, we present a novel statistical model, $\textit{the generalized-Gaussian-Rician}$ (GG-Rician) distribution, for the characterization of synthetic aperture radar (SAR) images. Since accurate statistical models lead to better results in applications such as target tracking, classification, or despeckling, characterizing SAR images of various scenes including urban, sea surface, or agricultural, is essential. The proposed statistical model is based on the Rician distribution to model the amplitude of a complex SAR signal, the in-phase and quadrature components of which are assumed to be generalized-Gaussian distributed. The proposed amplitude GG-Rician model is further extended to cover the intensity SAR signals. In the experimental analysis, the GG-Rician model is investigated for amplitude and intensity SAR images of various frequency bands and scenes in comparison to state-of-the-art statistical models that include $\mathcal{K}$, Weibull, Gamma, and Lognormal. In order to decide on the most suitable model, statistical significance analysis via Kullback-Leibler divergence and Kolmogorov-Smirnov statistics are performed. The results demonstrate the superior performance and flexibility of the proposed model for all frequency bands and scenes and its applicability on both amplitude and intensity SAR images. The Matlab package is available at https://github.com/oktaykarakus/GG-Rician-SAR-Image-Modelling. △ Less

Submitted 7 April, 2021; v1 submitted 15 June, 2020; originally announced June 2020.

Comments: 20 Pages, 11 figures, 5 tables

Detection of Line Artefacts in Lung Ultrasound Images of COVID-19 Patients via Non-Convex Regularization

Authors: Oktay Karakuş, Nantheera Anantrasirichai, Amazigh Aguersif, Stein Silva, Adrian Basarab, Alin Achim

Abstract: In this paper, we present a novel method for line artefacts quantification in lung ultrasound (LUS) images of COVID-19 patients. We formulate this as a non-convex regularisation problem involving a sparsity-enforcing, Cauchy-based penalty function, and the inverse Radon transform. We employ a simple local maxima detection technique in the Radon transform domain, associated with known clinical defi… ▽ More In this paper, we present a novel method for line artefacts quantification in lung ultrasound (LUS) images of COVID-19 patients. We formulate this as a non-convex regularisation problem involving a sparsity-enforcing, Cauchy-based penalty function, and the inverse Radon transform. We employ a simple local maxima detection technique in the Radon transform domain, associated with known clinical definitions of line artefacts. Despite being non-convex, the proposed technique is guaranteed to convergence through our proposed Cauchy proximal splitting (CPS) method and accurately identifies both horizontal and vertical line artefacts in LUS images. In order to reduce the number of false and missed detection, our method includes a two-stage validation mechanism, which is performed in both Radon and image domains. We evaluate the performance of the proposed method in comparison to the current state-of-the-art B-line identification method and show a considerable performance gain with 87% correctly detected B-lines in LUS images of nine COVID-19 patients. In addition, owing to its fast convergence, our proposed method is readily applicable for processing LUS image sequences. △ Less

Submitted 9 September, 2020; v1 submitted 6 May, 2020; originally announced May 2020.

Comments: 16 pages, 9 figures

On Solving SAR Imaging Inverse Problems Using Non-Convex Regularization with a Cauchy-based Penalty

Authors: Oktay Karakuş, Alin Achim

Abstract: Synthetic aperture radar (SAR) imagery can provide useful information in a multitude of applications, including climate change, environmental monitoring, meteorology, high dimensional map**, ship monitoring, or planetary exploration. In this paper, we investigate solutions to a number of inverse problems encountered in SAR imaging. We propose a convex proximal splitting method for the optimizati… ▽ More Synthetic aperture radar (SAR) imagery can provide useful information in a multitude of applications, including climate change, environmental monitoring, meteorology, high dimensional map**, ship monitoring, or planetary exploration. In this paper, we investigate solutions to a number of inverse problems encountered in SAR imaging. We propose a convex proximal splitting method for the optimization of a cost function that includes a non-convex Cauchy-based penalty. The convergence of the overall cost function optimization is ensured through careful selection of model parameters within a forward-backward (FB) algorithm. The performance of the proposed penalty function is evaluated by solving three standard SAR imaging inverse problems, including super-resolution, image formation, and despeckling, as well as ship wake detection for maritime applications. The proposed method is compared to several methods employing classical penalty functions such as total variation ($TV$) and $L_1$ norms, and to the generalized minimax-concave (GMC) penalty. We show that the proposed Cauchy-based penalty function leads to better image reconstruction results when compared to the reference penalty functions for all SAR imaging inverse problems in this paper. △ Less

Submitted 3 June, 2020; v1 submitted 1 May, 2020; originally announced May 2020.

Comments: 18 pages, 7 figures

Journal ref: TGRS-2020-00890

Iterative Cauchy Thresholding: Regularisation with a heavy-tailed prior

Authors: Perla Mayo, Robin Holmes, Alin Achim

Abstract: In the machine learning era, sparsity continues to attract significant interest due to the benefits it provides to learning models. Algorithms aiming to optimise the \(\ell_0\)- and \(\ell_1\)-norm are the common choices to achieve sparsity. In this work, an alternative algorithm is proposed, which is derived based on the assumption of a Cauchy distribution characterising the coefficients in spars… ▽ More In the machine learning era, sparsity continues to attract significant interest due to the benefits it provides to learning models. Algorithms aiming to optimise the \(\ell_0\)- and \(\ell_1\)-norm are the common choices to achieve sparsity. In this work, an alternative algorithm is proposed, which is derived based on the assumption of a Cauchy distribution characterising the coefficients in sparse domains. The Cauchy distribution is known to be able to capture heavy-tails in the data, which are linked to sparse processes. We begin by deriving the Cauchy proximal operator and subsequently propose an algorithm for optimising a cost function which includes a Cauchy penalty term. We have coined our contribution as Iterative Cauchy Thresholding (ICT). Results indicate that sparser solutions can be achieved using ICT in conjunction with a fixed over-complete discrete cosine transform dictionary under a sparse coding methodology. △ Less

Submitted 27 March, 2020; originally announced March 2020.

Comments: 7 pages, 4 figures, 2 tables

Convergence Guarantees for Non-Convex Optimisation with Cauchy-Based Penalties

Authors: Oktay Karakus, Perla Mayo, Alin Achim

Abstract: In this paper, we propose a proximal splitting methodology with a non-convex penalty function based on the heavy-tailed Cauchy distribution. We first suggest a closed-form expression for calculating the proximal operator of the Cauchy prior, which then makes it applicable in generic proximal splitting algorithms. We further derive the condition required for guaranteed convergence to a solution in… ▽ More In this paper, we propose a proximal splitting methodology with a non-convex penalty function based on the heavy-tailed Cauchy distribution. We first suggest a closed-form expression for calculating the proximal operator of the Cauchy prior, which then makes it applicable in generic proximal splitting algorithms. We further derive the condition required for guaranteed convergence to a solution in optimisation problems involving the Cauchy based penalty function. Setting the system parameters by satisfying the proposed condition ensures convergence even though the overall cost function is non-convex when minimisation is performed via a proximal splitting algorithm. The proposed method based on Cauchy regularisation is evaluated by solving generic signal processing examples, i.e. 1D signal denoising in the frequency domain, two image reconstruction tasks including de-blurring and denoising, and error recovery in a multiple-antenna communication system. We experimentally verify the proposed convergence conditions for various cases, and show the effectiveness of the proposed Cauchy based non-convex penalty function over state-of-the-art penalty functions such as $L_1$ and total variation ($TV$) norms. △ Less

Submitted 26 October, 2020; v1 submitted 10 March, 2020; originally announced March 2020.

Comments: 16 pages, 9 figures

Detection of Ship Wakes in SAR Imagery Using Cauchy Regularisation

Authors: Tianqi Yang, Oktay Karakuş, Alin Achim

Abstract: Ship wake detection is of great importance in the characterisation of synthetic aperture radar (SAR) images of the ocean surface since wakes usually carry essential information about vessels. Most detection methods exploit the linear characteristics of the ship wakes and transform the lines in the spatial domain into bright or dark points in a transform domain, such as the Radon or Hough transform… ▽ More Ship wake detection is of great importance in the characterisation of synthetic aperture radar (SAR) images of the ocean surface since wakes usually carry essential information about vessels. Most detection methods exploit the linear characteristics of the ship wakes and transform the lines in the spatial domain into bright or dark points in a transform domain, such as the Radon or Hough transforms. This paper proposes an innovative ship wake detection method based on sparse regularisation to obtain the Radon transform of the SAR image, in which the linear features are enhanced. The corresponding cost function utilizes the Cauchy prior, and on this basis, the Cauchy proximal operator is proposed. A Bayesian method, the Moreau-Yoshida unadjusted Langevin algorithm (MYULA), which is computationally efficient and robust is used to estimate the image in the transform domain by minimizing the negative log-posterior distribution. The detection accuracy of the Cauchy prior based approach is 86.7%, which is demonstrated by experiments over six COSMO-SkyMed images. △ Less

Submitted 6 October, 2020; v1 submitted 11 February, 2020; originally announced February 2020.

Comments: 9 pages, 2 Figures and 2 Tables

Ship Wake Detection in SAR Images via Sparse Regularization

Authors: Oktay Karakuş, Igor Rizaev, Alin Achim

Abstract: In order to analyse synthetic aperture radar (SAR) images of the sea surface, ship wake detection is essential for extracting information on the wake generating vessels. One possibility is to assume a linear model for wakes, in which case detection approaches are based on transforms such as Radon and Hough. These express the bright (dark) lines as peak (trough) points in the transform domain. In t… ▽ More In order to analyse synthetic aperture radar (SAR) images of the sea surface, ship wake detection is essential for extracting information on the wake generating vessels. One possibility is to assume a linear model for wakes, in which case detection approaches are based on transforms such as Radon and Hough. These express the bright (dark) lines as peak (trough) points in the transform domain. In this paper, ship wake detection is posed as an inverse problem, which the associated cost function including a sparsity enforcing penalty, i.e. the generalized minimax concave (GMC) function. Despite being a non-convex regularizer, the GMC penalty enforces the overall cost function to be convex. The proposed solution is based on a Bayesian formulation, whereby the point estimates are recovered using maximum a posteriori (MAP) estimation. To quantify the performance of the proposed method, various types of SAR images are used, corresponding to TerraSAR-X, COSMO-SkyMed, Sentinel-1, and ALOS2. The performance of various priors in solving the proposed inverse problem is first studied by investigating the GMC along with the L1, Lp, nuclear and total variation (TV) norms. We show that the GMC achieves the best results and we subsequently study the merits of the corresponding method in comparison to two state-of-the-art approaches for ship wake detection. The results show that our proposed technique offers the best performance by achieving 80% success rate. △ Less

Submitted 12 May, 2020; v1 submitted 5 April, 2019; originally announced April 2019.

Comments: 18 pages

Recovery of compressively sensed ultrasound images with structured Sparse Bayesian Learning

Authors: Richard Porter, Vladislav Tadic, Alin Achim

Abstract: In this paper, we consider the problem of recovering compressively sensed ultrasound images. We build on prior work, and consider a number of existing approaches that we consider to be the state-of-the-art. The methods we consider take advantage of a number of assumptions on the signals including those of temporal and spatial correlation, block structure, prior knowledge of the support, and non-Ga… ▽ More In this paper, we consider the problem of recovering compressively sensed ultrasound images. We build on prior work, and consider a number of existing approaches that we consider to be the state-of-the-art. The methods we consider take advantage of a number of assumptions on the signals including those of temporal and spatial correlation, block structure, prior knowledge of the support, and non-Gaussianity. We conduct a series of intensive tests to quantify the performance of these methods. We find that by altering the parameters of the structured Sparse Bayesian Learning approaches considered, we can significantly improve the objective quality of the reconstructed images. The results we achieve are a significant improvement upon previously proposed reconstruction techniques. In addition, we further show that by careful choice of parameters, we can obtain near-optimal results whilst requiring only a small fraction of the computational time needed for the best reconstruction quality. △ Less

Submitted 3 November, 2018; originally announced November 2018.

Comments: 12 pages