Showing 1–50 of 57 results for author: Bermudez, C

A Generalized Multiscale Bundle-Based Hyperspectral Sparse Unmixing Algorithm

Authors: Luciano Carvalho Ayres, Ricardo Augusto Borsoi, José Carlos Moreira Bermudez, Sérgio José Melo de Almeida

Abstract: In hyperspectral sparse unmixing, a successful approach employs spectral bundles to address the variability of the endmembers in the spatial domain. However, the regularization penalties usually employed aggregate substantial computational complexity, and the solutions are very noise-sensitive. We generalize a multiscale spatial regularization approach to solve the unmixing problem by incorporatin… ▽ More In hyperspectral sparse unmixing, a successful approach employs spectral bundles to address the variability of the endmembers in the spatial domain. However, the regularization penalties usually employed aggregate substantial computational complexity, and the solutions are very noise-sensitive. We generalize a multiscale spatial regularization approach to solve the unmixing problem by incorporating group sparsity-inducing mixed norms. Then, we propose a noise-robust method that can take advantage of the bundle structure to deal with endmember variability while ensuring inter- and intra-class sparsity in abundance estimation with reasonable computational cost. We also present a general heuristic to select the \emph{most representative} abundance estimation over multiple runs of the unmixing process, yielding a solution that is robust and highly reproducible. Experiments illustrate the robustness and consistency of the results when compared to related methods. △ Less

Submitted 23 January, 2024; originally announced January 2024.

On the variance of the Least Mean Square squared-error sample curve

Authors: Marcos H. Maruo, José Carlos M. Bermudez

Abstract: Most studies of adaptive algorithm behavior consider performance measures based on mean values such as the mean-square error. The derived models are useful for understanding the algorithm behavior under different environments and can be used for design. Nevertheless, from a practical point of view, the adaptive filter user has only one realization of the algorithm to obtain the desired result. Thi… ▽ More Most studies of adaptive algorithm behavior consider performance measures based on mean values such as the mean-square error. The derived models are useful for understanding the algorithm behavior under different environments and can be used for design. Nevertheless, from a practical point of view, the adaptive filter user has only one realization of the algorithm to obtain the desired result. This letter derives a model for the variance of the squared-error sample curve of the least-mean-square (LMS) adaptive algorithm, so that the achievable cancellation level can be predicted based on the properties of the steady-state squared error. The derived results provide the user with useful design guidelines. △ Less

Submitted 30 November, 2023; originally announced December 2023.

Discovery of CH3CHCO in TMC-1 with the QUIJOTE line survey

Authors: R. Fuentetaja, C . Bermúdez, C. Cabezas, M. Agúndez, B. Tercero, N. Marcelino, J. R. Pardo, L. Margulès, R. A. Motiyenko, J. -C. Guillemin, P. de Vicente, J. Cernicharo

Abstract: We report the detection of methyl ketene towards TMC-1 with the QUIJOTE line survey. Nineteen rotational transitions with rotational quantum numbers ranging from J = 3 up to J = 5 and Ka =< 2 were identified in the frequency range 32.0-50.4 GHz, 11 of which arise above the 3σ level. We derived a column density for CH3CHCO of N=1.5x10^11 cm-2 and a rotational temperature of 9 K. Hence, the abundanc… ▽ More We report the detection of methyl ketene towards TMC-1 with the QUIJOTE line survey. Nineteen rotational transitions with rotational quantum numbers ranging from J = 3 up to J = 5 and Ka =< 2 were identified in the frequency range 32.0-50.4 GHz, 11 of which arise above the 3σ level. We derived a column density for CH3CHCO of N=1.5x10^11 cm-2 and a rotational temperature of 9 K. Hence, the abundance ratio between ketene and methyl ketene, CH2CO/CH3CHCO, is 93. This species is the second C3H4O isomer detected. The other, trans-propenal (CH2CHCHO), corresponds to the most stable isomer and has a column density of N=(2.2+-0.3)x10^11 cm-2, which results in an abundance ratio CH2CHCHO/CH3CHCO of 1.5. The next non-detected isomer with the lowest energy is cis-propenal, which is therefore a good candidate for future discovery. We have carried out an in-depth study of the possible gas-phase chemical reactions involving methyl ketene to explain the abundance detected, achieving good agreement between chemical models and observations. △ Less

Submitted 17 February, 2023; originally announced February 2023.

Journal ref: A&A 671, L6 (2023)

Risk-based regulation for all: The need and a method for a wide adoption solution for data-driven inspection targeting

Authors: Celso H. H. Ribas, José C. M. Bermudez

Abstract: Access to data and data processing, including the use of machine learning techniques, has become significantly easier and cheaper in recent years. Nevertheless, solutions that can be widely adopted by regulators for market monitoring and inspection targeting in a data-driven way have not been frequently discussed by the scientific community. This article discusses the need and the difficulties for… ▽ More Access to data and data processing, including the use of machine learning techniques, has become significantly easier and cheaper in recent years. Nevertheless, solutions that can be widely adopted by regulators for market monitoring and inspection targeting in a data-driven way have not been frequently discussed by the scientific community. This article discusses the need and the difficulties for the development of such solutions, presents an effective method to address regulation planning, and illustrates its use to account for the most important and common subject for the majority of regulators: the consumer. This article hopes to contribute to increase the awareness of the regulatory community to the need for data processing methods that are objective, impartial, transparent, explainable, simple to implement and with low computational cost, aiming to the implementation of risk-based regulation in the world. △ Less

Submitted 7 April, 2022; originally announced April 2022.

A Pathology-Based Machine Learning Method to Assist in Epithelial Dysplasia Diagnosis

Authors: Karoline da Rocha, José C. M. Bermudez, Elena R. C. Rivero, Márcio H. Costa

Abstract: The Epithelial Dysplasia (ED) is a tissue alteration commonly present in lesions preceding oral cancer, being its presence one of the most important factors in the progression toward carcinoma. This study proposes a method to design a low computational cost classification system to support the detection of dysplastic epithelia, contributing to reduce the variability of pathologist assessments. We… ▽ More The Epithelial Dysplasia (ED) is a tissue alteration commonly present in lesions preceding oral cancer, being its presence one of the most important factors in the progression toward carcinoma. This study proposes a method to design a low computational cost classification system to support the detection of dysplastic epithelia, contributing to reduce the variability of pathologist assessments. We employ a multilayer artificial neural network (MLP-ANN) and defining the regions of the epithelium to be assessed based on the knowledge of the pathologist. The performance of the proposed solution was statistically evaluated. The implemented MLP-ANN presented an average accuracy of 87%, with a variability much inferior to that obtained from three trained evaluators. Moreover, the proposed solution led to results which are very close to those obtained using a convolutional neural network (CNN) implemented by transfer learning, with 100 times less computational complexity. In conclusion, our results show that a simple neural network structure can lead to a performance equivalent to that of much more complex structures, which are routinely used in the literature. △ Less

Submitted 7 April, 2022; originally announced April 2022.

Ultra-deep 31.0-50.3 GHz spectral survey of IRC+10216

Authors: J. R. Pardo, J. Cernicharo, B. Tercero, C. Cabezas, C. Bermúdez, M. Agúndez, J. D. Gallego, F. Tercero, M. Gómez-Garrido, P. de Vicente, J. A. López-Pérez

Abstract: Context. IRC+10216, the carbon-rich envelope of the asymptotic giant branch (AGB) star CW Leo, is one of the richest molecular sources in the sky. Available spectral surveys below 51 GHz are more than 25 years old and new work is needed. Aims. Characterizing the rich molecular content of this source, specially for heavy species, requires to carry out very sensitive spectral surveys at low freque… ▽ More Context. IRC+10216, the carbon-rich envelope of the asymptotic giant branch (AGB) star CW Leo, is one of the richest molecular sources in the sky. Available spectral surveys below 51 GHz are more than 25 years old and new work is needed. Aims. Characterizing the rich molecular content of this source, specially for heavy species, requires to carry out very sensitive spectral surveys at low frequencies. In particular in this work we have achieved an rms in the range 0.2-0.6 mK per MHz. Methods. long Q-band (31.0-50.3 GHz) single dish integrations were carried out with the Yebes 40m telescope using specifically built receivers. State of the art line catalogs are used for line identification. Results. A total of 652 spectral features corresponding to 713 transitions from 81 species (we count as different the isomers, isotopologues and ortho/para species) are present in the data. Only 57 unidentified lines remain with signal to noise ratios >3. Some new species and/or vibrational modes have been discovered for the first time with this survey. Conclusions. This IRC+10216 spectral survey is, by far, the most sensitive one carried out to this date in the Q-band. It therefore provides the most complete view of IRC+10216 from 31.0 to 50.3 GHz, giving unique information on its molecular content, specially for heavy species. Rotational diagrams built from the data provide valuable information on the physical conditions and chemical content of this circumstellar envelope. △ Less

Submitted 3 November, 2021; originally announced November 2021.

Comments: Accepted for publication in Astronomy and Astrophysics on Oct. 29th 2021. Table A.1 will be removed from the published version and sent to the CDS

Stochastic Analysis of the Diffusion Least Mean Square and Normalized Least Mean Square Algorithms for Cyclostationary White Gaussian and Non-Gaussian Inputs

Authors: Eweda Eweda, Neil J. Bershad, Jose C. M. Bermudez

Abstract: The diffusion least mean square (DLMS) and the diffusion normalized least mean square (DNLMS) algorithms are analyzed for a network having a fusion center. This structure reduces the dimensionality of the resulting stochastic models while preserving important diffusion properties. The analysis is done in a system identification framework for cyclostationary white nodal inputs. The system parameter… ▽ More The diffusion least mean square (DLMS) and the diffusion normalized least mean square (DNLMS) algorithms are analyzed for a network having a fusion center. This structure reduces the dimensionality of the resulting stochastic models while preserving important diffusion properties. The analysis is done in a system identification framework for cyclostationary white nodal inputs. The system parameters vary according to a random walk model. The cyclostationarity is modeled by periodic time variations of the nodal input powers. The analysis holds for all types of nodal input distributions and nodal input power variations. The derived models consist of simple scalar recursions. These recursions facilitate the understanding of the network mean and mean-square dependence upon the 1) nodal weighting coefficients, 2) nodal input kurtosis and cyclostationarities, 3) nodal noise powers and 4) the unknown system mean-square parameter increments. Optimization of the node weighting coefficients is studied. Also investigated is the stability dependence of the two algorithms upon the nodal input kurtosis and weighting coefficients. Significant differences are found between the behaviors of the DLMS and DNLMS algorithms for non-Gaussian nodal inputs. Simulations provide strong support for the theory. △ Less

Submitted 5 August, 2021; originally announced August 2021.

Model-Based Deep Autoencoder Networks for Nonlinear Hyperspectral Unmixing

Authors: Haoqing Li, Ricardo Augusto Borsoi, Tales Imbiriba, Pau Closas, José Carlos Moreira Bermudez, Deniz Erdoğmuş

Abstract: Autoencoder (AEC) networks have recently emerged as a promising approach to perform unsupervised hyperspectral unmixing (HU) by associating the latent representations with the abundances, the decoder with the mixing model and the encoder with its inverse. AECs are especially appealing for nonlinear HU since they lead to unsupervised and model-free algorithms. However, existing approaches fail to e… ▽ More Autoencoder (AEC) networks have recently emerged as a promising approach to perform unsupervised hyperspectral unmixing (HU) by associating the latent representations with the abundances, the decoder with the mixing model and the encoder with its inverse. AECs are especially appealing for nonlinear HU since they lead to unsupervised and model-free algorithms. However, existing approaches fail to explore the fact that the encoder should invert the mixing process, which might reduce their robustness. In this paper, we propose a model-based AEC for nonlinear HU by considering the mixing model a nonlinear fluctuation over a linear mixture. Differently from previous works, we show that this restriction naturally imposes a particular structure to both the encoder and to the decoder networks. This introduces prior information in the AEC without reducing the flexibility of the mixing model. Simulations with synthetic and real data indicate that the proposed strategy improves nonlinear HU. △ Less

Submitted 16 April, 2021; originally announced April 2021.

Fast Unmixing and Change Detection in Multitemporal Hyperspectral Data

Authors: Ricardo Augusto Borsoi, Tales Imbiriba, José Carlos Moreira Bermudez, Cédric Richard

Abstract: Multitemporal spectral unmixing (SU) is a powerful tool to process hyperspectral image (HI) sequences due to its ability to reveal the evolution of materials over time and space in a scene. However, significant spectral variability is often observed between collection of images due to variations in acquisition or seasonal conditions. This characteristic has to be considered in the design of SU alg… ▽ More Multitemporal spectral unmixing (SU) is a powerful tool to process hyperspectral image (HI) sequences due to its ability to reveal the evolution of materials over time and space in a scene. However, significant spectral variability is often observed between collection of images due to variations in acquisition or seasonal conditions. This characteristic has to be considered in the design of SU algorithms. Because of its good performance, the multiple endmember spectral mixture analysis algorithm (MESMA) has been recently used to perform SU in multitemporal scenarios arising in several practical applications. However, MESMA does not consider the relationship between the different HIs, and its computational complexity is extremely high for large spectral libraries. In this work, we propose an efficient multitemporal SU method that exploits the high temporal correlation between the abundances to provide more accurate results at a lower computational complexity. We propose to solve the complex general multitemporal SU problem by separately addressing the endmember selection and the abundance estimation problems. This leads to a simpler solution without sacrificing the accuracy of the results. We also propose a strategy to detect and address abrupt abundance variations in time. Theoretical results demonstrate how the proposed method compares to MESMA in terms of quality, and how effective it is in detecting abundance changes. This analysis provides valuable insight into the conditions under which the algorithm succeeds. Simulation results show that the proposed method achieves state-of-the-art performance at a smaller computational cost. △ Less

Submitted 9 September, 2021; v1 submitted 6 April, 2021; originally announced April 2021.

Tech Report: A Homogeneity-Based Multiscale Hyperspectral Image Representation for Sparse Spectral Unmixing

Authors: L. C. Ayres, S. J. M. de Almeida, J. C. M. Bermudez, R. A. Borsoi

Abstract: Several approaches have been proposed to solve the spectral unmixing problem in hyperspectral image analysis. Among them the use of sparse regression techniques aims to characterize the abundances in pixels based on a large library of spectral signatures known a priori. Recently, the integration of image spatial-contextual information significantly enhanced the performance of sparse unmixing. In t… ▽ More Several approaches have been proposed to solve the spectral unmixing problem in hyperspectral image analysis. Among them the use of sparse regression techniques aims to characterize the abundances in pixels based on a large library of spectral signatures known a priori. Recently, the integration of image spatial-contextual information significantly enhanced the performance of sparse unmixing. In this work, we propose a computationally efficient multiscale representation method for hyperspectral data adapted to the unmixing problem. The proposed method is based on a hierarchical extension of the SLIC oversegmentation algorithm constructed using a robust homogeneity testing. The image is subdivided into a set of spectrally homogeneous regions formed by pixels with similar characteristics (superpixels). This representation is then used to provide prior spatial regularity information for the abundances of materials present in the scene, improving the conditioning of the unmixing problem. Simulation results illustrate that the method is capable of estimating abundances with high quality and low computational cost, especially in noisy scenarios. △ Less

Submitted 10 February, 2021; originally announced February 2021.

Discovery of the acetyl cation, CH3CO+, in space and in the laboratory

Authors: J. Cernicharo, C. Cabezas, S. Bailleux, L. Margules, R. Motiyenko, L. Zou, Y. Endo, C. Bermudez, M. Agundez, N. Marcelino, B. Lefloch, B. Tercero, P. de Vicente

Abstract: Using the Yebes 40m and IRAM 30m radiotelescopes, we detected two series of harmonically related lines in space that can be fitted to a symmetric rotor. The lines have been seen towards the cold dense cores TMC-1, L483, L1527, and L1544. High level of theory ab initio calculations indicate that the best possible candidate is the acetyl cation, CH3CO+, which is the most stable product resulting fro… ▽ More Using the Yebes 40m and IRAM 30m radiotelescopes, we detected two series of harmonically related lines in space that can be fitted to a symmetric rotor. The lines have been seen towards the cold dense cores TMC-1, L483, L1527, and L1544. High level of theory ab initio calculations indicate that the best possible candidate is the acetyl cation, CH3CO+, which is the most stable product resulting from the protonation of ketene. We have produced this species in the laboratory and observed its rotational transitions Ju = 10 up to Ju = 27. Hence, we report the discovery of CH3CO+ in space based on our observations, theoretical calculations, and laboratory experiments. The derived rotational and distortion constants allow us to predict the spectrum of CH3CO+ with high accuracy up to 500 GHz. We derive an abundance ratio N(H2CCO)/N(CH3CO+) = 44. The high abundance of the protonated form of H2CCO is due to the high proton affinity of the neutral species. The other isomer, H2CCOH+, is found to be 178.9 kJ/mol above CH3CO+. The observed intensity ratio between the K=0 and K=1 lines, 2.2, strongly suggests that the A and E symmetry states have suffered interconversion processes due to collisions with H and/or H2, or during their formation through the reaction of H3+ with H2CCO. △ Less

Submitted 12 January, 2021; originally announced January 2021.

Comments: Accepted for publication in A&A Letters

Journal ref: A&A 646, L7 (2021)

Tentative detection of HC5NH+ in TMC-1

Authors: N. Marcelino, M. Agundez, B. Tercero, C. Cabezas, C. Bermudez, J. D. Gallego, P. de Vicente, J. Cernicharo

Abstract: Using the Yebes 40m radio telescope, we report the detection of a series of seven lines harmonically related with a rotational constant B0=1295.81581 +/- 0.00026 MHz and a distortion constant D0=27.3 +/- 0.5 Hz towards the cold dense cloud TMC-1. Ab initio calculations indicate that the best possible candidates are the cations HC5NH+ and NC4NH+. From a comparison between calculated and observed ro… ▽ More Using the Yebes 40m radio telescope, we report the detection of a series of seven lines harmonically related with a rotational constant B0=1295.81581 +/- 0.00026 MHz and a distortion constant D0=27.3 +/- 0.5 Hz towards the cold dense cloud TMC-1. Ab initio calculations indicate that the best possible candidates are the cations HC5NH+ and NC4NH+. From a comparison between calculated and observed rotational constants and other arguments based on proton affinities and dipole moments, we conclude that the best candidate for a carrier of the observed lines is the protonated cyanodiacetylene cation, HC5NH+. The HC5N/HC5NH+ ratio derived in TMC-1 is 240, which is very similar to the HC3N/HC3NH+ ratio. Results are discussed in the framework of a chemical model for protonated molecules in cold dense clouds. △ Less

Submitted 9 October, 2020; originally announced October 2020.

Comments: Accepted for publication in A&A Letters

Discovery of HC3O+ in space: The chemistry of O-bearing species in TMC-1

Authors: J. Cernicharo, N. Marcelino, M. Agundez, Y. Endo, C. Cabezas, C. Bermudez, B. Tercero, P. de Vicente

Abstract: Using the Yebes 40m and IRAM 30m radio telescopes, we detected a series of harmonically related lines with a rotational constant B0=4460.590 +/- 0.001 MHz and a distortion constant D0=0.511 +/- 0.005 kHz towards the cold dense core TMC-1. High-level-of-theory ab initio calculations indicate that the best possible candidate is protonated tricarbon monoxide, HC3O+. We have succeeded in producing thi… ▽ More Using the Yebes 40m and IRAM 30m radio telescopes, we detected a series of harmonically related lines with a rotational constant B0=4460.590 +/- 0.001 MHz and a distortion constant D0=0.511 +/- 0.005 kHz towards the cold dense core TMC-1. High-level-of-theory ab initio calculations indicate that the best possible candidate is protonated tricarbon monoxide, HC3O+. We have succeeded in producing this species in the laboratory and observed its J = 2-1 and 3-2 rotational transitions. Hence, we report the discovery of HC3O+ in space based on our observations, theoretical calculations, and laboratory experiments. We derive an abundance ratio N(C3O)/N(HC3O+) = 7. The high abundance of the protonated form of C3O is due to the high proton affinity of the neutral species. The chemistry of O-bearing species is modelled, and predictions are compared to the derived abundances from our data for the most prominent O-bearing species in TMC-1. △ Less

Submitted 9 October, 2020; originally announced October 2020.

Comments: Accepted for publication in A&A Letters

Discovery of HC4NC in TMC-1: A study of the isomers of HC3N, HC5N, and HC7N

Authors: J. Cernicharo, N. Marcelino, M. Agundez, C. Bermudez, C. Cabezas, B. Tercero, J. R. Pardo

Abstract: We present a study of the isocyano isomers of the cyanopolyynes HC3N, HC5N, and HC7N in TMC-1 and IRC+10216 carried out with the Yebes 40m radio telescope. This study has enabled us to report the detection, for the first time in space, of HCCCCNC in TMC-1 and to give upper limits for HC6NC in the same source. In addition, the deuterated isotopologues of HCCNC and HNCCC were detected, along with al… ▽ More We present a study of the isocyano isomers of the cyanopolyynes HC3N, HC5N, and HC7N in TMC-1 and IRC+10216 carried out with the Yebes 40m radio telescope. This study has enabled us to report the detection, for the first time in space, of HCCCCNC in TMC-1 and to give upper limits for HC6NC in the same source. In addition, the deuterated isotopologues of HCCNC and HNCCC were detected, along with all 13C substitutions of HCCNC, also for the first time in space. The abundance ratios of HC3N and HC5N, with their isomers, are very different in TMC-1 and IRC+10216, namely, N(HC5N)/N(HC4NC) is 300 and >2100, respectively. We discuss the chemistry of the metastable isomers of cyanopolyynes in terms of the most likely formation pathways and by comparing observational abundance ratios between different sources. △ Less

Submitted 16 September, 2020; originally announced September 2020.

Comments: This article was submitted to A&A on 27/08/2020 and accepted for publication on 11/09/2020

Journal ref: A&A 642, L8 (2020)

Interstellar nitrile anions: Detection of C3N- and C5N- in TMC-1

Authors: J. Cernicharo, N. Marcelino, J. R. Pardo, M. Agundez, B. Tercero, P. de Vicente, C. Cabezas, C. Bermudez

Abstract: We report on the first detection of C3N- and C5N- towards the cold dark core TMC-1 in the Taurus region, using the Yebes 40 m telescope. The observed C3N/C3N- and C5N/C5N- abundance ratios are 140 and 2, respectively; that is similar to those found in the circumstellar envelope of the carbon-rich star IRC+10216. Although the formation mechanisms for the neutrals are different in interstellar (ion-… ▽ More We report on the first detection of C3N- and C5N- towards the cold dark core TMC-1 in the Taurus region, using the Yebes 40 m telescope. The observed C3N/C3N- and C5N/C5N- abundance ratios are 140 and 2, respectively; that is similar to those found in the circumstellar envelope of the carbon-rich star IRC+10216. Although the formation mechanisms for the neutrals are different in interstellar (ion-neutral reactions) and circumstellar clouds (photodissociation and radical-neutral reactions), the similarity of the C3N/C3N- and C5N/C5N- abundance ratios strongly suggests a common chemical path for the formation of these anions in interstellar and circumstellar clouds. We discuss the role of radiative electronic attachment, reactions between N atoms and carbon chain anions Cn-, and that of H- reactions with HC3N and HC5N as possible routes to form CnN-. The detection of C5N- in TMC-1 gives strong support for assigning to this anion the lines found in IRC+10216, as it excludes the possibility of a metal-bearing species, or a vibrationally excited state. New sets of rotational parameters have been derived from the observed frequencies in TMC-1 and IRC+10216 for C5N- and the neutral radical C5N. △ Less

Submitted 7 September, 2020; originally announced September 2020.

Comments: Accepted for publication in A&A Letters

Journal ref: A&A 641, L9 (2020)

Coupled Tensor Decomposition for Hyperspectral and Multispectral Image Fusion with Inter-Image Variability

Authors: Ricardo Augusto Borsoi, Clémence Prévost, Konstantin Usevich, David Brie, José Carlos Moreira Bermudez, Cédric Richard

Abstract: Coupled tensor approximation has recently emerged as a promising approach for the fusion of hyperspectral and multispectral images, reconciling state of the art performance with strong theoretical guarantees. However, tensor-based approaches previously proposed assume that the different observed images are acquired under exactly the same conditions. A recent work proposed to accommodate inter-imag… ▽ More Coupled tensor approximation has recently emerged as a promising approach for the fusion of hyperspectral and multispectral images, reconciling state of the art performance with strong theoretical guarantees. However, tensor-based approaches previously proposed assume that the different observed images are acquired under exactly the same conditions. A recent work proposed to accommodate inter-image spectral variability in the image fusion problem using a matrix factorization-based formulation, but did not account for spatially-localized variations. Moreover, it lacks theoretical guarantees and has a high associated computational complexity. In this paper, we consider the image fusion problem while accounting for both spatially and spectrally localized changes in an additive model. We first study how the general identifiability of the model is impacted by the presence of such changes. Then, assuming that the high-resolution image and the variation factors admit a Tucker decomposition, two new algorithms are proposed -- one purely algebraic, and another based on an optimization procedure. Theoretical guarantees for the exact recovery of the high-resolution image are provided for both algorithms. Experimental results show that the proposed method outperforms state-of-the-art methods in the presence of spectral and spatial variations between the images, at a smaller computational cost. △ Less

Submitted 5 December, 2020; v1 submitted 30 June, 2020; originally announced June 2020.

Online Graph-Based Change Point Detection in Multiband Image Sequences

Authors: Ricardo Augusto Borsoi, Cédric Richard, André Ferrari, Jie Chen, José Carlos Moreira Bermudez

Abstract: The automatic detection of changes or anomalies between multispectral and hyperspectral images collected at different time instants is an active and challenging research topic. To effectively perform change-point detection in multitemporal images, it is important to devise techniques that are computationally efficient for processing large datasets, and that do not require knowledge about the natur… ▽ More The automatic detection of changes or anomalies between multispectral and hyperspectral images collected at different time instants is an active and challenging research topic. To effectively perform change-point detection in multitemporal images, it is important to devise techniques that are computationally efficient for processing large datasets, and that do not require knowledge about the nature of the changes. In this paper, we introduce a novel online framework for detecting changes in multitemporal remote sensing images. Acting on neighboring spectra as adjacent vertices in a graph, this algorithm focuses on anomalies concurrently activating groups of vertices corresponding to compact, well-connected and spectrally homogeneous image regions. It fully benefits from recent advances in graph signal processing to exploit the characteristics of the data that lie on irregular supports. Moreover, the graph is estimated directly from the images using superpixel decomposition algorithms. The learning algorithm is scalable in the sense that it is efficient and spatially distributed. Experiments illustrate the detection and localization performance of the method. △ Less

Submitted 24 June, 2020; originally announced June 2020.

Spectral Variability in Hyperspectral Data Unmixing: A Comprehensive Review

Authors: Ricardo Augusto Borsoi, Tales Imbiriba, José Carlos Moreira Bermudez, Cédric Richard, Jocelyn Chanussot, Lucas Drumetz, Jean-Yves Tourneret, Alina Zare, Christian Jutten

Abstract: The spectral signatures of the materials contained in hyperspectral images, also called endmembers (EM), can be significantly affected by variations in atmospheric, illumination or environmental conditions typically occurring within an image. Traditional spectral unmixing (SU) algorithms neglect the spectral variability of the endmembers, what propagates significant mismodeling errors throughout t… ▽ More The spectral signatures of the materials contained in hyperspectral images, also called endmembers (EM), can be significantly affected by variations in atmospheric, illumination or environmental conditions typically occurring within an image. Traditional spectral unmixing (SU) algorithms neglect the spectral variability of the endmembers, what propagates significant mismodeling errors throughout the whole unmixing process and compromises the quality of its results. Therefore, large efforts have been recently dedicated to mitigate the effects of spectral variability in SU. This resulted in the development of algorithms that incorporate different strategies to allow the EMs to vary within a hyperspectral image, using, for instance, sets of spectral signatures known a priori, Bayesian, parametric, or local EM models. Each of these approaches has different characteristics and underlying motivations. This paper presents a comprehensive literature review contextualizing both classic and recent approaches to solve this problem. We give a detailed evaluation of the sources of spectral variability and their effect in image spectra. Furthermore, we propose a new taxonomy that organizes existing works according to a practitioner's point of view, based on the necessary amount of supervision and on the computational cost they require. We also review methods used to construct spectral libraries (which are required by many SU techniques) based on the observed hyperspectral image, as well as algorithms for library augmentation and reduction. Finally, we conclude the paper with some discussions and an outline of possible future directions for the field. △ Less

Submitted 6 April, 2021; v1 submitted 20 January, 2020; originally announced January 2020.

Comments: Published at the IEEE Geoscience and Remote Sensing Magazine

Kalman Filtering and Expectation Maximization for Multitemporal Spectral Unmixing

Authors: Ricardo Augusto Borsoi, Tales Imbiriba, Pau Closas, José Carlos Moreira Bermudez, Cédric Richard

Abstract: The recent evolution of hyperspectral imaging technology and the proliferation of new emerging applications presses for the processing of multiple temporal hyperspectral images. In this work, we propose a novel spectral unmixing (SU) strategy using physically motivated parametric endmember representations to account for temporal spectral variability. By representing the multitemporal mixing proces… ▽ More The recent evolution of hyperspectral imaging technology and the proliferation of new emerging applications presses for the processing of multiple temporal hyperspectral images. In this work, we propose a novel spectral unmixing (SU) strategy using physically motivated parametric endmember representations to account for temporal spectral variability. By representing the multitemporal mixing process using a state-space formulation, we are able to exploit the Bayesian filtering machinery to estimate the endmember variability coefficients. Moreover, by assuming that the temporal variability of the abundances is small over short intervals, an efficient implementation of the expectation maximization (EM) algorithm is employed to estimate the abundances and the other model parameters. Simulation results indicate that the proposed strategy outperforms state-of-the-art multitemporal SU algorithms. △ Less

Submitted 12 August, 2020; v1 submitted 2 January, 2020; originally announced January 2020.

Deep Learning Captures More Accurate Diffusion Fiber Orientations Distributions than Constrained Spherical Deconvolution

Authors: Vishwesh Nath, Kurt G. Schilling, Colin B. Hansen, Prasanna Parvathaneni, Allison E. Hainline, Camilo Bermudez, Andrew J. Plassard, Vaibhav Janve, Yurui Gao, Justin A. Blaber, Iwona Stępniewska, Adam W. Anderson, Bennett A. Landman

Abstract: Confocal histology provides an opportunity to establish intra-voxel fiber orientation distributions that can be used to quantitatively assess the biological relevance of diffusion weighted MRI models, e.g., constrained spherical deconvolution (CSD). Here, we apply deep learning to investigate the potential of single shell diffusion weighted MRI to explain histologically observed fiber orientation… ▽ More Confocal histology provides an opportunity to establish intra-voxel fiber orientation distributions that can be used to quantitatively assess the biological relevance of diffusion weighted MRI models, e.g., constrained spherical deconvolution (CSD). Here, we apply deep learning to investigate the potential of single shell diffusion weighted MRI to explain histologically observed fiber orientation distributions (FOD) and compare the derived deep learning model with a leading CSD approach. This study (1) demonstrates that there exists additional information in the diffusion signal that is not currently exploited by CSD, and (2) provides an illustrative data-driven model that makes use of this information. △ Less

Submitted 13 November, 2019; originally announced November 2019.

Comments: 2 pages, 4 figures. This work was accepted and published as an abstract at ISMRM 2018 held in Paris, France

Contrast Phase Classification with a Generative Adversarial Network

Authors: Yucheng Tang, Ho Hin Lee, Yuchen Xu, Olivia Tang, Yunqiang Chen, Dashan Gao, Shizhong Han, Riqiang Gao, Camilo Bermudez, Michael R. Savona, Richard G. Abramson, Yuankai Huo, Bennett A. Landman

Abstract: Dynamic contrast enhanced computed tomography (CT) is an imaging technique that provides critical information on the relationship of vascular structure and dynamics in the context of underlying anatomy. A key challenge for image processing with contrast enhanced CT is that phase discrepancies are latent in different tissues due to contrast protocols, vascular dynamics, and metabolism variance. Pre… ▽ More Dynamic contrast enhanced computed tomography (CT) is an imaging technique that provides critical information on the relationship of vascular structure and dynamics in the context of underlying anatomy. A key challenge for image processing with contrast enhanced CT is that phase discrepancies are latent in different tissues due to contrast protocols, vascular dynamics, and metabolism variance. Previous studies with deep learning frameworks have been proposed for classifying contrast enhancement with networks inspired by computer vision. Here, we revisit the challenge in the context of whole abdomen contrast enhanced CTs. To capture and compensate for the complex contrast changes, we propose a novel discriminator in the form of a multi-domain disentangled representation learning network. The goal of this network is to learn an intermediate representation that separates contrast enhancement from anatomy and enables classification of images with varying contrast time. Briefly, our unpaired contrast disentangling GAN(CD-GAN) Discriminator follows the ResNet architecture to classify a CT scan from different enhancement phases. To evaluate the approach, we trained the enhancement phase classifier on 21060 slices from two clinical cohorts of 230 subjects. Testing was performed on 9100 slices from 30 independent subjects who had been imaged with CT scans from all contrast phases. Performance was quantified in terms of the multi-class normalized confusion matrix. The proposed network significantly improved correspondence over baseline UNet, ResNet50 and StarGAN performance of accuracy scores 0.54. 0.55, 0.62 and 0.91, respectively. The proposed discriminator from the disentangled network presents a promising technique that may allow deeper modeling of dynamic imaging against patient specific anatomies. △ Less

Submitted 14 November, 2019; originally announced November 2019.

Comments: 8 pages, 4 figures

Journal ref: SPIE2020

Extracting 2D weak labels from volume labels using multiple instance learning in CT hemorrhage detection

Authors: Samuel W. Remedios, Zihao Wu, Camilo Bermudez, Cailey I. Kerley, Snehashis Roy, Mayur B. Patel, John A. Butman, Bennett A. Landman, Dzung L. Pham

Abstract: Multiple instance learning (MIL) is a supervised learning methodology that aims to allow models to learn instance class labels from bag class labels, where a bag is defined to contain multiple instances. MIL is gaining traction for learning from weak labels but has not been widely applied to 3D medical imaging. MIL is well-suited to clinical CT acquisitions since (1) the highly anisotropic voxels… ▽ More Multiple instance learning (MIL) is a supervised learning methodology that aims to allow models to learn instance class labels from bag class labels, where a bag is defined to contain multiple instances. MIL is gaining traction for learning from weak labels but has not been widely applied to 3D medical imaging. MIL is well-suited to clinical CT acquisitions since (1) the highly anisotropic voxels hinder application of traditional 3D networks and (2) patch-based networks have limited ability to learn whole volume labels. In this work, we apply MIL with a deep convolutional neural network to identify whether clinical CT head image volumes possess one or more large hemorrhages (> 20cm$^3$), resulting in a learned 2D model without the need for 2D slice annotations. Individual image volumes are considered separate bags, and the slices in each volume are instances. Such a framework sets the stage for incorporating information obtained in clinical reports to help train a 2D segmentation approach. Within this context, we evaluate the data requirements to enable generalization of MIL by varying the amount of training data. Our results show that a training size of at least 400 patient image volumes was needed to achieve accurate per-slice hemorrhage detection. Over a five-fold cross-validation, the leading model, which made use of the maximum number of training volumes, had an average true positive rate of 98.10%, an average true negative rate of 99.36%, and an average precision of 0.9698. The models have been made available along with source code to enabled continued exploration and adaption of MIL in CT neuroimaging. △ Less

Submitted 13 November, 2019; originally announced November 2019.

Deep Generative Models for Library Augmentation in Multiple Endmember Spectral Mixture Analysis

Authors: Ricardo Augusto Borsoi, Tales Imbiriba, José Carlos Moreira Bermudez, Cédric Richard

Abstract: Multiple Endmember Spectral Mixture Analysis (MESMA) is one of the leading approaches to perform spectral unmixing (SU) considering variability of the endmembers (EMs). It represents each EM in the image using libraries of spectral signatures acquired a priori. However, existing spectral libraries are often small and unable to properly capture the variability of each EM in practical scenes, which… ▽ More Multiple Endmember Spectral Mixture Analysis (MESMA) is one of the leading approaches to perform spectral unmixing (SU) considering variability of the endmembers (EMs). It represents each EM in the image using libraries of spectral signatures acquired a priori. However, existing spectral libraries are often small and unable to properly capture the variability of each EM in practical scenes, which compromises the performance of MESMA. In this paper, we propose a library augmentation strategy to increase the diversity of existing spectral libraries, thus improving their ability to represent the materials in real images. First, we leverage the power of deep generative models to learn the statistical distribution of the EMs based on the spectral signatures available in the existing libraries. Afterwards, new samples can be drawn from the learned EM distributions and used to augment the spectral libraries, improving the overall quality of the SU process. Experimental results using synthetic and real data attest the superior performance of the proposed method even under library mismatch conditions. △ Less

Submitted 1 July, 2020; v1 submitted 20 September, 2019; originally announced September 2019.

A Blind Multiscale Spatial Regularization Framework for Kernel-based Spectral Unmixing

Authors: Ricardo Augusto Borsoi, Tales Imbiriba, José Carlos Moreira Bermudez, Cédric Richard

Abstract: Introducing spatial prior information in hyperspectral imaging (HSI) analysis has led to an overall improvement of the performance of many HSI methods applied for denoising, classification, and unmixing. Extending such methodologies to nonlinear settings is not always straightforward, specially for unmixing problems where the consideration of spatial relationships between neighboring pixels might… ▽ More Introducing spatial prior information in hyperspectral imaging (HSI) analysis has led to an overall improvement of the performance of many HSI methods applied for denoising, classification, and unmixing. Extending such methodologies to nonlinear settings is not always straightforward, specially for unmixing problems where the consideration of spatial relationships between neighboring pixels might comprise intricate interactions between their fractional abundances and nonlinear contributions. In this paper, we consider a multiscale regularization strategy for nonlinear spectral unmixing with kernels. The proposed methodology splits the unmixing problem into two sub-problems at two different spatial scales: a coarse scale containing low-dimensional structures, and the original fine scale. The coarse spatial domain is defined using superpixels that result from a multiscale transformation. Spectral unmixing is then formulated as the solution of quadratically constrained optimization problems, which are solved efficiently by exploring their strong duality and a reformulation of their dual cost functions in the form of root-finding problems. Furthermore, we employ a theory-based statistical framework to devise a consistent strategy to estimate all required parameters, including both the regularization parameters of the algorithm and the number of superpixels of the transformation, resulting in a truly blind (from the parameters setting perspective) unmixing method. Experimental results attest the superior performance of the proposed method when comparing with other, state-of-the-art, related strategies. △ Less

Submitted 2 March, 2020; v1 submitted 19 August, 2019; originally announced August 2019.

Generalizing Deep Whole Brain Segmentation for Pediatric and Post-Contrast MRI with Augmented Transfer Learning

Authors: Camilo Bermudez, Justin Blaber, Samuel W. Remedios, Jess E. Reynolds, Catherine Lebel, Maureen McHugo, Stephan Heckers, Yuankai Huo, Bennett A. Landman

Abstract: Generalizability is an important problem in deep neural networks, especially in the context of the variability of data acquisition in clinical magnetic resonance imaging (MRI). Recently, the Spatially Localized Atlas Network Tiles (SLANT) approach has been shown to effectively segment whole brain non-contrast T1w MRI with 132 volumetric labels. Enhancing generalizability of SLANT would enable broa… ▽ More Generalizability is an important problem in deep neural networks, especially in the context of the variability of data acquisition in clinical magnetic resonance imaging (MRI). Recently, the Spatially Localized Atlas Network Tiles (SLANT) approach has been shown to effectively segment whole brain non-contrast T1w MRI with 132 volumetric labels. Enhancing generalizability of SLANT would enable broader application of volumetric assessment in multi-site studies. Transfer learning (TL) is commonly used to update the neural network weights for local factors; yet, it is commonly recognized to risk degradation of performance on the original validation/test cohorts. Here, we explore TL by data augmentation to address these concerns in the context of adapting SLANT to anatomical variation and scanning protocol. We consider two datasets: First, we optimize for age with 30 T1w MRI of young children with manually corrected volumetric labels, and accuracy of automated segmentation defined relative to the manually provided truth. Second, we optimize for acquisition with 36 paired datasets of pre- and post-contrast clinically acquired T1w MRI, and accuracy of the post-contrast segmentations assessed relative to the pre-contrast automated assessment. For both studies, we augment the original TL step of SLANT with either only the new data or with both original and new data. Over baseline SLANT, both approaches yielded significantly improved performance (signed rank tests; pediatric: 0.89 vs. 0.82 DSC, p<0.001; contrast: 0.80 vs 0.76, p<0.001). The performance on the original test set decreased with the new-data only transfer learning approach, so data augmentation was superior to strict transfer learning. △ Less

Submitted 13 August, 2019; originally announced August 2019.

Discovery of the first Ca-bearing molecule in space: CaNC

Authors: J. Cernicharo, L. Velilla-Prieto, M. Agúndez, J. R. Pardo, J. P. Fonfría, G. Quintana-Lacaci, C. Cabezas, C. Bermúdez, M. Guélin

Abstract: We report on the detection of calcium isocyanide, CaNC, in the carbon-rich evolved star IRC+10216. We derived a column density for this species of (2.0$\pm$0.5)$\times$10$^{11}$ cm$^{-2}$. Based on the observed line profiles and the modelling of its emission through the envelope, the molecule has to be produced in the intermediate and outer layers of the circumstellar envelope where other metal-is… ▽ More We report on the detection of calcium isocyanide, CaNC, in the carbon-rich evolved star IRC+10216. We derived a column density for this species of (2.0$\pm$0.5)$\times$10$^{11}$ cm$^{-2}$. Based on the observed line profiles and the modelling of its emission through the envelope, the molecule has to be produced in the intermediate and outer layers of the circumstellar envelope where other metal-isocyanides have previously been found in this source. The abundance ratio of CaNC relative to MgNC and FeCN is $\simeq$1/60 and $\simeq$1, respectively. We searched for the species CaF, CaCl, CaC, CaCCH, and CaCH$_3$ for which accurate frequency predictions are available. Only upper limits have been obtained for these molecules. △ Less

Submitted 21 June, 2019; originally announced June 2019.

Comments: 5 pages, 2 figures, accepted for publication in A&A

3D Whole Brain Segmentation using Spatially Localized Atlas Network Tiles

Authors: Yuankai Huo, Zhoubing Xu, Yunxi Xiong, Katherine Aboud, Prasanna Parvathaneni, Shunxing Bao, Camilo Bermudez, Susan M. Resnick, Laurie E. Cutting, Bennett A. Landman

Abstract: Detailed whole brain segmentation is an essential quantitative technique, which provides a non-invasive way of measuring brain regions from a structural magnetic resonance imaging (MRI). Recently, deep convolution neural network (CNN) has been applied to whole brain segmentation. However, restricted by current GPU memory, 2D based methods, downsampling based 3D CNN methods, and patch-based high-re… ▽ More Detailed whole brain segmentation is an essential quantitative technique, which provides a non-invasive way of measuring brain regions from a structural magnetic resonance imaging (MRI). Recently, deep convolution neural network (CNN) has been applied to whole brain segmentation. However, restricted by current GPU memory, 2D based methods, downsampling based 3D CNN methods, and patch-based high-resolution 3D CNN methods have been the de facto standard solutions. 3D patch-based high resolution methods typically yield superior performance among CNN approaches on detailed whole brain segmentation (>100 labels), however, whose performance are still commonly inferior compared with multi-atlas segmentation methods (MAS) due to the following challenges: (1) a single network is typically used to learn both spatial and contextual information for the patches, (2) limited manually traced whole brain volumes are available (typically less than 50) for training a network. In this work, we propose the spatially localized atlas network tiles (SLANT) method to distribute multiple independent 3D fully convolutional networks (FCN) for high-resolution whole brain segmentation. To address the first challenge, multiple spatially distributed networks were used in the SLANT method, in which each network learned contextual information for a fixed spatial location. To address the second challenge, auxiliary labels on 5111 initially unlabeled scans were created by multi-atlas segmentation for training. Since the method integrated multiple traditional medical image processing methods with deep learning, we developed a containerized pipeline to deploy the end-to-end solution. From the results, the proposed method achieved superior performance compared with multi-atlas segmentation methods, while reducing the computational time from >30 hours to 15 minutes (https://github.com/MASILab/SLANTbrainSeg). △ Less

Submitted 28 March, 2019; originally announced March 2019.

Distributed deep learning for robust multi-site segmentation of CT imaging after traumatic brain injury

Authors: Samuel Remedios, Snehashis Roy, Justin Blaber, Camilo Bermudez, Vishwesh Nath, Mayur B. Patel, John A. Butman, Bennett A. Landman, Dzung L. Pham

Abstract: Machine learning models are becoming commonplace in the domain of medical imaging, and with these methods comes an ever-increasing need for more data. However, to preserve patient anonymity it is frequently impractical or prohibited to transfer protected health information (PHI) between institutions. Additionally, due to the nature of some studies, there may not be a large public dataset available… ▽ More Machine learning models are becoming commonplace in the domain of medical imaging, and with these methods comes an ever-increasing need for more data. However, to preserve patient anonymity it is frequently impractical or prohibited to transfer protected health information (PHI) between institutions. Additionally, due to the nature of some studies, there may not be a large public dataset available on which to train models. To address this conundrum, we analyze the efficacy of transferring the model itself in lieu of data between different sites. By doing so we accomplish two goals: 1) the model gains access to training on a larger dataset that it could not normally obtain and 2) the model better generalizes, having trained on data from separate locations. In this paper, we implement multi-site learning with disparate datasets from the National Institutes of Health (NIH) and Vanderbilt University Medical Center (VUMC) without compromising PHI. Three neural networks are trained to convergence on a computed tomography (CT) brain hematoma segmentation task: one only with NIH data,one only with VUMC data, and one multi-site model alternating between NIH and VUMC data. Resultant lesion masks with the multi-site model attain an average Dice similarity coefficient of 0.64 and the automatically segmented hematoma volumes correlate to those done manually with a Pearson correlation coefficient of 0.87,corresponding to an 8% and 5% improvement, respectively, over the single-site model counterparts. △ Less

Submitted 11 March, 2019; originally announced March 2019.

Deep Generative Endmember Modeling: An Application to Unsupervised Spectral Unmixing

Authors: Ricardo Augusto Borsoi, Tales Imbiriba, José Carlos Moreira Bermudez

Abstract: Endmember (EM) spectral variability can greatly impact the performance of standard hyperspectral image analysis algorithms. Extended parametric models have been successfully applied to account for the EM spectral variability. However, these models still lack the compromise between flexibility and low-dimensional representation that is necessary to properly explore the fact that spectral variabilit… ▽ More Endmember (EM) spectral variability can greatly impact the performance of standard hyperspectral image analysis algorithms. Extended parametric models have been successfully applied to account for the EM spectral variability. However, these models still lack the compromise between flexibility and low-dimensional representation that is necessary to properly explore the fact that spectral variability is often confined to a low-dimensional manifold in real scenes. In this paper we propose to learn a spectral variability model directly form the observed data, instead of imposing it \emph{a priori}. This is achieved through a deep generative EM model, which is estimated using a variational autoencoder (VAE). The encoder and decoder that compose the generative model are trained using pure pixel information extracted directly from the observed image, what allows for an unsupervised formulation. The proposed EM model is applied to the solution of a spectral unmixing problem, which we cast as an alternating nonlinear least-squares problem that is solved iteratively with respect to the abundances and to the low-dimensional representations of the EMs in the latent space of the deep generative model. Simulations using both synthetic and real data indicate that the proposed strategy can outperform the competing state-of-the-art algorithms. △ Less

Submitted 21 November, 2019; v1 submitted 14 February, 2019; originally announced February 2019.

Improved Hyperspectral Unmixing With Endmember Variability Parametrized Using an Interpolated Scaling Tensor

Authors: Ricardo Augusto Borsoi, Tales Imbiriba, José Carlos Moreira Bermudez

Abstract: Endmember (EM) variability has an important impact on the performance of hyperspectral image (HI) analysis algorithms. Recently, extended linear mixing models have been proposed to account for EM variability in the spectral unmixing (SU) problem. The direct use of these models has led to severely ill-posed optimization problems. Different regularization strategies have been considered to deal with… ▽ More Endmember (EM) variability has an important impact on the performance of hyperspectral image (HI) analysis algorithms. Recently, extended linear mixing models have been proposed to account for EM variability in the spectral unmixing (SU) problem. The direct use of these models has led to severely ill-posed optimization problems. Different regularization strategies have been considered to deal with this issue, but none so far has consistently exploited the information provided by the existence of multiple pure pixels often present in HIs. In this work, we propose to break the SU problem into a sequence of two problems. First, we use pure pixel information to estimate an interpolated tensor of scaling factors representing spectral variability. This is done by considering the spectral variability to be a smooth function over the HI and confining the energy of the scaling tensor to a low-rank structure. Afterwards, we solve a matrix-factorization problem to estimate the fractional abundances using the variability scaling factors estimated in the previous step, what leads to a significantly more well-posed problem. Simulation swith synthetic and real data attest the effectiveness of the proposed strategy. △ Less

Submitted 2 January, 2019; originally announced January 2019.

Towards Machine Learning Prediction of Deep Brain Stimulation (DBS) Intra-operative Efficacy Maps

Authors: Camilo Bermudez, William Rodriguez, Yuankai Huo, Allison E. Hainline, Rui Li, Robert Shults, Pierre D. DHaese, Peter E. Konrad, Benoit M. Dawant, Bennett A. Landman

Abstract: Deep brain stimulation (DBS) has the potential to improve the quality of life of people with a variety of neurological diseases. A key challenge in DBS is in the placement of a stimulation electrode in the anatomical location that maximizes efficacy and minimizes side effects. Pre-operative localization of the optimal stimulation zone can reduce surgical times and morbidity. Current methods of pro… ▽ More Deep brain stimulation (DBS) has the potential to improve the quality of life of people with a variety of neurological diseases. A key challenge in DBS is in the placement of a stimulation electrode in the anatomical location that maximizes efficacy and minimizes side effects. Pre-operative localization of the optimal stimulation zone can reduce surgical times and morbidity. Current methods of producing efficacy probability maps follow an anatomical guidance on magnetic resonance imaging (MRI) to identify the areas with the highest efficacy in a population. In this work, we propose to revisit this problem as a classification problem, where each voxel in the MRI is a sample informed by the surrounding anatomy. We use a patch-based convolutional neural network to classify a stimulation coordinate as having a positive reduction in symptoms during surgery. We use a cohort of 187 patients with a total of 2,869 stimulation coordinates, upon which 3D patches were extracted and associated with an efficacy score. We compare our results with a registration-based method of surgical planning. We show an improvement in the classification of intraoperative stimulation coordinates as a positive response in reduction of symptoms with AUC of 0.670 compared to a baseline registration-based approach, which achieves an AUC of 0.627 (p < 0.01). Although additional validation is needed, the proposed classification framework and deep learning method appear well-suited for improving pre-surgical planning and personalize treatment strategies. △ Less

Submitted 26 November, 2018; originally announced November 2018.

Comments: Accepted to SPIE: Medical Imaging 2019

Coronary Calcium Detection using 3D Attention Identical Dual Deep Network Based on Weakly Supervised Learning

Authors: Yuankai Huo, James G. Terry, Jiachen Wang, Vishwesh Nath, Camilo Bermudez, Shunxing Bao, Prasanna Parvathaneni, J. Jeffery Carr, Bennett A. Landman

Abstract: Coronary artery calcium (CAC) is biomarker of advanced subclinical coronary artery disease and predicts myocardial infarction and death prior to age 60 years. The slice-wise manual delineation has been regarded as the gold standard of coronary calcium detection. However, manual efforts are time and resource consuming and even impracticable to be applied on large-scale cohorts. In this paper, we pr… ▽ More Coronary artery calcium (CAC) is biomarker of advanced subclinical coronary artery disease and predicts myocardial infarction and death prior to age 60 years. The slice-wise manual delineation has been regarded as the gold standard of coronary calcium detection. However, manual efforts are time and resource consuming and even impracticable to be applied on large-scale cohorts. In this paper, we propose the attention identical dual network (AID-Net) to perform CAC detection using scan-rescan longitudinal non-contrast CT scans with weakly supervised attention by only using per scan level labels. To leverage the performance, 3D attention mechanisms were integrated into the AID-Net to provide complementary information for classification tasks. Moreover, the 3D Gradient-weighted Class Activation Map** (Grad-CAM) was also proposed at the testing stage to interpret the behaviors of the deep neural network. 5075 non-contrast chest CT scans were used as training, validation and testing datasets. Baseline performance was assessed on the same cohort. From the results, the proposed AID-Net achieved the superior performance on classification accuracy (0.9272) and AUC (0.9627). △ Less

Submitted 10 November, 2018; originally announced November 2018.

Comments: Accepted by SPIE medical imaging 2019

Splenomegaly Segmentation on Multi-modal MRI using Deep Convolutional Networks

Authors: Yuankai Huo, Zhoubing Xu, Shunxing Bao, Camilo Bermudez, Hyeonsoo Moon, Prasanna Parvathaneni, Tamara K. Moyo, Michael R. Savona, Albert Assad, Richard G. Abramson, Bennett A. Landman

Abstract: The findings of splenomegaly, abnormal enlargement of the spleen, is a non-invasive clinical biomarker for liver and spleen disease. Automated segmentation methods are essential to efficiently quantify splenomegaly from clinically acquired abdominal magnetic resonance imaging (MRI) scans. However, the task is challenging due to (1) large anatomical and spatial variations of splenomegaly, (2) large… ▽ More The findings of splenomegaly, abnormal enlargement of the spleen, is a non-invasive clinical biomarker for liver and spleen disease. Automated segmentation methods are essential to efficiently quantify splenomegaly from clinically acquired abdominal magnetic resonance imaging (MRI) scans. However, the task is challenging due to (1) large anatomical and spatial variations of splenomegaly, (2) large inter- and intra-scan intensity variations on multi-modal MRI, and (3) limited numbers of labeled splenomegaly scans. In this paper, we propose the Splenomegaly Segmentation Network (SS-Net) to introduce the deep convolutional neural network (DCNN) approaches in multi-modal MRI splenomegaly segmentation. Large convolutional kernel layers were used to address the spatial and anatomical variations, while the conditional generative adversarial networks (GAN) were employed to leverage the segmentation performance of SS-Net in an end-to-end manner. A clinically acquired cohort containing both T1-weighted (T1w) and T2-weighted (T2w) MRI splenomegaly scans was used to train and evaluate the performance of multi-atlas segmentation (MAS), 2D DCNN networks, and a 3D DCNN network. From the experimental results, the DCNN methods achieved superior performance to the state-of-the-art MAS method. The proposed SS-Net method achieved the highest median and mean Dice scores among investigated baseline DCNN methods. △ Less

Submitted 9 November, 2018; originally announced November 2018.

Comments: Accepted by IEEE Transactions on Medical Imaging

Low-Rank Tensor Modeling for Hyperspectral Unmixing Accounting for Spectral Variability

Authors: Tales Imbiriba, Ricardo Augusto Borsoi, José Carlos Moreira Bermudez

Abstract: Traditional hyperspectral unmixing methods neglect the underlying variability of spectral signatures often observed in typical hyperspectral images (HI), propagating these missmodeling errors throughout the whole unmixing process. Attempts to model material spectra as members of sets or as random variables tend to lead to severely ill-posed unmixing problems. Although parametric models have been p… ▽ More Traditional hyperspectral unmixing methods neglect the underlying variability of spectral signatures often observed in typical hyperspectral images (HI), propagating these missmodeling errors throughout the whole unmixing process. Attempts to model material spectra as members of sets or as random variables tend to lead to severely ill-posed unmixing problems. Although parametric models have been proposed to overcome this drawback by handling endmember variability through generalizations of the mixing model, the success of these techniques depend on employing appropriate regularization strategies. Moreover, the existing approaches fail to adequately explore the natural multidimensinal representation of HIs. Recently, tensor-based strategies considered low-rank decompositions of hyperspectral images as an alternative to impose low-dimensional structures on the solutions of standard and multitemporal unmixing problems. These strategies, however, present two main drawbacks: 1) they confine the solutions to low-rank tensors, which often cannot represent the complexity of real-world scenarios; and 2) they lack guarantees that endmembers and abundances will be correctly factorized in their respective tensors. In this work, we propose a more flexible approach, called ULTRA-V, that imposes low-rank structures through regularizations whose strictness is controlled by scalar parameters. Simulations attest the superior accuracy of the method when compared with state-of-the-art unmixing algorithms that account for spectral variability. △ Less

Submitted 23 October, 2019; v1 submitted 2 November, 2018; originally announced November 2018.

Comments: arXiv admin note: substantial text overlap with arXiv:1803.06355

Inter-Scanner Harmonization of High Angular Resolution DW-MRI using Null Space Deep Learning

Authors: Vishwesh Nath, Prasanna Parvathaneni, Colin B. Hansen, Allison E. Hainline, Camilo Bermudez, Samuel Remedios, Justin A. Blaber, Kurt G. Schilling, Ilwoo Lyu, Vaibhav Janve, Yurui Gao, Iwona Stepniewska, Baxter P. Rogers, Allen T. Newton, L. Taylor Davis, Jeff Luci, Adam W. Anderson, Bennett A. Landman

Abstract: Diffusion-weighted magnetic resonance imaging (DW-MRI) allows for non-invasive imaging of the local fiber architecture of the human brain at a millimetric scale. Multiple classical approaches have been proposed to detect both single (e.g., tensors) and multiple (e.g., constrained spherical deconvolution, CSD) fiber population orientations per voxel. However, existing techniques generally exhibit l… ▽ More Diffusion-weighted magnetic resonance imaging (DW-MRI) allows for non-invasive imaging of the local fiber architecture of the human brain at a millimetric scale. Multiple classical approaches have been proposed to detect both single (e.g., tensors) and multiple (e.g., constrained spherical deconvolution, CSD) fiber population orientations per voxel. However, existing techniques generally exhibit low reproducibility across MRI scanners. Herein, we propose a data-driven tech-nique using a neural network design which exploits two categories of data. First, training data were acquired on three squirrel monkey brains using ex-vivo DW-MRI and histology of the brain. Second, repeated scans of human subjects were acquired on two different scanners to augment the learning of the network pro-posed. To use these data, we propose a new network architecture, the null space deep network (NSDN), to simultaneously learn on traditional observed/truth pairs (e.g., MRI-histology voxels) along with repeated observations without a known truth (e.g., scan-rescan MRI). The NSDN was tested on twenty percent of the histology voxels that were kept completely blind to the network. NSDN significantly improved absolute performance relative to histology by 3.87% over CSD and 1.42% over a recently proposed deep neural network approach. More-over, it improved reproducibility on the paired data by 21.19% over CSD and 10.09% over a recently proposed deep approach. Finally, NSDN improved gen-eralizability of the model to a third in vivo human scanner (which was not used in training) by 16.08% over CSD and 10.41% over a recently proposed deep learn-ing approach. This work suggests that data-driven approaches for local fiber re-construction are more reproducible, informative and precise and offers a novel, practical method for determining these models. △ Less

Submitted 9 October, 2018; originally announced October 2018.

Comments: 10 pages, 5 figures

Profiling lung cancer patients using electronic health records

Authors: Ernestina Menasalvas Ruiz, Juan Manuel Tuñas, Guzmán Bermejo, Consuelo Gonzalo Martín, Alejandro Rodríguez-González, Massimiliano Zanin, Cristina González de Pedro, Marta Mendez, Olga Zaretskaia, Jesús Rey, Consuelo Parejo, Juan Luis Cruz Bermudez, Mariano Provencio

Abstract: If Electronic Health Records contain a large amount of information about the patients condition and response to treatment, which can potentially revolutionize the clinical practice, such information is seldom considered due to the complexity of its extraction and analysis. We here report on a first integration of an NLP framework for the analysis of clinical records of lung cancer patients making… ▽ More If Electronic Health Records contain a large amount of information about the patients condition and response to treatment, which can potentially revolutionize the clinical practice, such information is seldom considered due to the complexity of its extraction and analysis. We here report on a first integration of an NLP framework for the analysis of clinical records of lung cancer patients making use of a telephone assistance service of a major Spanish hospital. We specifically show how some relevant data, about patient demographics and health condition, can be extracted; and how some relevant analyses can be performed, aimed at improving the usefulness of the service. We thus demonstrate that the use of EHR texts, and their integration inside a data analysis framework, is technically feasible and worth of further study. △ Less

Submitted 18 September, 2018; originally announced September 2018.

Comments: 14 pages, 12 figures

Journal ref: Journal of Medical Systems (2018) 42:126

Super-Resolution for Hyperspectral and Multispectral Image Fusion Accounting for Seasonal Spectral Variability

Authors: Ricardo Augusto Borsoi, Tales Imbiriba, José Carlos Moreira Bermudez

Abstract: Image fusion combines data from different heterogeneous sources to obtain more precise information about an underlying scene. Hyperspectral-multispectral (HS-MS) image fusion is currently attracting great interest in remote sensing since it allows the generation of high spatial resolution HS images, circumventing the main limitation of this imaging modality. Existing HS-MS fusion algorithms, howev… ▽ More Image fusion combines data from different heterogeneous sources to obtain more precise information about an underlying scene. Hyperspectral-multispectral (HS-MS) image fusion is currently attracting great interest in remote sensing since it allows the generation of high spatial resolution HS images, circumventing the main limitation of this imaging modality. Existing HS-MS fusion algorithms, however, neglect the spectral variability often existing between images acquired at different time instants. This time difference causes variations in spectral signatures of the underlying constituent materials due to different acquisition and seasonal conditions. This paper introduces a novel HS-MS image fusion strategy that combines an unmixing-based formulation with an explicit parametric model for typical spectral variability between the two images. Simulations with synthetic and real data show that the proposed strategy leads to a significant performance improvement under spectral variability and state-of-the-art performance otherwise. △ Less

Submitted 2 July, 2019; v1 submitted 29 August, 2018; originally announced August 2018.

A Data Dependent Multiscale Model for Hyperspectral Unmixing With Spectral Variability

Authors: Ricardo Augusto Borsoi, Tales Imbiriba, José Carlos Moreira Bermudez

Abstract: Spectral variability in hyperspectral images can result from factors including environmental, illumination, atmospheric and temporal changes. Its occurrence may lead to the propagation of significant estimation errors in the unmixing process. To address this issue, extended linear mixing models have been proposed which lead to large scale nonsmooth ill-posed inverse problems. Furthermore, the regu… ▽ More Spectral variability in hyperspectral images can result from factors including environmental, illumination, atmospheric and temporal changes. Its occurrence may lead to the propagation of significant estimation errors in the unmixing process. To address this issue, extended linear mixing models have been proposed which lead to large scale nonsmooth ill-posed inverse problems. Furthermore, the regularization strategies used to obtain meaningful results have introduced interdependencies among abundance solutions that further increase the complexity of the resulting optimization problem. In this paper we present a novel data dependent multiscale model for hyperspectral unmixing accounting for spectral variability. The new method incorporates spatial contextual information to the abundances in extended linear mixing models by using a multiscale transform based on superpixels. The proposed method results in a fast algorithm that solves the abundance estimation problem only once in each scale during each iteration. Simulation results using synthetic and real images compare the performances, both in accuracy and execution time, of the proposed algorithm and other state-of-the-art solutions. △ Less

Submitted 22 January, 2020; v1 submitted 2 August, 2018; originally announced August 2018.

Spatially Localized Atlas Network Tiles Enables 3D Whole Brain Segmentation from Limited Data

Authors: Yuankai Huo, Zhoubing Xu, Katherine Aboud, Prasanna Parvathaneni, Shunxing Bao, Camilo Bermudez, Susan M. Resnick, Laurie E. Cutting, Bennett A. Landman

Abstract: Whole brain segmentation on a structural magnetic resonance imaging (MRI) is essential in non-invasive investigation for neuroanatomy. Historically, multi-atlas segmentation (MAS) has been regarded as the de facto standard method for whole brain segmentation. Recently, deep neural network approaches have been applied to whole brain segmentation by learning random patches or 2D slices. Yet, few pre… ▽ More Whole brain segmentation on a structural magnetic resonance imaging (MRI) is essential in non-invasive investigation for neuroanatomy. Historically, multi-atlas segmentation (MAS) has been regarded as the de facto standard method for whole brain segmentation. Recently, deep neural network approaches have been applied to whole brain segmentation by learning random patches or 2D slices. Yet, few previous efforts have been made on detailed whole brain segmentation using 3D networks due to the following challenges: (1) fitting entire whole brain volume into 3D networks is restricted by the current GPU memory, and (2) the large number of targeting labels (e.g., > 100 labels) with limited number of training 3D volumes (e.g., < 50 scans). In this paper, we propose the spatially localized atlas network tiles (SLANT) method to distribute multiple independent 3D fully convolutional networks to cover overlapped sub-spaces in a standard atlas space. This strategy simplifies the whole brain learning task to localized sub-tasks, which was enabled by combing canonical registration and label fusion techniques with deep learning. To address the second challenge, auxiliary labels on 5111 initially unlabeled scans were created by MAS for pre-training. From empirical validation, the state-of-the-art MAS method achieved mean Dice value of 0.76, 0.71, and 0.68, while the proposed method achieved 0.78, 0.73, and 0.71 on three validation cohorts. Moreover, the computational time reduced from > 30 hours using MAS to ~15 minutes using the proposed method. The source code is available online https://github.com/MASILab/SLANTbrainSeg △ Less

Submitted 5 June, 2018; v1 submitted 1 June, 2018; originally announced June 2018.

Comments: To appear in MICCAI2018

A Low-rank Tensor Regularization Strategy for Hyperspectral Unmixing

Authors: Tales Imbiriba, Ricardo Augusto Borsoi, José Carlos Moreira Bermudez

Abstract: Tensor-based methods have recently emerged as a more natural and effective formulation to address many problems in hyperspectral imaging. In hyperspectral unmixing (HU), low-rank constraints on the abundance maps have been shown to act as a regularization which adequately accounts for the multidimensional structure of the underlying signal. However, imposing a strict low-rank constraint for the ab… ▽ More Tensor-based methods have recently emerged as a more natural and effective formulation to address many problems in hyperspectral imaging. In hyperspectral unmixing (HU), low-rank constraints on the abundance maps have been shown to act as a regularization which adequately accounts for the multidimensional structure of the underlying signal. However, imposing a strict low-rank constraint for the abundance maps does not seem to be adequate, as important information that may be required to represent fine scale abundance behavior may be discarded. This paper introduces a new low-rank tensor regularization that adequately captures the low-rank structure underlying the abundance maps without hindering the flexibility of the solution. Simulation results with synthetic and real data show that the the extra flexibility introduced by the proposed regularization significantly improves the unmixing results. △ Less

Submitted 16 March, 2018; originally announced March 2018.

Learning Implicit Brain MRI Manifolds with Deep Learning

Authors: Camilo Bermudez, Andrew J. Plassard, Larry T. Davis, Allen T. Newton, Susan M Resnick, Bennett A. Landman

Abstract: An important task in image processing and neuroimaging is to extract quantitative information from the acquired images in order to make observations about the presence of disease or markers of development in populations. Having a lowdimensional manifold of an image allows for easier statistical comparisons between groups and the synthesis of group representatives. Previous studies have sought to i… ▽ More An important task in image processing and neuroimaging is to extract quantitative information from the acquired images in order to make observations about the presence of disease or markers of development in populations. Having a lowdimensional manifold of an image allows for easier statistical comparisons between groups and the synthesis of group representatives. Previous studies have sought to identify the best map** of brain MRI to a low-dimensional manifold, but have been limited by assumptions of explicit similarity measures. In this work, we use deep learning techniques to investigate implicit manifolds of normal brains and generate new, high-quality images. We explore implicit manifolds by addressing the problems of image synthesis and image denoising as important tools in manifold learning. First, we propose the unsupervised synthesis of T1-weighted brain MRI using a Generative Adversarial Network (GAN) by learning from 528 examples of 2D axial slices of brain MRI. Synthesized images were first shown to be unique by performing a crosscorrelation with the training set. Real and synthesized images were then assessed in a blinded manner by two imaging experts providing an image quality score of 1-5. The quality score of the synthetic image showed substantial overlap with that of the real images. Moreover, we use an autoencoder with skip connections for image denoising, showing that the proposed method results in higher PSNR than FSL SUSAN after denoising. This work shows the power of artificial networks to synthesize realistic imaging data, which can be used to improve image processing techniques and provide a quantitative framework to structural changes in the brain. △ Less

Submitted 5 January, 2018; originally announced January 2018.

Comments: SPIE Medical Imaging 2018

A Data Colocation Grid Framework for Big Data Medical Image Processing - Backend Design

Authors: Shunxing Bao, Yuankai Huo, Prasanna Parvathaneni, Andrew J. Plassard, Camilo Bermudez, Yuang Yao, Ilwoo Llyu, Aniruddha Gokhale, Bennett A. Landman

Abstract: When processing large medical imaging studies, adopting high performance grid computing resources rapidly becomes important. We recently presented a "medical image processing-as-a-service" grid framework that offers promise in utilizing the Apache Hadoop ecosystem and HBase for data colocation by moving computation close to medical image storage. However, the framework has not yet proven to be eas… ▽ More When processing large medical imaging studies, adopting high performance grid computing resources rapidly becomes important. We recently presented a "medical image processing-as-a-service" grid framework that offers promise in utilizing the Apache Hadoop ecosystem and HBase for data colocation by moving computation close to medical image storage. However, the framework has not yet proven to be easy to use in a heterogeneous hardware environment. Furthermore, the system has not yet validated when considering variety of multi-level analysis in medical imaging. Our target criteria are (1) improving the framework's performance in a heterogeneous cluster, (2) performing population based summary statistics on large datasets, and (3) introducing a table design scheme for rapid NoSQL query. In this paper, we present a backend interface application program interface design for Hadoop & HBase for Medical Image Processing. The API includes: Upload, Retrieve, Remove, Load balancer and MapReduce templates. A dataset summary statistic model is discussed and implemented by MapReduce paradigm. We introduce a HBase table scheme for fast data query to better utilize the MapReduce model. Briefly, 5153 T1 images were retrieved from a university secure database and used to empirically access an in-house grid with 224 heterogeneous CPU cores. Three empirical experiments results are presented and discussed: (1) load balancer wall-time improvement of 1.5-fold compared with a framework with built-in data allocation strategy, (2) a summary statistic model is empirically verified on grid framework and is compared with the cluster when deployed with a standard Sun Grid Engine, which reduces 8-fold of wall clock time and 14-fold of resource time, and (3) the proposed HBase table scheme improves MapReduce computation with 7 fold reduction of wall time compare with a naïve scheme when datasets are relative small. △ Less

Submitted 22 December, 2017; originally announced December 2017.

Comments: Accepted and awaiting publication at SPIE Medical Imaging, International Society for Optics and Photonics, 2018

Opportunities for Mining Radiology Archives for Pediatric Control Images

Authors: Camilo Bermudez, Varvara N Probst, Larry T Davis, Thomas Lasko, Bennett A Landman

Abstract: A large database of brain imaging data from healthy, normal controls is useful to describe physiologic and pathologic structural changes at a population scale. In particular, these data can provide information about structural changes throughout development and aging. However, scarcity of control data as well as technical challenges during imaging acquisition has made it difficult to collect large… ▽ More A large database of brain imaging data from healthy, normal controls is useful to describe physiologic and pathologic structural changes at a population scale. In particular, these data can provide information about structural changes throughout development and aging. However, scarcity of control data as well as technical challenges during imaging acquisition has made it difficult to collect large amounts of data in a healthy pediatric population. In this study, we search the medical record at Vanderbilt University Medical Center for pediatric patients who received brain imaging, either CT or MRI, according to 7 common complaints: headache, seizure, altered level of consciousness, nausea and vomiting, dizziness, head injury, and gait abnormalities in order to find the percent of studies that demonstrated pathologic findings. Using a text-search based algorithm, we show that an average of 59.3% of MRI studies and 37.3% of CT scans are classified as normal, resulting in the production of thousands of normal images. These results suggest there is a wealth of pediatric imaging control data which can be used to create normative descriptions of development as well as to establish biomarkers for disease. △ Less

Submitted 7 December, 2017; originally announced December 2017.

Comments: MASI Brief Report

Tech Report: A Fast Multiscale Spatial Regularization for Sparse Hyperspectral Unmixing

Authors: Ricardo Augusto Borsoi, Tales Imbiriba, José Carlos Moreira Bermudez, Cédric Richard

Abstract: Sparse hyperspectral unmixing from large spectral libraries has been considered to circumvent limitations of endmember extraction algorithms in many applications. This strategy often leads to ill-posed inverse problems, which can benefit from spatial regularization strategies. While existing spatial regularization methods improve the problem conditioning and promote piecewise smooth solutions, the… ▽ More Sparse hyperspectral unmixing from large spectral libraries has been considered to circumvent limitations of endmember extraction algorithms in many applications. This strategy often leads to ill-posed inverse problems, which can benefit from spatial regularization strategies. While existing spatial regularization methods improve the problem conditioning and promote piecewise smooth solutions, they lead to large nonsmooth optimization problems. Thus, efficiently introducing spatial context in the unmixing problem remains a challenge, and a necessity for many real world applications. In this paper, a novel multiscale spatial regularization approach for sparse unmixing is proposed. The method uses a signal-adaptive spatial multiscale decomposition based on superpixels to decompose the unmixing problem into two simpler problems, one in the approximation domain and another in the original domain. Simulation results using both synthetic and real data indicate that the proposed method can outperform state-of-the-art Total Variation-based algorithms with a computation time comparable to that of their unregularized counterparts. △ Less

Submitted 25 October, 2018; v1 submitted 5 December, 2017; originally announced December 2017.

Splenomegaly Segmentation using Global Convolutional Kernels and Conditional Generative Adversarial Networks

Authors: Yuankai Huo, Zhoubing Xu, Shunxing Bao, Camilo Bermudez, Andrew J. Plassard, Jiaqi Liu, Yuang Yao, Albert Assad, Richard G. Abramson, Bennett A. Landman

Abstract: Spleen volume estimation using automated image segmentation technique may be used to detect splenomegaly (abnormally enlarged spleen) on Magnetic Resonance Imaging (MRI) scans. In recent years, Deep Convolutional Neural Networks (DCNN) segmentation methods have demonstrated advantages for abdominal organ segmentation. However, variations in both size and shape of the spleen on MRI images may resul… ▽ More Spleen volume estimation using automated image segmentation technique may be used to detect splenomegaly (abnormally enlarged spleen) on Magnetic Resonance Imaging (MRI) scans. In recent years, Deep Convolutional Neural Networks (DCNN) segmentation methods have demonstrated advantages for abdominal organ segmentation. However, variations in both size and shape of the spleen on MRI images may result in large false positive and false negative labeling when deploying DCNN based methods. In this paper, we propose the Splenomegaly Segmentation Network (SSNet) to address spatial variations when segmenting extraordinarily large spleens. SSNet was designed based on the framework of image-to-image conditional generative adversarial networks (cGAN). Specifically, the Global Convolutional Network (GCN) was used as the generator to reduce false negatives, while the Markovian discriminator (PatchGAN) was used to alleviate false positives. A cohort of clinically acquired 3D MRI scans (both T1 weighted and T2 weighted) from patients with splenomegaly were used to train and test the networks. The experimental results demonstrated that a mean Dice coefficient of 0.9260 and a median Dice coefficient of 0.9262 using SSNet on independently tested MRI volumes of patients with splenomegaly. △ Less

Submitted 1 December, 2017; originally announced December 2017.

Comments: SPIE Medical Imaging 2018

Technical Report: A New Decision-Theory-Based Framework for Echo Canceler Control

Authors: Tales Imbiriba, José Carlos M. Bermudez, Jean-Yves Tourneret, Neil J. Bershad

Abstract: A control logic has a central role in many echo cancellation systems for optimizing the performance of adaptive filters while estimating the echo path. For reliable control, accurate double-talk (DT) and channel change (CC) detectors are usually incorporated to the echo canceler. This work expands the usual detection strategy to define a classification problem characterizing four possible states o… ▽ More A control logic has a central role in many echo cancellation systems for optimizing the performance of adaptive filters while estimating the echo path. For reliable control, accurate double-talk (DT) and channel change (CC) detectors are usually incorporated to the echo canceler. This work expands the usual detection strategy to define a classification problem characterizing four possible states of the echo canceler operation. The new formulation allow the use of decision theory to continuously control the transitions among the different modes of operation. The classification rule reduces to a low cost statistics for which it is possible to determine the probability of error under all hypotheses, allowing the classification performance to be accessed analytically. Monte Carlo simulations using synthetic and real data illustrate the reliability of the proposed method. △ Less

Submitted 29 November, 2017; originally announced November 2017.

Generalized linear mixing model accounting for endmember variability

Authors: Tales Imbiriba, Ricardo Augusto Borsoi, José Carlos Moreira Bermudez

Abstract: Endmember variability is an important factor for accurately unveiling vital information relating the pure materials and their distribution in hyperspectral images. Recently, the extended linear mixing model (ELMM) has been proposed as a modification of the linear mixing model (LMM) to consider endmember variability effects resulting mainly from illumination changes. In this paper, we further gener… ▽ More Endmember variability is an important factor for accurately unveiling vital information relating the pure materials and their distribution in hyperspectral images. Recently, the extended linear mixing model (ELMM) has been proposed as a modification of the linear mixing model (LMM) to consider endmember variability effects resulting mainly from illumination changes. In this paper, we further generalize the ELMM leading to a new model (GLMM) to account for more complex spectral distortions where different wavelength intervals can be affected unevenly. We also extend the existing methodology to jointly estimate the variability and the abundances for the GLMM. Simulations with real and synthetic data show that the unmixing process can benefit from the extra flexibility introduced by the GLMM. △ Less

Submitted 20 October, 2017; originally announced October 2017.

A New Adaptive Video Super-Resolution Algorithm With Improved Robustness to Innovations

Authors: Ricardo Augusto Borsoi, Guilherme Holsbach Costa, José Carlos Moreira Bermudez

Abstract: In this paper, a new video super-resolution reconstruction (SRR) method with improved robustness to outliers is proposed. Although the R-LMS is one of the SRR algorithms with the best reconstruction quality for its computational cost, and is naturally robust to registration inaccuracies, its performance is known to degrade severely in the presence of innovation outliers. By studying the proximal p… ▽ More In this paper, a new video super-resolution reconstruction (SRR) method with improved robustness to outliers is proposed. Although the R-LMS is one of the SRR algorithms with the best reconstruction quality for its computational cost, and is naturally robust to registration inaccuracies, its performance is known to degrade severely in the presence of innovation outliers. By studying the proximal point cost function representation of the R-LMS iterative equation, a better understanding of its performance under different situations is attained. Using statistical properties of typical innovation outliers, a new cost function is then proposed and two new algorithms are derived, which present improved robustness to outliers while maintaining computational costs comparable to that of R-LMS. Monte Carlo simulation results illustrate that the proposed method outperforms the traditional and regularized versions of LMS, and is competitive with state-of-the-art SRR methods at a much smaller computational cost. △ Less

Submitted 17 August, 2018; v1 submitted 14 June, 2017; originally announced June 2017.

Super-Resolution Reconstruction of Electrical Impedance Tomography Images

Authors: Ricardo A. Borsoi, Julio C. C. Aya, Guilherme H. Costa, José C. M. Bermudez

Abstract: Electrical Impedance Tomography (EIT) systems are becoming popular because they present several advantages over competing systems. However, EIT leads to images with very low resolution. Moreover, the nonuniform sampling characteristic of EIT precludes the straightforward application of traditional image ruper-resolution techniques. In this work, we propose a resampling based Super-Resolution metho… ▽ More Electrical Impedance Tomography (EIT) systems are becoming popular because they present several advantages over competing systems. However, EIT leads to images with very low resolution. Moreover, the nonuniform sampling characteristic of EIT precludes the straightforward application of traditional image ruper-resolution techniques. In this work, we propose a resampling based Super-Resolution method for EIT image quality improvement. Preliminary results show that the proposed technique can lead to substantial improvements in EIT image resolution, making it more competitive with other technologies. △ Less

Submitted 15 May, 2018; v1 submitted 30 December, 2016; originally announced January 2017.

Technical Report: Band selection for nonlinear unmixing of hyperspectral images as a maximal clique problem

Authors: Tales Imbiriba, José Carlos Moreira Bermudez, Cédric Richard

Abstract: Kernel-based nonlinear mixing models have been applied to unmix spectral information of hyperspectral images when the type of mixing occurring in the scene is too complex or unknown. Such methods, however, usually require the inversion of matrices of sizes equal to the number of spectral bands. Reducing the computational load of these methods remains a challenge in large scale applications. This p… ▽ More Kernel-based nonlinear mixing models have been applied to unmix spectral information of hyperspectral images when the type of mixing occurring in the scene is too complex or unknown. Such methods, however, usually require the inversion of matrices of sizes equal to the number of spectral bands. Reducing the computational load of these methods remains a challenge in large scale applications. This paper proposes a centralized method for band selection (BS) in the reproducing kernel Hilbert space (RKHS). It is based upon the coherence criterion, which sets the largest value allowed for correlations between the basis kernel functions characterizing the unmixing model. We show that the proposed BS approach is equivalent to solving a maximum clique problem (MCP), that is, searching for the biggest complete subgraph in a graph. Furthermore, we devise a strategy for selecting the coherence threshold and the Gaussian kernel bandwidth using coherence bounds for linearly independent bases. Simulation results illustrate the efficiency of the proposed method. △ Less

Submitted 19 September, 2016; v1 submitted 1 March, 2016; originally announced March 2016.