Showing 1–30 of 30 results for author: Bruzzone, L

Local-to-Global Cross-Modal Attention-Aware Fusion for HSI-X Semantic Segmentation

Authors: Xuming Zhang, Naoto Yokoya, Xingfa Gu, Qingjiu Tian, Lorenzo Bruzzone

Abstract: Hyperspectral image (HSI) classification has recently reached its performance bottleneck. Multimodal data fusion is emerging as a promising approach to overcome this bottleneck by providing rich complementary information from the supplementary modality (X-modality). However, achieving comprehensive cross-modal interaction and fusion that can be generalized across different sensing modalities is ch… ▽ More Hyperspectral image (HSI) classification has recently reached its performance bottleneck. Multimodal data fusion is emerging as a promising approach to overcome this bottleneck by providing rich complementary information from the supplementary modality (X-modality). However, achieving comprehensive cross-modal interaction and fusion that can be generalized across different sensing modalities is challenging due to the disparity in imaging sensors, resolution, and content of different modalities. In this study, we propose a Local-to-Global Cross-modal Attention-aware Fusion (LoGoCAF) framework for HSI-X classification that jointly considers efficiency, accuracy, and generalizability. LoGoCAF adopts a pixel-to-pixel two-branch semantic segmentation architecture to learn information from HSI and X modalities. The pipeline of LoGoCAF consists of a local-to-global encoder and a lightweight multilayer perceptron (MLP) decoder. In the encoder, convolutions are used to encode local and high-resolution fine details in shallow layers, while transformers are used to integrate global and low-resolution coarse features in deeper layers. The MLP decoder aggregates information from the encoder for feature fusion and prediction. In particular, two cross-modality modules, the feature enhancement module (FEM) and the feature interaction and fusion module (FIFM), are introduced in each encoder stage. The FEM is used to enhance complementary information by combining the feature from the other modality across direction-aware, position-sensitive, and channel-wise dimensions. With the enhanced features, the FIFM is designed to promote cross-modality information interaction and fusion for the final semantic prediction. Extensive experiments demonstrate that our LoGoCAF achieves superior performance and generalizes well. The code will be made publicly available. △ Less

Submitted 25 June, 2024; originally announced June 2024.

OBSUM: An object-based spatial unmixing model for spatiotemporal fusion of remote sensing images

Authors: Houcai Guo, Dingqi Ye, Lorenzo Bruzzone

Abstract: Spatiotemporal fusion aims to improve both the spatial and temporal resolution of remote sensing images, thus facilitating time-series analysis at a fine spatial scale. However, there are several important issues that limit the application of current spatiotemporal fusion methods. First, most spatiotemporal fusion methods are based on pixel-level computation, which neglects the valuable object-lev… ▽ More Spatiotemporal fusion aims to improve both the spatial and temporal resolution of remote sensing images, thus facilitating time-series analysis at a fine spatial scale. However, there are several important issues that limit the application of current spatiotemporal fusion methods. First, most spatiotemporal fusion methods are based on pixel-level computation, which neglects the valuable object-level information of the land surface. Moreover, many existing methods cannot accurately retrieve strong temporal changes between the available high-resolution image at base date and the predicted one. This study proposes an Object-Based Spatial Unmixing Model (OBSUM), which incorporates object-based image analysis and spatial unmixing, to overcome the two abovementioned problems. OBSUM consists of one preprocessing step and three fusion steps, i.e., object-level unmixing, object-level residual compensation, and pixel-level residual compensation. OBSUM can be applied using only one fine image at the base date and one coarse image at the prediction date, without the need of a coarse image at the base date. The performance of OBSUM was compared with five representative spatiotemporal fusion methods. The experimental results demonstrated that OBSUM outperformed other methods in terms of both accuracy indices and visual effects over time-series. Furthermore, OBSUM also achieved satisfactory results in two typical remote sensing applications. Therefore, it has great potential to generate accurate and high-resolution time-series observations for supporting various remote sensing applications. △ Less

Submitted 14 October, 2023; originally announced October 2023.

Journal ref: Remote Sensing of Environment, 304, 2024, 114046

Adapting Segment Anything Model for Change Detection in HR Remote Sensing Images

Authors: Lei Ding, Kun Zhu, Daifeng Peng, Hao Tang, Kuiwu Yang, Lorenzo Bruzzone

Abstract: Vision Foundation Models (VFMs) such as the Segment Anything Model (SAM) allow zero-shot or interactive segmentation of visual contents, thus they are quickly applied in a variety of visual scenes. However, their direct use in many Remote Sensing (RS) applications is often unsatisfactory due to the special imaging characteristics of RS images. In this work, we aim to utilize the strong visual reco… ▽ More Vision Foundation Models (VFMs) such as the Segment Anything Model (SAM) allow zero-shot or interactive segmentation of visual contents, thus they are quickly applied in a variety of visual scenes. However, their direct use in many Remote Sensing (RS) applications is often unsatisfactory due to the special imaging characteristics of RS images. In this work, we aim to utilize the strong visual recognition capabilities of VFMs to improve the change detection of high-resolution Remote Sensing Images (RSIs). We employ the visual encoder of FastSAM, an efficient variant of the SAM, to extract visual representations in RS scenes. To adapt FastSAM to focus on some specific ground objects in the RS scenes, we propose a convolutional adaptor to aggregate the task-oriented change information. Moreover, to utilize the semantic representations that are inherent to SAM features, we introduce a task-agnostic semantic learning branch to model the semantic latent in bi-temporal RSIs. The resulting method, SAMCD, obtains superior accuracy compared to the SOTA methods and exhibits a sample-efficient learning ability that is comparable to semi-supervised CD methods. To the best of our knowledge, this is the first work that adapts VFMs for the CD of HR RSIs. △ Less

Submitted 25 January, 2024; v1 submitted 4 September, 2023; originally announced September 2023.

Incomplete Multimodal Learning for Remote Sensing Data Fusion

Authors: Yuxing Chen, Maofan Zhao, Lorenzo Bruzzone

Abstract: The mechanism of connecting multimodal signals through self-attention operation is a key factor in the success of multimodal Transformer networks in remote sensing data fusion tasks. However, traditional approaches assume access to all modalities during both training and inference, which can lead to severe degradation when dealing with modal-incomplete inputs in downstream applications. To address… ▽ More The mechanism of connecting multimodal signals through self-attention operation is a key factor in the success of multimodal Transformer networks in remote sensing data fusion tasks. However, traditional approaches assume access to all modalities during both training and inference, which can lead to severe degradation when dealing with modal-incomplete inputs in downstream applications. To address this limitation, our proposed approach introduces a novel model for incomplete multimodal learning in the context of remote sensing data fusion. This approach can be used in both supervised and self-supervised pretraining paradigms and leverages the additional learned fusion tokens in combination with Bi-LSTM attention and masked self-attention mechanisms to collect multimodal signals. The proposed approach employs reconstruction and contrastive loss to facilitate fusion in pre-training while allowing for random modality combinations as inputs in network training. Our approach delivers state-of-the-art performance on two multimodal datasets for tasks such as building instance / semantic segmentation and land-cover map** tasks when dealing with incomplete inputs during inference. △ Less

Submitted 22 April, 2023; originally announced April 2023.

Unsupervised CD in satellite image time series by contrastive learning and feature tracking

Authors: Yuxing Chen, Lorenzo Bruzzone

Abstract: While unsupervised change detection using contrastive learning has been significantly improved the performance of literature techniques, at present, it only focuses on the bi-temporal change detection scenario. Previous state-of-the-art models for image time-series change detection often use features obtained by learning for clustering or training a model from scratch using pseudo labels tailored… ▽ More While unsupervised change detection using contrastive learning has been significantly improved the performance of literature techniques, at present, it only focuses on the bi-temporal change detection scenario. Previous state-of-the-art models for image time-series change detection often use features obtained by learning for clustering or training a model from scratch using pseudo labels tailored to each scene. However, these approaches fail to exploit the spatial-temporal information of image time-series or generalize to unseen scenarios. In this work, we propose a two-stage approach to unsupervised change detection in satellite image time-series using contrastive learning with feature tracking. By deriving pseudo labels from pre-trained models and using feature tracking to propagate them among the image time-series, we improve the consistency of our pseudo labels and address the challenges of seasonal changes in long-term remote sensing image time-series. We adopt the self-training algorithm with ConvLSTM on the obtained pseudo labels, where we first use supervised contrastive loss and contrastive random walks to further improve the feature correspondence in space-time. Then a fully connected layer is fine-tuned on the pre-trained multi-temporal features for generating the final change maps. Through comprehensive experiments on two datasets, we demonstrate consistent improvements in accuracy on fitting and inference scenarios. △ Less

Submitted 22 April, 2023; originally announced April 2023.

Jupiter Science Enabled by ESA's Jupiter Icy Moons Explorer

Authors: Leigh N. Fletcher, Thibault Cavalié, Davide Grassi, Ricardo Hueso, Luisa M. Lara, Yohai Kaspi, Eli Galanti, Thomas K. Greathouse, Philippa M. Molyneux, Marina Galand, Claire Vallat, Olivier Witasse, Rosario Lorente, Paul Hartogh, François Poulet, Yves Langevin, Pasquale Palumbo, G. Randall Gladstone, Kurt D. Retherford, Michele K. Dougherty, Jan-Erik Wahlund, Stas Barabash, Luciano Iess, Lorenzo Bruzzone, Hauke Hussmann , et al. (25 additional authors not shown)

Abstract: ESA's Jupiter Icy Moons Explorer (JUICE) will provide a detailed investigation of the Jovian system in the 2030s, combining a suite of state-of-the-art instruments with an orbital tour tailored to maximise observing opportunities. We review the Jupiter science enabled by the JUICE mission, building on the legacy of discoveries from the Galileo, Cassini, and Juno missions, alongside ground- and spa… ▽ More ESA's Jupiter Icy Moons Explorer (JUICE) will provide a detailed investigation of the Jovian system in the 2030s, combining a suite of state-of-the-art instruments with an orbital tour tailored to maximise observing opportunities. We review the Jupiter science enabled by the JUICE mission, building on the legacy of discoveries from the Galileo, Cassini, and Juno missions, alongside ground- and space-based observatories. We focus on remote sensing of the climate, meteorology, and chemistry of the atmosphere and auroras from the cloud-forming weather layer, through the upper troposphere, into the stratosphere and ionosphere. The Jupiter orbital tour provides a wealth of opportunities for atmospheric and auroral science: global perspectives with its near-equatorial and inclined phases, sampling all phase angles from dayside to nightside, and investigating phenomena evolving on timescales from minutes to months. The remote sensing payload spans far-UV spectroscopy (50-210 nm), visible imaging (340-1080 nm), visible/near-infrared spectroscopy (0.49-5.56 $μ$m), and sub-millimetre sounding (near 530-625\,GHz and 1067-1275\,GHz). This is coupled to radio, stellar, and solar occultation opportunities to explore the atmosphere at high vertical resolution; and radio and plasma wave measurements of electric discharges in the Jovian atmosphere and auroras. Cross-disciplinary scientific investigations enable JUICE to explore coupling processes in giant planet atmospheres, to show how the atmosphere is connected to (i) the deep circulation and composition of the hydrogen-dominated interior; and (ii) to the currents and charged particle environments of the external magnetosphere. JUICE will provide a comprehensive characterisation of the atmosphere and auroras of this archetypal giant planet. △ Less

Submitted 26 October, 2023; v1 submitted 20 April, 2023; originally announced April 2023.

Comments: 83 pages, 24 figures, accepted to Space Science Reviews special issue on ESA's JUICE mission

Journal ref: Space Sci Rev. 2023; 219(7): 53

Joint Spatio-Temporal Modeling for the Semantic Change Detection in Remote Sensing Images

Authors: Lei Ding, **g Zhang, Kai Zhang, Haitao Guo, Bing Liu, Lorenzo Bruzzone

Abstract: Semantic Change Detection (SCD) refers to the task of simultaneously extracting the changed areas and the semantic categories (before and after the changes) in Remote Sensing Images (RSIs). This is more meaningful than Binary Change Detection (BCD) since it enables detailed change analysis in the observed areas. Previous works established triple-branch Convolutional Neural Network (CNN) architectu… ▽ More Semantic Change Detection (SCD) refers to the task of simultaneously extracting the changed areas and the semantic categories (before and after the changes) in Remote Sensing Images (RSIs). This is more meaningful than Binary Change Detection (BCD) since it enables detailed change analysis in the observed areas. Previous works established triple-branch Convolutional Neural Network (CNN) architectures as the paradigm for SCD. However, it remains challenging to exploit semantic information with a limited amount of change samples. In this work, we investigate to jointly consider the spatio-temporal dependencies to improve the accuracy of SCD. First, we propose a Semantic Change Transformer (SCanFormer) to explicitly model the 'from-to' semantic transitions between the bi-temporal RSIs. Then, we introduce a semantic learning scheme to leverage the spatio-temporal constraints, which are coherent to the SCD task, to guide the learning of semantic changes. The resulting network (SCanNet) significantly outperforms the baseline method in terms of both detection of critical semantic changes and semantic consistency in the obtained bi-temporal results. It achieves the SOTA accuracy on two benchmark datasets for the SCD. △ Less

Submitted 18 April, 2023; v1 submitted 10 December, 2022; originally announced December 2022.

Bi-Temporal Semantic Reasoning for the Semantic Change Detection in HR Remote Sensing Images

Authors: Lei Ding, Haitao Guo, Sicong Liu, Lichao Mou, **g Zhang, Lorenzo Bruzzone

Abstract: Semantic change detection (SCD) extends the multi-class change detection (MCD) task to provide not only the change locations but also the detailed land-cover/land-use (LCLU) categories before and after the observation intervals. This fine-grained semantic change information is very useful in many applications. Recent studies indicate that the SCD can be modeled through a triple-branch Convolutiona… ▽ More Semantic change detection (SCD) extends the multi-class change detection (MCD) task to provide not only the change locations but also the detailed land-cover/land-use (LCLU) categories before and after the observation intervals. This fine-grained semantic change information is very useful in many applications. Recent studies indicate that the SCD can be modeled through a triple-branch Convolutional Neural Network (CNN), which contains two temporal branches and a change branch. However, in this architecture, the communications between the temporal branches and the change branch are insufficient. To overcome the limitations in existing methods, we propose a novel CNN architecture for the SCD, where the semantic temporal features are merged in a deep CD unit. Furthermore, we elaborate on this architecture to reason the bi-temporal semantic correlations. The resulting Bi-temporal Semantic Reasoning Network (Bi-SRNet) contains two types of semantic reasoning blocks to reason both single-temporal and cross-temporal semantic correlations, as well as a novel loss function to improve the semantic consistency of change detection results. Experimental results on a benchmark dataset show that the proposed architecture obtains significant accuracy improvements over the existing approaches, while the added designs in the Bi-SRNet further improves the segmentation of both semantic categories and the changed areas. The codes in this paper are accessible at: github.com/ggsDing/Bi-SRNet. △ Less

Submitted 5 January, 2022; v1 submitted 13 August, 2021; originally announced August 2021.

Comments: Manuscript to IEEE TGRS

Looking Outside the Window: Wide-Context Transformer for the Semantic Segmentation of High-Resolution Remote Sensing Images

Authors: Lei Ding, Dong Lin, Shaofu Lin, **g Zhang, Xiaojie Cui, Yuebin Wang, Hao Tang, Lorenzo Bruzzone

Abstract: Long-range contextual information is crucial for the semantic segmentation of High-Resolution (HR) Remote Sensing Images (RSIs). However, image crop** operations, commonly used for training neural networks, limit the perception of long-range contexts in large RSIs. To overcome this limitation, we propose a Wide-Context Network (WiCoNet) for the semantic segmentation of HR RSIs. Apart from extrac… ▽ More Long-range contextual information is crucial for the semantic segmentation of High-Resolution (HR) Remote Sensing Images (RSIs). However, image crop** operations, commonly used for training neural networks, limit the perception of long-range contexts in large RSIs. To overcome this limitation, we propose a Wide-Context Network (WiCoNet) for the semantic segmentation of HR RSIs. Apart from extracting local features with a conventional CNN, the WiCoNet has an extra context branch to aggregate information from a larger image area. Moreover, we introduce a Context Transformer to embed contextual information from the context branch and selectively project it onto the local features. The Context Transformer extends the Vision Transformer, an emerging kind of neural network, to model the dual-branch semantic correlations. It overcomes the locality limitation of CNNs and enables the WiCoNet to see the bigger picture before segmenting the land-cover/land-use (LCLU) classes. Ablation studies and comparative experiments conducted on several benchmark datasets demonstrate the effectiveness of the proposed method. In addition, we present a new Bei**g Land-Use (BLU) dataset. This is a large-scale HR satellite dataset with high-quality and fine-grained reference labels, which can facilitate future studies in this field. △ Less

Submitted 19 April, 2022; v1 submitted 29 June, 2021; originally announced June 2021.

Self-supervised Remote Sensing Images Change Detection at Pixel-level

Authors: Yuxing Chen, Lorenzo Bruzzone

Abstract: Deep learning techniques have achieved great success in remote sensing image change detection. Most of them are supervised techniques, which usually require large amounts of training data and are limited to a particular application. Self-supervised methods as an unsupervised approach are popularly used to solve this problem and are widely used in unsupervised binary change detection tasks. However… ▽ More Deep learning techniques have achieved great success in remote sensing image change detection. Most of them are supervised techniques, which usually require large amounts of training data and are limited to a particular application. Self-supervised methods as an unsupervised approach are popularly used to solve this problem and are widely used in unsupervised binary change detection tasks. However, the existing self-supervised methods in change detection are based on pre-tasks or at patch-level, which may be sub-optimal for pixel-wise change detection tasks. Therefore, in this work, a pixel-wise contrastive approach is proposed to overcome this limitation. This is achieved by using contrastive loss in pixel-level features on an unlabeled multi-view setting. In this approach, a Siamese ResUnet is trained to obtain pixel-wise representations and to align features from shifted positive pairs. Meanwhile, vector quantization is used to augment the learned features in two branches. The final binary change map is obtained by subtracting features of one branch from features of the other branch and using the Rosin thresholding method. To overcome the effects of regular seasonal changes in binary change maps, we also used an uncertainty method to enhance the temporal robustness of the proposed approach. Two homogeneous (OSCD and MUDS) datasets and one heterogeneous (California Flood) dataset are used to evaluate the performance of the proposed approach. Results demonstrate improvements in both efficiency and accuracy over the patch-wise multi-view contrastive method. △ Less

Submitted 8 October, 2021; v1 submitted 18 May, 2021; originally announced May 2021.

Recent Advances in Domain Adaptation for the Classification of Remote Sensing Data

Authors: Devis Tuia, Claudio Persello, Lorenzo Bruzzone

Abstract: The success of supervised classification of remotely sensed images acquired over large geographical areas or at short time intervals strongly depends on the representativity of the samples used to train the classification algorithm and to define the model. When training samples are collected from an image (or a spatial region) different from the one used for map**, spectral shifts between the tw… ▽ More The success of supervised classification of remotely sensed images acquired over large geographical areas or at short time intervals strongly depends on the representativity of the samples used to train the classification algorithm and to define the model. When training samples are collected from an image (or a spatial region) different from the one used for map**, spectral shifts between the two distributions are likely to make the model fail. Such shifts are generally due to differences in acquisition and atmospheric conditions or to changes in the nature of the object observed. In order to design classification methods that are robust to data-set shifts, recent remote sensing literature has considered solutions based on domain adaptation (DA) approaches. Inspired by machine learning literature, several DA methods have been proposed to solve specific problems in remote sensing data classification. This paper provides a critical review of the recent advances in DA for remote sensing and presents an overview of methods divided into four categories: i) invariant feature selection; ii) representation matching; iii) adaptation of classifiers and iv) selective sampling. We provide an overview of recent methodologies, as well as examples of application of the considered techniques to real remote sensing images characterized by very high spatial and spectral resolution. Finally, we propose guidelines to the selection of the method to use in real application scenarios. △ Less

Submitted 15 April, 2021; originally announced April 2021.

Journal ref: IEEE Geoscience and Remote Sensing Magazine, 4(2): 41-57, 2016

Robust Registration of Multimodal Remote Sensing Images Based on Structural Similarity

Authors: Yuanxin Ye, Jie Shan, Lorenzo Bruzzone, Li Shen

Abstract: Automatic registration of multimodal remote sensing data (e.g., optical, LiDAR, SAR) is a challenging task due to the significant non-linear radiometric differences between these data. To address this problem, this paper proposes a novel feature descriptor named the Histogram of Orientated Phase Congruency (HOPC), which is based on the structural properties of images. Furthermore, a similarity met… ▽ More Automatic registration of multimodal remote sensing data (e.g., optical, LiDAR, SAR) is a challenging task due to the significant non-linear radiometric differences between these data. To address this problem, this paper proposes a novel feature descriptor named the Histogram of Orientated Phase Congruency (HOPC), which is based on the structural properties of images. Furthermore, a similarity metric named HOPCncc is defined, which uses the normalized correlation coefficient (NCC) of the HOPC descriptors for multimodal registration. In the definition of the proposed similarity metric, we first extend the phase congruency model to generate its orientation representation, and use the extended model to build HOPCncc. Then a fast template matching scheme for this metric is designed to detect the control points between images. The proposed HOPCncc aims to capture the structural similarity between images, and has been tested with a variety of optical, LiDAR, SAR and map data. The results show that HOPCncc is robust against complex non-linear radiometric differences and outperforms the state-of-the-art similarities metrics (i.e., NCC and mutual information) in matching performance. Moreover, a robust registration method is also proposed in this paper based on HOPCncc, which is evaluated using six pairs of multimodal remote sensing images. The experimental results demonstrate the effectiveness of the proposed method for multimodal image registration. △ Less

Submitted 31 March, 2021; originally announced March 2021.

Deep Reinforcement Learning for Band Selection in Hyperspectral Image Classification

Authors: Lichao Mou, Sudipan Saha, Yuansheng Hua, Francesca Bovolo, Lorenzo Bruzzone, Xiao Xiang Zhu

Abstract: Band selection refers to the process of choosing the most relevant bands in a hyperspectral image. By selecting a limited number of optimal bands, we aim at speeding up model training, improving accuracy, or both. It reduces redundancy among spectral bands while trying to preserve the original information of the image. By now many efforts have been made to develop unsupervised band selection appro… ▽ More Band selection refers to the process of choosing the most relevant bands in a hyperspectral image. By selecting a limited number of optimal bands, we aim at speeding up model training, improving accuracy, or both. It reduces redundancy among spectral bands while trying to preserve the original information of the image. By now many efforts have been made to develop unsupervised band selection approaches, of which the majority are heuristic algorithms devised by trial and error. In this paper, we are interested in training an intelligent agent that, given a hyperspectral image, is capable of automatically learning policy to select an optimal band subset without any hand-engineered reasoning. To this end, we frame the problem of unsupervised band selection as a Markov decision process, propose an effective method to parameterize it, and finally solve the problem by deep reinforcement learning. Once the agent is trained, it learns a band-selection policy that guides the agent to sequentially select bands by fully exploiting the hyperspectral image and previously picked bands. Furthermore, we propose two different reward schemes for the environment simulation of deep reinforcement learning and compare them in experiments. This, to the best of our knowledge, is the first study that explores a deep reinforcement learning model for hyperspectral image analysis, thus opening a new door for future research and showcasing the great potential of deep reinforcement learning in remote sensing applications. Extensive experiments are carried out on four hyperspectral data sets, and experimental results demonstrate the effectiveness of the proposed method. △ Less

Submitted 15 March, 2021; originally announced March 2021.

Self-supervised Change Detection in Multi-view Remote Sensing Images

Authors: Yuxing Chen, Lorenzo Bruzzone

Abstract: The vast amount of unlabeled multi-temporal and multi-sensor remote sensing data acquired by the many Earth Observation satellites present a challenge for change detection. Recently, many generative model-based methods have been proposed for remote sensing image change detection on such unlabeled data. However, the high diversities in the learned features weaken the discrimination of the relevant… ▽ More The vast amount of unlabeled multi-temporal and multi-sensor remote sensing data acquired by the many Earth Observation satellites present a challenge for change detection. Recently, many generative model-based methods have been proposed for remote sensing image change detection on such unlabeled data. However, the high diversities in the learned features weaken the discrimination of the relevant change indicators in unsupervised change detection tasks. Moreover, these methods lack research on massive archived images. In this work, a self-supervised change detection approach based on an unlabeled multi-view setting is proposed to overcome this limitation. This is achieved by the use of a multi-view contrastive loss and an implicit contrastive strategy in the feature alignment between multi-view images. In this approach, a pseudo-Siamese network is trained to regress the output between its two branches pre-trained in a contrastive way on a large dataset of multi-temporal homogeneous or heterogeneous image patches. Finally, the feature distance between the outputs of the two branches is used to define a change measure, which can be analyzed by thresholding to get the final binary change map. Experiments are carried out on five homogeneous and heterogeneous remote sensing image datasets. The proposed SSL approach is compared with other supervised and unsupervised state-of-the-art change detection methods. Results demonstrate both improvements over state-of-the-art unsupervised methods and that the proposed SSL approach narrows the gap between unsupervised and supervised change detection. △ Less

Submitted 10 March, 2021; originally announced March 2021.

Comments: submitted to TGRS

Self-supervised SAR-optical Data Fusion and Land-cover Map** using Sentinel-1/-2 Images

Authors: Yuxing Chen, Lorenzo Bruzzone

Abstract: The effective combination of the complementary information provided by the huge amount of unlabeled multi-sensor data (e.g., Synthetic Aperture Radar (SAR) and optical images) is a critical topic in remote sensing. Recently, contrastive learning methods have reached remarkable success in obtaining meaningful feature representations from multi-view data. However, these methods only focus on image-l… ▽ More The effective combination of the complementary information provided by the huge amount of unlabeled multi-sensor data (e.g., Synthetic Aperture Radar (SAR) and optical images) is a critical topic in remote sensing. Recently, contrastive learning methods have reached remarkable success in obtaining meaningful feature representations from multi-view data. However, these methods only focus on image-level features, which may not satisfy the requirement for dense prediction tasks such as land-cover map**. In this work, we propose a self-supervised framework for SAR-optical data fusion and land-cover map** tasks. SAR and optical images are fused by using multi-view contrastive loss at image-level and super-pixel level in the early, intermediate and later fashion individually. For the land-cover map** task, we assign each pixel a land-cover class by the joint use of pre-trained features and spectral information of the image itself. Experimental results show that the proposed approach achieves a comparable accuracy and that reduces the dimension of features with respect to the image-level contrastive learning method. Among three fusion fashions, the intermediate fusion strategy achieves the best performance. The combination of the pixel-level fusion approach and spectral indices leads to further improvements on the land-cover map** task with respect to the image-level fusion approach, especially with few pseudo labels. △ Less

Submitted 8 October, 2021; v1 submitted 9 March, 2021; originally announced March 2021.

Comments: 11 pages, 5 figures

Adversarial Shape Learning for Building Extraction in VHR Remote Sensing Images

Authors: Lei Ding, Hao Tang, Yahui Liu, Yilei Shi, Xiao Xiang Zhu, Lorenzo Bruzzone

Abstract: Building extraction in VHR RSIs remains a challenging task due to occlusion and boundary ambiguity problems. Although conventional convolutional neural networks (CNNs) based methods are capable of exploiting local texture and context information, they fail to capture the shape patterns of buildings, which is a necessary constraint in the human recognition. To address this issue, we propose an adve… ▽ More Building extraction in VHR RSIs remains a challenging task due to occlusion and boundary ambiguity problems. Although conventional convolutional neural networks (CNNs) based methods are capable of exploiting local texture and context information, they fail to capture the shape patterns of buildings, which is a necessary constraint in the human recognition. To address this issue, we propose an adversarial shape learning network (ASLNet) to model the building shape patterns that improve the accuracy of building segmentation. In the proposed ASLNet, we introduce the adversarial learning strategy to explicitly model the shape constraints, as well as a CNN shape regularizer to strengthen the embedding of shape features. To assess the geometric accuracy of building segmentation results, we introduced several object-based quality assessment metrics. Experiments on two open benchmark datasets show that the proposed ASLNet improves both the pixel-based accuracy and the object-based quality measurements by a large margin. The code is available at: https://github.com/ggsDing/ASLNet △ Less

Submitted 17 December, 2021; v1 submitted 22 February, 2021; originally announced February 2021.

MP-ResNet: Multi-path Residual Network for the Semantic segmentation of High-Resolution PolSAR Images

Authors: Lei Ding, Kai Zheng, Dong Lin, Yuxing Chen, Bing Liu, Jiansheng Li, Lorenzo Bruzzone

Abstract: There are limited studies on the semantic segmentation of high-resolution Polarimetric Synthetic Aperture Radar (PolSAR) images due to the scarcity of training data and the inference of speckle noises. The Gaofen contest has provided open access of a high-quality PolSAR semantic segmentation dataset. Taking this chance, we propose a Multi-path ResNet (MP-ResNet) architecture for the semantic segme… ▽ More There are limited studies on the semantic segmentation of high-resolution Polarimetric Synthetic Aperture Radar (PolSAR) images due to the scarcity of training data and the inference of speckle noises. The Gaofen contest has provided open access of a high-quality PolSAR semantic segmentation dataset. Taking this chance, we propose a Multi-path ResNet (MP-ResNet) architecture for the semantic segmentation of high-resolution PolSAR images. Compared to conventional U-shape encoder-decoder convolutional neural network (CNN) architectures, the MP-ResNet learns semantic context with its parallel multi-scale branches, which greatly enlarges its valid receptive fields and improves the embedding of local discriminative features. In addition, MP-ResNet adopts a multi-level feature fusion design in its decoder to make the best use of the features learned from its different branches. Ablation studies show that the MPResNet has significant advantages over its baseline method (FCN with ResNet34). It also surpasses several classic state-of-the-art methods in terms of overall accuracy (OA), mean F1 and fwIoU, whereas its computational costs are not much increased. This CNN architecture can be used as a baseline method for future studies on the semantic segmentation of PolSAR images. The code is available at: https://github.com/ggsDing/SARSeg. △ Less

Submitted 16 November, 2020; v1 submitted 10 November, 2020; originally announced November 2020.

Remote Sensing Image Scene Classification with Deep Neural Networks in JPEG 2000 Compressed Domain

Authors: Akshara Preethy Byju, Gencer Sumbul, Begüm Demir, Lorenzo Bruzzone

Abstract: To reduce the storage requirements, remote sensing (RS) images are usually stored in compressed format. Existing scene classification approaches using deep neural networks (DNNs) require to fully decompress the images, which is a computationally demanding task in operational applications. To address this issue, in this paper we propose a novel approach to achieve scene classification in JPEG 2000… ▽ More To reduce the storage requirements, remote sensing (RS) images are usually stored in compressed format. Existing scene classification approaches using deep neural networks (DNNs) require to fully decompress the images, which is a computationally demanding task in operational applications. To address this issue, in this paper we propose a novel approach to achieve scene classification in JPEG 2000 compressed RS images. The proposed approach consists of two main steps: i) approximation of the finer resolution sub-bands of reversible biorthogonal wavelet filters used in JPEG 2000; and ii) characterization of the high-level semantic content of approximated wavelet sub-bands and scene classification based on the learnt descriptors. This is achieved by taking codestreams associated with the coarsest resolution wavelet sub-band as input to approximate finer resolution sub-bands using a number of transposed convolutional layers. Then, a series of convolutional layers models the high-level semantic content of the approximated wavelet sub-band. Thus, the proposed approach models the multiresolution paradigm given in the JPEG 2000 compression algorithm in an end-to-end trainable unified neural network. In the classification stage, the proposed approach takes only the coarsest resolution wavelet sub-bands as input, thereby reducing the time required to apply decoding. Experimental results performed on two benchmark aerial image archives demonstrate that the proposed approach significantly reduces the computational time with similar classification accuracies when compared to traditional RS scene classification approaches (which requires full image decompression). △ Less

Submitted 15 December, 2020; v1 submitted 20 June, 2020; originally announced June 2020.

Comments: Accepted to IEEE Transactions on Geoscience and Remote Sensing

DiResNet: Direction-aware Residual Network for Road Extraction in VHR Remote Sensing Images

Authors: Lei Ding, Lorenzo Bruzzone

Abstract: The binary segmentation of roads in very high resolution (VHR) remote sensing images (RSIs) has always been a challenging task due to factors such as occlusions (caused by shadows, trees, buildings, etc.) and the intra-class variances of road surfaces. The wide use of convolutional neural networks (CNNs) has greatly improved the segmentation accuracy and made the task end-to-end trainable. However… ▽ More The binary segmentation of roads in very high resolution (VHR) remote sensing images (RSIs) has always been a challenging task due to factors such as occlusions (caused by shadows, trees, buildings, etc.) and the intra-class variances of road surfaces. The wide use of convolutional neural networks (CNNs) has greatly improved the segmentation accuracy and made the task end-to-end trainable. However, there are still margins to improve in terms of the completeness and connectivity of the results. In this paper, we consider the specific context of road extraction and present a direction-aware residual network (DiResNet) that includes three main contributions: 1) An asymmetric residual segmentation network with deconvolutional layers and a structural supervision to enhance the learning of road topology (DiResSeg); 2) A pixel-level supervision of local directions to enhance the embedding of linear features; 3) A refinement network to optimize the segmentation results (DiResRef). Ablation studies on two benchmark datasets (the Massachusetts dataset and the DeepGlobe dataset) have confirmed the effectiveness of the presented designs. Comparative experiments with other approaches show that the proposed method has advantages in both overall accuracy and F1-score. The code is available at: https://github.com/ggsDing/DiResNet. △ Less

Submitted 24 May, 2020; v1 submitted 14 May, 2020; originally announced May 2020.

Comments: 12 pages, 13 figures. IEEE Transactions on Geoscience and Remote Sensing, 2020

Journal ref: Ding L, Bruzzone L. DiResNet: Direction-Aware Residual Network for Road Extraction in VHR Remote Sensing Images[J]. IEEE Transactions on Geoscience and Remote Sensing, 2020

Lunar impact craters identification and age estimation with Chang'E data by deep and transfer learning

Authors: Chen Yang, Haishi Zhao, Lorenzo Bruzzone, Jon Atli Benediktsson, Yanchun Liang, Bin Liu, Xingguo Zeng, Renchu Guan, Chunlai Li, Ziyuan Ouyang

Abstract: Impact craters, as "lunar fossils", are the most dominant lunar surface features and occupy most of the Moon's surface. Their formation and evolution record the history of the Solar System. Sixty years of triumphs in the lunar exploration projects accumulated a large amount of lunar data. Currently, there are 9137 existing recognized craters. However, only 1675 of them have been determined age, wh… ▽ More Impact craters, as "lunar fossils", are the most dominant lunar surface features and occupy most of the Moon's surface. Their formation and evolution record the history of the Solar System. Sixty years of triumphs in the lunar exploration projects accumulated a large amount of lunar data. Currently, there are 9137 existing recognized craters. However, only 1675 of them have been determined age, which is obviously not satisfactory to reveal the evolution of the Moon. Identifying craters is a challenging task due to their enormous difference in size, large variations in shape and vast presence. Furthermore, estimating the age of craters is extraordinarily difficult due to their complex and different morphologies. Here, in order to effectively identify craters and estimate their age, we convert the crater identification problem into a target detection task and crater age estimation into a taxonomy structure. From an initial small number of available craters, we progressively identify craters and estimate their age from Chang'E data by transfer learning (TL) using deep neural networks. For comprehensive identification of multi-scale craters, a two-stage craters detection approach is developed. Thus 117240 unrecognized lunar craters that range in diameter from 532 km to 1 km are identified. Then, a two-stage classification approach is developed to estimate the age of craters by simultaneously extracting their morphological features and stratigraphic information. The age of 79243 craters larger than 3 km in diameter is estimated. These identified and aged craters throughout the mid and low-latitude regions of the Moon are crucial for reconstructing the dynamic evolution process of the Solar System. △ Less

Submitted 3 December, 2019; originally announced December 2019.

Comments: 6 pages, 3 figures

Journal ref: Nat Commun 11, 6358 (2020)

Improving Semantic Segmentation of Aerial Images Using Patch-based Attention

Authors: Lei Ding, Hao Tang, Lorenzo Bruzzone

Abstract: The trade-off between feature representation power and spatial localization accuracy is crucial for the dense classification/semantic segmentation of aerial images. High-level features extracted from the late layers of a neural network are rich in semantic information, yet have blurred spatial details; low-level features extracted from the early layers of a network contain more pixel-level informa… ▽ More The trade-off between feature representation power and spatial localization accuracy is crucial for the dense classification/semantic segmentation of aerial images. High-level features extracted from the late layers of a neural network are rich in semantic information, yet have blurred spatial details; low-level features extracted from the early layers of a network contain more pixel-level information, but are isolated and noisy. It is therefore difficult to bridge the gap between high and low-level features due to their difference in terms of physical information content and spatial distribution. In this work, we contribute to solve this problem by enhancing the feature representation in two ways. On the one hand, a patch attention module (PAM) is proposed to enhance the embedding of context information based on a patch-wise calculation of local attention. On the other hand, an attention embedding module (AEM) is proposed to enrich the semantic information of low-level features by embedding local focus from high-level features. Both of the proposed modules are light-weight and can be applied to process the extracted features of convolutional neural networks (CNNs). Experiments show that, by integrating the proposed modules into the baseline Fully Convolutional Network (FCN), the resulting local attention network (LANet) greatly improves the performance over the baseline and outperforms other attention based methods on two aerial image datasets. △ Less

Submitted 20 November, 2019; originally announced November 2019.

Comments: [J]. IEEE Transactions on Geoscience and Remote Sensing, 2020

Journal ref: Ding L, Tang H, Bruzzone L. LANet: Local attention embedding to improve the semantic segmentation of remote sensing images[J]. IEEE Transactions on Geoscience and Remote Sensing, 2020

Multisource and Multitemporal Data Fusion in Remote Sensing

Authors: Pedram Ghamisi, Behnood Rasti, Naoto Yokoya, Qunming Wang, Bernhard Hofle, Lorenzo Bruzzone, Francesca Bovolo, Mingmin Chi, Katharina Anders, Richard Gloaguen, Peter M. Atkinson, Jon Atli Benediktsson

Abstract: The sharp and recent increase in the availability of data captured by different sensors combined with their considerably heterogeneous natures poses a serious challenge for the effective and efficient processing of remotely sensed data. Such an increase in remote sensing and ancillary datasets, however, opens up the possibility of utilizing multimodal datasets in a joint manner to further improve… ▽ More The sharp and recent increase in the availability of data captured by different sensors combined with their considerably heterogeneous natures poses a serious challenge for the effective and efficient processing of remotely sensed data. Such an increase in remote sensing and ancillary datasets, however, opens up the possibility of utilizing multimodal datasets in a joint manner to further improve the performance of the processing approaches with respect to the application at hand. Multisource data fusion has, therefore, received enormous attention from researchers worldwide for a wide variety of applications. Moreover, thanks to the revisit capability of several spaceborne sensors, the integration of the temporal information with the spatial and/or spectral/backscattering information of the remotely sensed data is possible and helps to move from a representation of 2D/3D data to 4D data structures, where the time variable adds new information as well as challenges for the information extraction algorithms. There are a huge number of research works dedicated to multisource and multitemporal data fusion, but the methods for the fusion of different modalities have expanded in different paths according to each research community. This paper brings together the advances of multisource and multitemporal data fusion approaches with respect to different research communities and provides a thorough and discipline-specific starting point for researchers at different levels (i.e., students, researchers, and senior researchers) willing to conduct novel investigations on this challenging topic by supplying sufficient detail and references. △ Less

Submitted 19 December, 2018; originally announced December 2018.

Tensor Alignment Based Domain Adaptation for Hyperspectral Image Classification

Authors: Yao Qin, Lorenzo Bruzzone, Biao Li

Abstract: This paper presents a tensor alignment (TA) based domain adaptation method for hyperspectral image (HSI) classification. To be specific, HSIs in both domains are first segmented into superpixels and tensors of both domains are constructed to include neighboring samples from single superpixel. Then we consider the subspace invariance between two domains as projection matrices and original tensors a… ▽ More This paper presents a tensor alignment (TA) based domain adaptation method for hyperspectral image (HSI) classification. To be specific, HSIs in both domains are first segmented into superpixels and tensors of both domains are constructed to include neighboring samples from single superpixel. Then we consider the subspace invariance between two domains as projection matrices and original tensors are projected as core tensors with lower dimensions into the invariant tensor subspace by applying Tucker decomposition. To preserve geometric information in original tensors, we employ a manifold regularization term for core tensors into the decomposition progress. The projection matrices and core tensors are solved in an alternating optimization manner and the convergence of TA algorithm is analyzed. In addition, a post-processing strategy is defined via pure samples extraction for each superpixel to further improve classification performance. Experimental results on four real HSIs demonstrate that the proposed method can achieve better performance compared with the state-of-the-art subspace learning methods when a limited amount of source labeled samples are available. △ Less

Submitted 4 September, 2018; v1 submitted 29 August, 2018; originally announced August 2018.

Comments: 15 pages, 10 figures

Cross-Domain Collaborative Learning via Cluster Canonical Correlation Analysis and Random Walker for Hyperspectral Image Classification

Authors: Yao Qin, Lorenzo Bruzzone, Biao Li, Yuanxin Ye

Abstract: This paper introduces a novel heterogenous domain adaptation (HDA) method for hyperspectral image classification with a limited amount of labeled samples in both domains. The method is achieved in the way of cross-domain collaborative learning (CDCL), which is addressed via cluster canonical correlation analysis (C-CCA) and random walker (RW) algorithms. To be specific, the proposed CDCL method is… ▽ More This paper introduces a novel heterogenous domain adaptation (HDA) method for hyperspectral image classification with a limited amount of labeled samples in both domains. The method is achieved in the way of cross-domain collaborative learning (CDCL), which is addressed via cluster canonical correlation analysis (C-CCA) and random walker (RW) algorithms. To be specific, the proposed CDCL method is an iterative process of three main stages, i.e. twice of RW-based pseudolabeling and cross domain learning via C-CCA. Firstly, given the initially labeled target samples as training set ($\mathbf{TS}$), the RW-based pseudolabeling is employed to update $\mathbf{TS}$ and extract target clusters ($\mathbf{TCs}$) by fusing the segmentation results obtained by RW and extended RW (ERW) classifiers. Secondly, cross domain learning via C-CCA is applied using labeled source samples and $\mathbf{TCs}$. The unlabeled target samples are then classified with the estimated probability maps using the model trained in the projected correlation subspace. Thirdly, both $\mathbf{TS}$ and estimated probability maps are used for updating $\mathbf{TS}$ again via RW-based pseudolabeling. When the iterative process finishes, the result obtained by the ERW classifier using the final $\mathbf{TS}$ and estimated probability maps is regarded as the final classification map. Experimental results on four real HSIs demonstrate that the proposed method can achieve better performance compared with the state-of-the-art HDA and ERW methods. △ Less

Submitted 30 October, 2018; v1 submitted 29 August, 2018; originally announced August 2018.

Comments: 14 pages, 10 figures

Fast and Robust Matching for Multimodal Remote Sensing Image Registration

Authors: Yuanxin Ye, Lorenzo Bruzzone, Jie Shan, Francesca Bovolo, Qing Zhu

Abstract: While image registration has been studied in remote sensing community for decades, registering multimodal data [e.g., optical, LiDAR, SAR, and map] remains a challenging problem because of significant nonlinear intensity differences between such data. To address this problem, this paper presents a fast and robust matching framework integrating local descriptors for multimodal registration. In the… ▽ More While image registration has been studied in remote sensing community for decades, registering multimodal data [e.g., optical, LiDAR, SAR, and map] remains a challenging problem because of significant nonlinear intensity differences between such data. To address this problem, this paper presents a fast and robust matching framework integrating local descriptors for multimodal registration. In the proposed framework, a local descriptor, such as Histogram of Oriented Gradient (HOG), Local Self Similarity (LSS), or Speeded-Up Robust Feature (SURF), is first extracted at each pixel to form a pixel-wise feature representation of an image. Then we define a similarity measure based on the feature representation in frequency domain using the 3 Dimensional Fast Fourier Transform (3DFFT) technique, followed by a template matching scheme to detect control points between images. In this procedure, we also propose a novel pixel-wise feature representation using orientated gradients of images, which is named channel features of orientated gradients (CFOG). This novel feature is an extension of the pixel-wise HOG descriptors, and outperforms that both in matching performance and computational efficiency. The major advantage of the proposed framework includes: (1) structural similarity representation using the pixel-wise feature description and (2) high computational efficiency due to the use of 3DFFT. Experimental results on different types of multimodal images show the superior matching performance of the proposed framework than the state-of-the-art methods.The proposed matching framework have been used in the software products of a Chinese listed company. The matlab code is available in this manuscript. △ Less

Submitted 31 March, 2021; v1 submitted 19 August, 2018; originally announced August 2018.

Recent Developments from Attribute Profiles for Remote Sensing Image Classification

Authors: Minh-Tan Pham, Sébastien Lefèvre, Erchan Aptoula, Lorenzo Bruzzone

Abstract: Morphological attribute profiles (APs) are among the most effective methods to model the spatial and contextual information for the analysis of remote sensing images, especially for classification task. Since their first introduction to this field in early 2010's, many research studies have been contributed not only to exploit and adapt their use to different applications, but also to extend and i… ▽ More Morphological attribute profiles (APs) are among the most effective methods to model the spatial and contextual information for the analysis of remote sensing images, especially for classification task. Since their first introduction to this field in early 2010's, many research studies have been contributed not only to exploit and adapt their use to different applications, but also to extend and improve their performance for better dealing with more complex data. In this paper, we revisit and discuss different developments and extensions from APs which have drawn significant attention from researchers in the past few years. These studies are analyzed and gathered based on the concept of multi-stage AP construction. In our experiments, a comparative study on classification results of two remote sensing data is provided in order to show their significant improvements compared to the originally proposed APs. △ Less

Submitted 27 March, 2018; originally announced March 2018.

Comments: 6 pages; to appear in ICPRAI 2018

Learning Spectral-Spatial-Temporal Features via a Recurrent Convolutional Neural Network for Change Detection in Multispectral Imagery

Authors: Lichao Mou, Lorenzo Bruzzone, Xiao Xiang Zhu

Abstract: Change detection is one of the central problems in earth observation and was extensively investigated over recent decades. In this paper, we propose a novel recurrent convolutional neural network (ReCNN) architecture, which is trained to learn a joint spectral-spatial-temporal feature representation in a unified framework for change detection in multispectral images. To this end, we bring together… ▽ More Change detection is one of the central problems in earth observation and was extensively investigated over recent decades. In this paper, we propose a novel recurrent convolutional neural network (ReCNN) architecture, which is trained to learn a joint spectral-spatial-temporal feature representation in a unified framework for change detection in multispectral images. To this end, we bring together a convolutional neural network (CNN) and a recurrent neural network (RNN) into one end-to-end network. The former is able to generate rich spectral-spatial feature representations, while the latter effectively analyzes temporal dependency in bi-temporal images. In comparison with previous approaches to change detection, the proposed network architecture possesses three distinctive properties: 1) It is end-to-end trainable, in contrast to most existing methods whose components are separately trained or computed; 2) it naturally harnesses spatial information that has been proven to be beneficial to change detection task; 3) it is capable of adaptively learning the temporal dependency between multitemporal images, unlike most of algorithms that use fairly simple operation like image differencing or stacking. As far as we know, this is the first time that a recurrent convolutional network architecture has been proposed for multitemporal remote sensing image analysis. The proposed network is validated on real multispectral data sets. Both visual and quantitative analysis of experimental results demonstrates competitive performance in the proposed mode. △ Less

Submitted 7 March, 2018; originally announced March 2018.

EnVision: understanding why our most Earth-like neighbour is so different

Authors: Richard Ghail, Colin Wilson, Thomas Widemann, Lorenzo Bruzzone, Caroline Dumoulin, Jörn Helbert, Robbie Herrick, Emmanuel Marcq, Philippa Mason, Pascal Rosenblatt, Ann Carine Vandaele, Louis-Jerome Burtz

Abstract: This document is the EnVision Venus orbiter proposal, submitted in October 2016 in response to ESA's M5 call for Medium-size missions for its Science Programme, for launch in 2029. Why are the terrestrial planets so different? Venus should be the most Earth-like of all our planetary neighbours: its size, bulk composition and distance from the Sun are very similar to those of Earth. Its original… ▽ More This document is the EnVision Venus orbiter proposal, submitted in October 2016 in response to ESA's M5 call for Medium-size missions for its Science Programme, for launch in 2029. Why are the terrestrial planets so different? Venus should be the most Earth-like of all our planetary neighbours: its size, bulk composition and distance from the Sun are very similar to those of Earth. Its original atmosphere was probably similar to that of early Earth, with abundant water that would have been liquid under the young sun's fainter output. Even today, with its global cloud cover, the surface of Venus receives less solar energy than does Earth, so why did a moderate climate ensue here but a catastrophic runaway greenhouse on Venus? How and why did it all go wrong for Venus? What lessons can be learned about the life story of terrestrial planets in general, in this era of discovery of Earth-like exoplanets? Were the radically different evolutionary paths of Earth and Venus driven solely by distance from the Sun, or do internal dynamics, geological activity, volcanic outgassing and weathering also play an important part? Following the primarily atmospheric focus of Venus Express, we propose a new Venus orbiter named EnVision, to focus on Venus' geology and geochemical cycles, seeking evidence for present and past activity. The payload comprises a state-of-the-art S-band radar which will be able to return imagery at spatial resolutions of 1 - 30 m, and capable of measuring cm-scale deformation; this is complemented by subsurface radar, IR and UV spectrometers to map volcanic gases, and by geodetic investigations. △ Less

Submitted 27 March, 2017; originally announced March 2017.

Comments: ES M5 mission proposal

Advances in Hyperspectral Image Classification: Earth monitoring with statistical learning methods

Authors: Gustavo Camps-Valls, Devis Tuia, Lorenzo Bruzzone, Jón Atli Benediktsson

Abstract: Hyperspectral images show similar statistical properties to natural grayscale or color photographic images. However, the classification of hyperspectral images is more challenging because of the very high dimensionality of the pixels and the small number of labeled examples typically available for learning. These peculiarities lead to particular signal processing problems, mainly characterized by… ▽ More Hyperspectral images show similar statistical properties to natural grayscale or color photographic images. However, the classification of hyperspectral images is more challenging because of the very high dimensionality of the pixels and the small number of labeled examples typically available for learning. These peculiarities lead to particular signal processing problems, mainly characterized by indetermination and complex manifolds. The framework of statistical learning has gained popularity in the last decade. New methods have been presented to account for the spatial homogeneity of images, to include user's interaction via active learning, to take advantage of the manifold structure with semisupervised learning, to extract and encode invariances, or to adapt classifiers and image representations to unseen yet similar scenes. This tutuorial reviews the main advances for hyperspectral remote sensing image classification through illustrative examples. △ Less

Submitted 18 October, 2013; originally announced October 2013.

Comments: IEEE Signal Processing Magazine, 2013

High performance new MgB2 superconducting hollow wires

Authors: G. Giunchi, S. Ceresara, G. Ripamonti, A. DiZenobio, S. Rossi, S. Chiarelli, M. Spadoni, R. Wesche, P. L. Bruzzone

Abstract: MgB2 hollow wires have been produced with a new technique which uses a conventional wire manufacturing process but is applied to composite billets containing the elemental B and Mg precursors in an appropriate shape. The technique has been applied to the manufacture of both monofilamentary and multifilamentary wires of several tens meters length. The superconducting transport properties of the M… ▽ More MgB2 hollow wires have been produced with a new technique which uses a conventional wire manufacturing process but is applied to composite billets containing the elemental B and Mg precursors in an appropriate shape. The technique has been applied to the manufacture of both monofilamentary and multifilamentary wires of several tens meters length. The superconducting transport properties of the MgB2 hollow wires have been measured in magnetic field and in the temperature range from 4.2 to 30 K. Promising results are obtained, which indicate the possibility of application of these wires as superconductors in the temperature range of 15-30 K and at medium-high values of magnetic field. △ Less

Submitted 19 July, 2002; originally announced July 2002.

Comments: 14 Pages, 10 Figures, Paper presented at BOROMAG, Genova 17-19 June 2002 and submitted to Supercond. Sci. Technol