-
QSpeckleFilter: a Quantum Machine Learning approach for SAR speckle filtering
Authors:
Francesco Mauro,
Alessandro Sebastianelli,
Maria Pia Del Rosso,
Paolo Gamba,
Silvia Liberata Ullo
Abstract:
The use of Synthetic Aperture Radar (SAR) has greatly advanced our capacity for comprehensive Earth monitoring, providing detailed insights into terrestrial surface use and cover regardless of weather conditions, and at any time of day or night. However, SAR imagery quality is often compromised by speckle, a granular disturbance that poses challenges in producing accurate results without suitable…
▽ More
The use of Synthetic Aperture Radar (SAR) has greatly advanced our capacity for comprehensive Earth monitoring, providing detailed insights into terrestrial surface use and cover regardless of weather conditions, and at any time of day or night. However, SAR imagery quality is often compromised by speckle, a granular disturbance that poses challenges in producing accurate results without suitable data processing. In this context, the present paper explores the cutting-edge application of Quantum Machine Learning (QML) in speckle filtering, harnessing quantum algorithms to address computational complexities. We introduce here QSpeckleFilter, a novel QML model for SAR speckle filtering. The proposed method compared to a previous work from the same authors showcases its superior performance in terms of Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM) on a testing dataset, and it opens new avenues for Earth Observation (EO) applications.
△ Less
Submitted 2 February, 2024;
originally announced February 2024.
-
Using Multi-Temporal Sentinel-1 and Sentinel-2 data for water bodies map**
Authors:
Luigi Russo,
Francesco Mauro,
Babak Memar,
Alessandro Sebastianelli,
Paolo Gamba,
Silvia Liberata Ullo
Abstract:
Climate change is intensifying extreme weather events, causing both water scarcity and severe rainfall unpredictability, and posing threats to sustainable development, biodiversity, and access to water and sanitation. This paper aims to provide valuable insights for comprehensive water resource monitoring under diverse meteorological conditions. An extension of the SEN2DWATER dataset is proposed t…
▽ More
Climate change is intensifying extreme weather events, causing both water scarcity and severe rainfall unpredictability, and posing threats to sustainable development, biodiversity, and access to water and sanitation. This paper aims to provide valuable insights for comprehensive water resource monitoring under diverse meteorological conditions. An extension of the SEN2DWATER dataset is proposed to enhance its capabilities for water basin segmentation. Through the integration of temporally and spatially aligned radar information from Sentinel-1 data with the existing multispectral Sentinel-2 data, a novel multisource and multitemporal dataset is generated. Benchmarking the enhanced dataset involves the application of indices such as the Soil Water Index (SWI) and Normalized Difference Water Index (NDWI), along with an unsupervised Machine Learning (ML) classifier (k-means clustering). Promising results are obtained and potential future developments and applications arising from this research are also explored.
△ Less
Submitted 5 January, 2024;
originally announced February 2024.
-
A Hybrid MLP-Quantum approach in Graph Convolutional Neural Networks for Oceanic Nino Index (ONI) prediction
Authors:
Francesco Mauro,
Alessandro Sebastianelli,
Bertrand Le Saux,
Paolo Gamba,
Silvia Liberata Ullo
Abstract:
This paper explores an innovative fusion of Quantum Computing (QC) and Artificial Intelligence (AI) through the development of a Hybrid Quantum Graph Convolutional Neural Network (HQGCNN), combining a Graph Convolutional Neural Network (GCNN) with a Quantum Multilayer Perceptron (MLP). The study highlights the potentialities of GCNNs in handling global-scale dependencies and proposes the HQGCNN fo…
▽ More
This paper explores an innovative fusion of Quantum Computing (QC) and Artificial Intelligence (AI) through the development of a Hybrid Quantum Graph Convolutional Neural Network (HQGCNN), combining a Graph Convolutional Neural Network (GCNN) with a Quantum Multilayer Perceptron (MLP). The study highlights the potentialities of GCNNs in handling global-scale dependencies and proposes the HQGCNN for predicting complex phenomena such as the Oceanic Nino Index (ONI). Preliminary results suggest the model potential to surpass state-of-the-art (SOTA). The code will be made available with the paper publication.
△ Less
Submitted 29 January, 2024;
originally announced January 2024.
-
SpectralGPT: Spectral Remote Sensing Foundation Model
Authors:
Danfeng Hong,
Bing Zhang,
Xuyang Li,
Yuxuan Li,
Chenyu Li,
**g Yao,
Naoto Yokoya,
Hao Li,
Pedram Ghamisi,
** Jia,
Antonio Plaza,
Paolo Gamba,
Jon Atli Benediktsson,
Jocelyn Chanussot
Abstract:
The foundation model has recently garnered significant attention due to its potential to revolutionize the field of visual representation learning in a self-supervised manner. While most foundation models are tailored to effectively process RGB images for various visual tasks, there is a noticeable gap in research focused on spectral data, which offers valuable information for scene understanding,…
▽ More
The foundation model has recently garnered significant attention due to its potential to revolutionize the field of visual representation learning in a self-supervised manner. While most foundation models are tailored to effectively process RGB images for various visual tasks, there is a noticeable gap in research focused on spectral data, which offers valuable information for scene understanding, especially in remote sensing (RS) applications. To fill this gap, we created for the first time a universal RS foundation model, named SpectralGPT, which is purpose-built to handle spectral RS images using a novel 3D generative pretrained transformer (GPT). Compared to existing foundation models, SpectralGPT 1) accommodates input images with varying sizes, resolutions, time series, and regions in a progressive training fashion, enabling full utilization of extensive RS big data; 2) leverages 3D token generation for spatial-spectral coupling; 3) captures spectrally sequential patterns via multi-target reconstruction; 4) trains on one million spectral RS images, yielding models with over 600 million parameters. Our evaluation highlights significant performance improvements with pretrained SpectralGPT models, signifying substantial potential in advancing spectral RS big data applications within the field of geoscience across four downstream tasks: single/multi-label scene classification, semantic segmentation, and change detection.
△ Less
Submitted 12 February, 2024; v1 submitted 13 November, 2023;
originally announced November 2023.
-
A speckle filter for Sentinel-1 SAR Ground Range Detected data based on Residual Convolutional Neural Networks
Authors:
Alessandro Sebastianelli,
Maria Pia Del Rosso,
Silvia Liberata Ullo,
Paolo Gamba
Abstract:
In recent years, machine learning (ML) algorithms have become widespread in all the fields of remote sensing (RS) and earth observation (EO). This has allowed the rapid development of new procedures to solve problems affecting these sectors. In this context, this work aims at presenting a novel method for filtering speckle noise from Sentinel-1 ground range detected (GRD) data by applying deep lea…
▽ More
In recent years, machine learning (ML) algorithms have become widespread in all the fields of remote sensing (RS) and earth observation (EO). This has allowed the rapid development of new procedures to solve problems affecting these sectors. In this context, this work aims at presenting a novel method for filtering speckle noise from Sentinel-1 ground range detected (GRD) data by applying deep learning (DL) algorithms, based on convolutional neural networks (CNNs). The paper provides an easy yet very effective approach to extract the large amount of training data needed for DL approaches in this challenging case. The experimental results on simulated speckled images and an actual SAR dataset show a clear improvement with respect to the state of the art in terms of peak signal-to-noise ratio (PSNR), structural similarity index (SSIM), equivalent number of looks (ENL), proving the effectiveness of the proposed architecture.
△ Less
Submitted 17 May, 2022; v1 submitted 19 April, 2021;
originally announced April 2021.
-
Spectral Superresolution of Multispectral Imagery with Joint Sparse and Low-Rank Learning
Authors:
Lianru Gao,
Danfeng Hong,
**g Yao,
Bing Zhang,
Paolo Gamba,
Jocelyn Chanussot
Abstract:
Extensive attention has been widely paid to enhance the spatial resolution of hyperspectral (HS) images with the aid of multispectral (MS) images in remote sensing. However, the ability in the fusion of HS and MS images remains to be improved, particularly in large-scale scenes, due to the limited acquisition of HS images. Alternatively, we super-resolve MS images in the spectral domain by the mea…
▽ More
Extensive attention has been widely paid to enhance the spatial resolution of hyperspectral (HS) images with the aid of multispectral (MS) images in remote sensing. However, the ability in the fusion of HS and MS images remains to be improved, particularly in large-scale scenes, due to the limited acquisition of HS images. Alternatively, we super-resolve MS images in the spectral domain by the means of partially overlapped HS images, yielding a novel and promising topic: spectral superresolution (SSR) of MS imagery. This is challenging and less investigated task due to its high ill-posedness in inverse imaging. To this end, we develop a simple but effective method, called joint sparse and low-rank learning (J-SLoL), to spectrally enhance MS images by jointly learning low-rank HS-MS dictionary pairs from overlapped regions. J-SLoL infers and recovers the unknown hyperspectral signals over a larger coverage by sparse coding on the learned dictionary pair. Furthermore, we validate the SSR performance on three HS-MS datasets (two for classification and one for unmixing) in terms of reconstruction, classification, and unmixing by comparing with several existing state-of-the-art baselines, showing the effectiveness and superiority of the proposed J-SLoL algorithm. Furthermore, the codes and datasets will be available at: https://github.com/danfenghong/IEEE\_TGRS\_J-SLoL, contributing to the RS community.
△ Less
Submitted 28 July, 2020;
originally announced July 2020.
-
Modeling the Temporal Population Distribution of Ae. aegypti Mosquito using Big Earth Observation Data
Authors:
Oladimeji Mudele,
Fabio M. Bayer,
Lucas Zanandrez,
Alvaro E. Eiras,
Paolo Gamba
Abstract:
Over 50% of the world population is at risk of mosquito-borne diseases. Female Ae. aegypti mosquito species transmit Zika, Dengue, and Chikungunya. The spread of these diseases correlate positively with the vector population, and this population depends on biotic and abiotic environmental factors including temperature, vegetation condition, humidity and precipitation. To combat virus outbreaks, in…
▽ More
Over 50% of the world population is at risk of mosquito-borne diseases. Female Ae. aegypti mosquito species transmit Zika, Dengue, and Chikungunya. The spread of these diseases correlate positively with the vector population, and this population depends on biotic and abiotic environmental factors including temperature, vegetation condition, humidity and precipitation. To combat virus outbreaks, information about vector population is required. To this aim, Earth observation (EO) data provide fast, efficient and economically viable means to estimate environmental features of interest. In this work, we present a temporal distribution model for adult female Ae. aegypti mosquitoes based on the joint use of the Normalized Difference Vegetation Index, the Normalized Difference Water Index, the Land Surface Temperature (both at day and night time), along with the precipitation information, extracted from EO data. The model was applied separately to data obtained during three different vector control and field data collection condition regimes, and used to explain the differences in environmental variable contributions across these regimes. To this aim, a random forest (RF) regression technique and its nonlinear features importance ranking based on mean decrease impurity (MDI) were implemented. To prove the robustness of the proposed model, we compared it to other machine learning techniques and statistical models. Our results show that machine learning techniques perform better than linear statistical models for the task at hand, and RF performs best. By ranking the importance of all features based on MDI in RF and selecting the subset comprising the most informative ones, a more parsimonious but equally effective and explainable model can be obtained...
△ Less
Submitted 26 November, 2019; v1 submitted 20 November, 2019;
originally announced November 2019.
-
Multi-feature combined cloud and cloud shadow detection in GaoFen-1 wide field of view imagery
Authors:
Zhiwei Li,
Huanfeng Shen,
Huifang Li,
Guisong Xia,
Paolo Gamba,
Liangpei Zhang
Abstract:
The wide field of view (WFV) imaging system onboard the Chinese GaoFen-1 (GF-1) optical satellite has a 16-m resolution and four-day revisit cycle for large-scale Earth observation. The advantages of the high temporal-spatial resolution and the wide field of view make the GF-1 WFV imagery very popular. However, cloud cover is an inevitable problem in GF-1 WFV imagery, which influences its precise…
▽ More
The wide field of view (WFV) imaging system onboard the Chinese GaoFen-1 (GF-1) optical satellite has a 16-m resolution and four-day revisit cycle for large-scale Earth observation. The advantages of the high temporal-spatial resolution and the wide field of view make the GF-1 WFV imagery very popular. However, cloud cover is an inevitable problem in GF-1 WFV imagery, which influences its precise application. Accurate cloud and cloud shadow detection in GF-1 WFV imagery is quite difficult due to the fact that there are only three visible bands and one near-infrared band. In this paper, an automatic multi-feature combined (MFC) method is proposed for cloud and cloud shadow detection in GF-1 WFV imagery. The MFC algorithm first implements threshold segmentation based on the spectral features and mask refinement based on guided filtering to generate a preliminary cloud mask. The geometric features are then used in combination with the texture features to improve the cloud detection results and produce the final cloud mask. Finally, the cloud shadow mask can be acquired by means of the cloud and shadow matching and follow-up correction process. The method was validated using 108 globally distributed scenes. The results indicate that MFC performs well under most conditions, and the average overall accuracy of MFC cloud detection is as high as 96.8%. In the contrastive analysis with the official provided cloud fractions, MFC shows a significant improvement in cloud fraction estimation, and achieves a high accuracy for the cloud and cloud shadow detection in the GF-1 WFV imagery with fewer spectral bands. The proposed method could be used as a preprocessing step in the future to monitor land-cover change, and it could also be easily extended to other optical satellite imagery which has a similar spectral setting.
△ Less
Submitted 4 February, 2017; v1 submitted 16 June, 2016;
originally announced June 2016.
-
Low Complexity Indoor Localization in Wireless Sensor Networks by UWB and Inertial Data Fusion
Authors:
Alberto Savioli,
Emanuele Goldoni,
Pietro Savazzi,
Paolo Gamba
Abstract:
Precise indoor localization of moving targets is a challenging activity which cannot be easily accomplished without combining different sources of information. In this sense, the combination of different data sources with an appropriate filter might improve both positioning and tracking performance. This work proposes an algorithm for hybrid positioning in Wireless Sensor Networks based on data fu…
▽ More
Precise indoor localization of moving targets is a challenging activity which cannot be easily accomplished without combining different sources of information. In this sense, the combination of different data sources with an appropriate filter might improve both positioning and tracking performance. This work proposes an algorithm for hybrid positioning in Wireless Sensor Networks based on data fusion of UWB and inertial information. A constant-gain Steady State Kalman Filter is used to bound the complexity of the system, simplifying its implementation on a typical low-power WSN node. The performance of the presented data fusion algorithm has been evaluated in a realistic scenario using both simulations and realistic datasets. The obtained results prove the validity of this approach, which efficiently fuses different positioning data sources, reducing the localization error.
△ Less
Submitted 7 May, 2013;
originally announced May 2013.
-
An Autonomous Long Range Monitoring System For Emergency Operators
Authors:
Matteo Lanati,
Davide Curone,
Emanuele Lindo Secco,
Giovanni Magenes,
Paolo Gamba
Abstract:
Miniaturization and portability of new electronics lead up to wearable devices embedded within garments: a European program called ProeTEX developed multi-purpose sensors integrated within emergency operators' garments in order to monitor their health state and the surrounding environment. This work deals with the development of an autonomous Long Range communication System (LRS), suitable to tran…
▽ More
Miniaturization and portability of new electronics lead up to wearable devices embedded within garments: a European program called ProeTEX developed multi-purpose sensors integrated within emergency operators' garments in order to monitor their health state and the surrounding environment. This work deals with the development of an autonomous Long Range communication System (LRS), suitable to transmit data between operators' equipment and the local command post, where remote monitoring software is set up. The LRS infrastructure is based on Wi-Fi protocol and modular architecture. Field tests carried out on the developed prototype showed a high reliability in terms of correctly exchanged data and recovering capabilities in case of temporary disconnection, due to the operator's movements.
△ Less
Submitted 28 February, 2011;
originally announced February 2011.