-
NTIRE 2024 Restore Any Image Model (RAIM) in the Wild Challenge
Authors:
Jie Liang,
Radu Timofte,
Qiaosi Yi,
Shuaizheng Liu,
Lingchen Sun,
Rongyuan Wu,
Xindong Zhang,
Hui Zeng,
Lei Zhang
Abstract:
In this paper, we review the NTIRE 2024 challenge on Restore Any Image Model (RAIM) in the Wild. The RAIM challenge constructed a benchmark for image restoration in the wild, including real-world images with/without reference ground truth in various scenarios from real applications. The participants were required to restore the real-captured images from complex and unknown degradation, where gener…
▽ More
In this paper, we review the NTIRE 2024 challenge on Restore Any Image Model (RAIM) in the Wild. The RAIM challenge constructed a benchmark for image restoration in the wild, including real-world images with/without reference ground truth in various scenarios from real applications. The participants were required to restore the real-captured images from complex and unknown degradation, where generative perceptual quality and fidelity are desired in the restoration result. The challenge consisted of two tasks. Task one employed real referenced data pairs, where quantitative evaluation is available. Task two used unpaired images, and a comprehensive user study was conducted. The challenge attracted more than 200 registrations, where 39 of them submitted results with more than 400 submissions. Top-ranked methods improved the state-of-the-art restoration performance and obtained unanimous recognition from all 18 judges. The proposed datasets are available at https://drive.google.com/file/d/1DqbxUoiUqkAIkExu3jZAqoElr_nu1IXb/view?usp=sharing and the homepage of this challenge is at https://codalab.lisn.upsaclay.fr/competitions/17632.
△ Less
Submitted 16 May, 2024;
originally announced May 2024.
-
Multi-Modal Concurrent Transmission
Authors:
Majid Nasiri Khormuji,
Alberto Giuseppe Perotti,
Qin Yi,
Branislav Popovic
Abstract:
This paper introduces a novel physical-layer method labelled as Multi-Modal Concurrent Transmission (MMCT) for efficient transmission of multiple data streams with different reliability-latency performance requirements. The MMCT arranges data from multiple streams within a same physical-layer transport block wherein stream-specific modulation and coding scheme (MCS) selection is combined with join…
▽ More
This paper introduces a novel physical-layer method labelled as Multi-Modal Concurrent Transmission (MMCT) for efficient transmission of multiple data streams with different reliability-latency performance requirements. The MMCT arranges data from multiple streams within a same physical-layer transport block wherein stream-specific modulation and coding scheme (MCS) selection is combined with joint map** of modulated codewords to Multiple-Input Multiple-Output spatial layers and frequency resources. Map** to spatial-frequency resources with higher Signal-to-Noise Ratios (SNRs) provides the required performance boost for the more demanding streams. In tactile internet applications, wherein haptic feedback/actuation and audio-video streams flow in parallel, the method provides significant SNR and spectral efficiency enhancements compared to conventional 3GPP New Radio (NR) transmission methods.
△ Less
Submitted 9 February, 2024;
originally announced February 2024.
-
Low-Mid Adversarial Perturbation against Unauthorized Face Recognition System
Authors:
Jiaming Zhang,
Qi Yi,
Dongyuan Lu,
Jitao Sang
Abstract:
In light of the growing concerns regarding the unauthorized use of facial recognition systems and its implications on individual privacy, the exploration of adversarial perturbations as a potential countermeasure has gained traction. However, challenges arise in effectively deploying this approach against unauthorized facial recognition systems due to the effects of JPEG compression on image distr…
▽ More
In light of the growing concerns regarding the unauthorized use of facial recognition systems and its implications on individual privacy, the exploration of adversarial perturbations as a potential countermeasure has gained traction. However, challenges arise in effectively deploying this approach against unauthorized facial recognition systems due to the effects of JPEG compression on image distribution across the internet, which ultimately diminishes the efficacy of adversarial perturbations. Existing JPEG compression-resistant techniques struggle to strike a balance between resistance, transferability, and attack potency. To address these limitations, we propose a novel solution referred to as \emph{low frequency adversarial perturbation} (LFAP). This method conditions the source model to leverage low-frequency characteristics through adversarial training. To further enhance the performance, we introduce an improved \emph{low-mid frequency adversarial perturbation} (LMFAP) that incorporates mid-frequency components for an additive benefit. Our study encompasses a range of settings to replicate genuine application scenarios, including cross backbones, supervisory heads, training datasets, and testing datasets. Moreover, we evaluated our approaches on a commercial black-box API, \texttt{Face++}. The empirical results validate the cutting-edge performance achieved by our proposed solutions.
△ Less
Submitted 2 September, 2023; v1 submitted 19 June, 2022;
originally announced June 2022.
-
Multiple Degradation and Reconstruction Network for Single Image Denoising via Knowledge Distillation
Authors:
Juncheng Li,
Hanhui Yang,
Qiaosi Yi,
Faming Fang,
Guangwei Gao,
Tieyong Zeng,
Guixu Zhang
Abstract:
Single image denoising (SID) has achieved significant breakthroughs with the development of deep learning. However, the proposed methods are often accompanied by plenty of parameters, which greatly limits their application scenarios. Different from previous works that blindly increase the depth of the network, we explore the degradation mechanism of the noisy image and propose a lightweight Multip…
▽ More
Single image denoising (SID) has achieved significant breakthroughs with the development of deep learning. However, the proposed methods are often accompanied by plenty of parameters, which greatly limits their application scenarios. Different from previous works that blindly increase the depth of the network, we explore the degradation mechanism of the noisy image and propose a lightweight Multiple Degradation and Reconstruction Network (MDRN) to progressively remove noise. Meanwhile, we propose two novel Heterogeneous Knowledge Distillation Strategies (HMDS) to enable MDRN to learn richer and more accurate features from heterogeneous models, which make it possible to reconstruct higher-quality denoised images under extreme conditions. Extensive experiments show that our MDRN achieves favorable performance against other SID models with fewer parameters. Meanwhile, plenty of ablation studies demonstrate that the introduced HMDS can improve the performance of tiny models or the model under high noise levels, which is extremely useful for related applications.
△ Less
Submitted 29 April, 2022;
originally announced April 2022.
-
Contrastive Learning for Local and Global Learning MRI Reconstruction
Authors:
Qiaosi Yi,
**hao Liu,
Le Hu,
Faming Fang,
Guixu Zhang
Abstract:
Magnetic Resonance Imaging (MRI) is an important medical imaging modality, while it requires a long acquisition time. To reduce the acquisition time, various methods have been proposed. However, these methods failed to reconstruct images with a clear structure for two main reasons. Firstly, similar patches widely exist in MR images, while most previous deep learning-based methods ignore this prope…
▽ More
Magnetic Resonance Imaging (MRI) is an important medical imaging modality, while it requires a long acquisition time. To reduce the acquisition time, various methods have been proposed. However, these methods failed to reconstruct images with a clear structure for two main reasons. Firstly, similar patches widely exist in MR images, while most previous deep learning-based methods ignore this property and only adopt CNN to learn local information. Secondly, the existing methods only use clear images to constrain the upper bound of the solution space, while the lower bound is not constrained, so that a better parameter of the network cannot be obtained. To address these problems, we propose a Contrastive Learning for Local and Global Learning MRI Reconstruction Network (CLGNet). Specifically, according to the Fourier theory, each value in the Fourier domain is calculated from all the values in Spatial domain. Therefore, we propose a Spatial and Fourier Layer (SFL) to simultaneously learn the local and global information in Spatial and Fourier domains. Moreover, compared with self-attention and transformer, the SFL has a stronger learning ability and can achieve better performance in less time. Based on the SFL, we design a Spatial and Fourier Residual block as the main component of our model. Meanwhile, to constrain the lower bound and upper bound of the solution space, we introduce contrastive learning, which can pull the result closer to the clear image and push the result further away from the undersampled image. Extensive experimental results on different datasets and acceleration rates demonstrate that the proposed CLGNet achieves new state-of-the-art results.
△ Less
Submitted 30 November, 2021;
originally announced November 2021.
-
Quantitative Evaluation of Crack Depths on Thin Aluminum Plate using Eddy Current Pulse-Compression Thermography
Authors:
Qiuji Yi,
Hamed Malekmohammadi,
Gui Yun Tian,
Stefano Laureti,
Marco Ricci
Abstract:
Eddy current stimulated thermography is an emerging technique for non-destructive testing and evaluation of conductive materials. However, quantitative estimation of the depth of subsurface defects in metallic materials by thermography techniques remains challenging due to significant lateral thermal diffusion. This work presents the application of eddy current pulse compression thermography to de…
▽ More
Eddy current stimulated thermography is an emerging technique for non-destructive testing and evaluation of conductive materials. However, quantitative estimation of the depth of subsurface defects in metallic materials by thermography techniques remains challenging due to significant lateral thermal diffusion. This work presents the application of eddy current pulse compression thermography to detect surface and subsurface defects with various depths in an aluminum sample. Kernel Principal Component analysis and Low Rank Sparse modelling were used to enhance the defective area, and cross point feature was exploited to quantitatively evaluate the defects depth. Based on experimental results, it is shown that the crossing point feature has a monotonic relationship with surface and subsurface defects depth, and it can also indicate whether the defect is within or beyond the eddy current skin depth. In addition, the comparison study between aluminum and composites in terms of impulse response and proposed features are also presented.
△ Less
Submitted 24 February, 2021;
originally announced February 2021.
