-
Rethinking RGB Color Representation for Image Restoration Models
Authors:
Jaerin Lee,
JoonKyu Park,
Sungyong Baik,
Kyoung Mu Lee
Abstract:
Image restoration models are typically trained with a pixel-wise distance loss defined over the RGB color representation space, which is well known to be a source of blurry and unrealistic textures in the restored images. The reason, we believe, is that the three-channel RGB space is insufficient for supervising the restoration models. To this end, we augment the representation to hold structural…
▽ More
Image restoration models are typically trained with a pixel-wise distance loss defined over the RGB color representation space, which is well known to be a source of blurry and unrealistic textures in the restored images. The reason, we believe, is that the three-channel RGB space is insufficient for supervising the restoration models. To this end, we augment the representation to hold structural information of local neighborhoods at each pixel while kee** the color information and pixel-grainedness unharmed. The result is a new representation space, dubbed augmented RGB ($a$RGB) space. Substituting the underlying representation space for the per-pixel losses facilitates the training of image restoration models, thereby improving the performance without affecting the evaluation phase. Notably, when combined with auxiliary objectives such as adversarial or perceptual losses, our $a$RGB space consistently improves overall metrics by reconstructing both color and local structures, overcoming the conventional perception-distortion trade-off.
△ Less
Submitted 5 February, 2024;
originally announced February 2024.
-
Reliability Improvement of Circular k-out-of-n: G Balanced Systems through Center of Gravity
Authors:
Yongkyu Cho,
Seung Min Baik,
Young Myoung Ko
Abstract:
This paper considers a circular k-out-of-n: G balance system equipped with homogeneous and stationary units. Building on previous research by Endharta et al. (Reliability Engineering & System Safety, 2018), we propose a new balance definition in circular k-out-of-n: G balance systems based on the concept of center of gravity. According to this condition, a circular k-out-of-n: G balance system is…
▽ More
This paper considers a circular k-out-of-n: G balance system equipped with homogeneous and stationary units. Building on previous research by Endharta et al. (Reliability Engineering & System Safety, 2018), we propose a new balance definition in circular k-out-of-n: G balance systems based on the concept of center of gravity. According to this condition, a circular k-out-of-n: G balance system is considered balanced if its center of gravity is located at the origin. This new balance condition is not only simple but also advantageous as it covers the previous two balance conditions of symmetry and proportionality. To evaluate the system's reliability, we consider the minimum tie-sets, and extensive numerical studies verify the enhancement of system reliability resulting from the proposed balance definition.
△ Less
Submitted 10 May, 2023;
originally announced May 2023.
-
CADyQ: Content-Aware Dynamic Quantization for Image Super-Resolution
Authors:
Cheeun Hong,
Sungyong Baik,
Heewon Kim,
Seungjun Nah,
Kyoung Mu Lee
Abstract:
Despite breakthrough advances in image super-resolution (SR) with convolutional neural networks (CNNs), SR has yet to enjoy ubiquitous applications due to the high computational complexity of SR networks. Quantization is one of the promising approaches to solve this problem. However, existing methods fail to quantize SR models with a bit-width lower than 8 bits, suffering from severe accuracy loss…
▽ More
Despite breakthrough advances in image super-resolution (SR) with convolutional neural networks (CNNs), SR has yet to enjoy ubiquitous applications due to the high computational complexity of SR networks. Quantization is one of the promising approaches to solve this problem. However, existing methods fail to quantize SR models with a bit-width lower than 8 bits, suffering from severe accuracy loss due to fixed bit-width quantization applied everywhere. In this work, to achieve high average bit-reduction with less accuracy loss, we propose a novel Content-Aware Dynamic Quantization (CADyQ) method for SR networks that allocates optimal bits to local regions and layers adaptively based on the local contents of an input image. To this end, a trainable bit selector module is introduced to determine the proper bit-width and quantization level for each layer and a given local image patch. This module is governed by the quantization sensitivity that is estimated by using both the average magnitude of image gradient of the patch and the standard deviation of the input feature of the layer. The proposed quantization pipeline has been tested on various SR networks and evaluated on several standard benchmarks extensively. Significant reduction in computational complexity and the elevated restoration accuracy clearly demonstrate the effectiveness of the proposed CADyQ framework for SR. Codes are available at https://github.com/Cheeun/CADyQ.
△ Less
Submitted 30 October, 2022; v1 submitted 21 July, 2022;
originally announced July 2022.
-
Estimation of the Frequency of Occurrence of Italian Phonemes in Text
Authors:
Javi Arango,
Alec DeCaprio,
Sunwoo Baik,
Luca De Nardis,
Stefanie Shattuck-Hufnagel,
Maria Gabriella Di Benedetto
Abstract:
The purpose of this project was to derive a reliable estimate of the frequency of occurrence of the 30 phonemes - plus consonant geminated counterparts - of the Italian language, based on four selected written texts. Since no comparable dataset was found in previous literature, the present analysis may serve as a reference in future studies. Four textual sources were considered: Come si fa una tes…
▽ More
The purpose of this project was to derive a reliable estimate of the frequency of occurrence of the 30 phonemes - plus consonant geminated counterparts - of the Italian language, based on four selected written texts. Since no comparable dataset was found in previous literature, the present analysis may serve as a reference in future studies. Four textual sources were considered: Come si fa una tesi di laurea: le materie umanistiche by Umberto Eco, I promessi sposi by Alessandro Manzoni, a recent article in Corriere della Sera (a popular daily Italian newspaper), and In altre parole by Jhumpa Lahiri. The sources were chosen to represent varied genres, subject matter, time periods, and writing styles. Results of the analysis, which also included an analysis of variance, showed that, for all four sources, the frequencies of occurrence reached relatively stable values after about 6,000 phonemes (approx. 1,250 words), varying by <0.025%. Estimated frequencies are provided for each single source and as an average across sources.
△ Less
Submitted 18 January, 2021; v1 submitted 14 January, 2021;
originally announced January 2021.
-
DAQ: Channel-Wise Distribution-Aware Quantization for Deep Image Super-Resolution Networks
Authors:
Cheeun Hong,
Heewon Kim,
Sungyong Baik,
Junghun Oh,
Kyoung Mu Lee
Abstract:
Quantizing deep convolutional neural networks for image super-resolution substantially reduces their computational costs. However, existing works either suffer from a severe performance drop in ultra-low precision of 4 or lower bit-widths, or require a heavy fine-tuning process to recover the performance. To our knowledge, this vulnerability to low precisions relies on two statistical observations…
▽ More
Quantizing deep convolutional neural networks for image super-resolution substantially reduces their computational costs. However, existing works either suffer from a severe performance drop in ultra-low precision of 4 or lower bit-widths, or require a heavy fine-tuning process to recover the performance. To our knowledge, this vulnerability to low precisions relies on two statistical observations of feature map values. First, distribution of feature map values varies significantly per channel and per input image. Second, feature maps have outliers that can dominate the quantization error. Based on these observations, we propose a novel distribution-aware quantization scheme (DAQ) which facilitates accurate training-free quantization in ultra-low precision. A simple function of DAQ determines dynamic range of feature maps and weights with low computational burden. Furthermore, our method enables mixed-precision quantization by calculating the relative sensitivity of each channel, without any training process involved. Nonetheless, quantization-aware training is also applicable for auxiliary performance gain. Our new method outperforms recent training-free and even training-based quantization methods to the state-of-the-art image super-resolution networks in ultra-low precision.
△ Less
Submitted 6 July, 2022; v1 submitted 21 December, 2020;
originally announced December 2020.
