-
IQUAFLOW: A new framework to measure image quality
Authors:
P. Gallés,
K. Takats,
M. Hernández-Cabronero,
D. Berga,
L. Pega,
L. Riordan-Chen,
C. Garcia,
G. Becker,
A. Garriga,
A. Bukva,
J. Serra-Sagristà,
D. Vilaseca,
J. Marín
Abstract:
IQUAFLOW is a new image quality framework that provides a set of tools to assess image quality. The user can add custom metrics that can be easily integrated. Furthermore, iquaflow allows to measure quality by using the performance of AI models trained on the images as a proxy. This also helps to easily make studies of performance degradation of several modifications of the original dataset, for i…
▽ More
IQUAFLOW is a new image quality framework that provides a set of tools to assess image quality. The user can add custom metrics that can be easily integrated. Furthermore, iquaflow allows to measure quality by using the performance of AI models trained on the images as a proxy. This also helps to easily make studies of performance degradation of several modifications of the original dataset, for instance, with images reconstructed after different levels of lossy compression; satellite images would be a use case example, since they are commonly compressed before downloading to the ground. In this situation, the optimization problem consists in finding the smallest images that provide yet sufficient quality to meet the required performance of the deep learning algorithms. Thus, a study with iquaflow is suitable for such case. All this development is wrapped in Mlflow: an interactive tool used to visualize and summarize the results. This document describes different use cases and provides links to their respective repositories. To ease the creation of new studies, we include a cookie-cutter repository. The source code, issue tracker and aforementioned repositories are all hosted on GitHub https://github.com/satellogic/iquaflow.
△ Less
Submitted 24 October, 2022;
originally announced October 2022.
-
Rice-Marlin Codes: Tiny and Efficient Variable-to-Fixed Codes
Authors:
Manuel Martinez,
Joan Serra-Sagristà
Abstract:
Marlin is a Variable-to-Fixed (VF) codec optimized for high decoding speed through the use of small sized dictionaries that fit in the L1 cache of most CPUs. While the size of Marlin dictionaries is adequate for decoding, they are still too large to be encoded fast. We address this problem by proposing two techniques to reduce the alphabet size. The first technique is to encode rare symbols in the…
▽ More
Marlin is a Variable-to-Fixed (VF) codec optimized for high decoding speed through the use of small sized dictionaries that fit in the L1 cache of most CPUs. While the size of Marlin dictionaries is adequate for decoding, they are still too large to be encoded fast. We address this problem by proposing two techniques to reduce the alphabet size. The first technique is to encode rare symbols in their own segment, and the second is to combine Marlin dictionaries with Rice encoding, hence our name Rice-Marlin for our new codec. Using those techniques, we are able to reduce the size of Marlin dictionaries by a factor of 16, not only enabling faster encoding speed, but also achieving better compression efficiency.
△ Less
Submitted 14 November, 2018;
originally announced November 2018.
-
Lower Bounds on the Redundancy of Huffman Codes with Known and Unknown Probabilities
Authors:
Ian Blanes,
Miguel Hernández-Cabronero,
Joan Serra-Sagristà,
Michael W. Marcellin
Abstract:
In this paper we provide a method to obtain tight lower bounds on the minimum redundancy achievable by a Huffman code when the probability distribution underlying an alphabet is only partially known. In particular, we address the case where the occurrence probabilities are unknown for some of the symbols in an alphabet. Bounds can be obtained for alphabets of a given size, for alphabets of up to a…
▽ More
In this paper we provide a method to obtain tight lower bounds on the minimum redundancy achievable by a Huffman code when the probability distribution underlying an alphabet is only partially known. In particular, we address the case where the occurrence probabilities are unknown for some of the symbols in an alphabet. Bounds can be obtained for alphabets of a given size, for alphabets of up to a given size, and for alphabets of arbitrary size. The method operates on a Computer Algebra System, yielding closed-form numbers for all results. Finally, we show the potential of the proposed method to shed some light on the structure of the minimum redundancy achievable by the Huffman code.
△ Less
Submitted 2 September, 2019; v1 submitted 14 September, 2018;
originally announced September 2018.
