-
Efficient Single-Image Depth Estimation on Mobile Devices, Mobile AI & AIM 2022 Challenge: Report
Authors:
Andrey Ignatov,
Grigory Malivenko,
Radu Timofte,
Lukasz Treszczotko,
Xin Chang,
Piotr Ksiazek,
Michal Lopuszynski,
Maciej Pioro,
Rafal Rudnicki,
Maciej Smyl,
Yujie Ma,
Zhenyu Li,
Zehui Chen,
Jialei Xu,
Xianming Liu,
Junjun Jiang,
XueChao Shi,
Difan Xu,
Yanan Li,
Xiaotao Wang,
Lei Lei,
Ziyu Zhang,
Yicheng Wang,
Zilong Huang,
Guozhong Luo
, et al. (14 additional authors not shown)
Abstract:
Various depth estimation models are now widely used on many mobile and IoT devices for image segmentation, bokeh effect rendering, object tracking and many other mobile tasks. Thus, it is very crucial to have efficient and accurate depth estimation models that can run fast on low-power mobile chipsets. In this Mobile AI challenge, the target was to develop deep learning-based single image depth es…
▽ More
Various depth estimation models are now widely used on many mobile and IoT devices for image segmentation, bokeh effect rendering, object tracking and many other mobile tasks. Thus, it is very crucial to have efficient and accurate depth estimation models that can run fast on low-power mobile chipsets. In this Mobile AI challenge, the target was to develop deep learning-based single image depth estimation solutions that can show a real-time performance on IoT platforms and smartphones. For this, the participants used a large-scale RGB-to-depth dataset that was collected with the ZED stereo camera capable to generated depth maps for objects located at up to 50 meters. The runtime of all models was evaluated on the Raspberry Pi 4 platform, where the developed solutions were able to generate VGA resolution depth maps at up to 27 FPS while achieving high fidelity results. All models developed in the challenge are also compatible with any Android or Linux-based mobile devices, their detailed description is provided in this paper.
△ Less
Submitted 7 November, 2022;
originally announced November 2022.
-
NTIRE 2020 Challenge on Real Image Denoising: Dataset, Methods and Results
Authors:
Abdelrahman Abdelhamed,
Mahmoud Afifi,
Radu Timofte,
Michael S. Brown,
Yue Cao,
Zhilu Zhang,
Wangmeng Zuo,
Xiaoling Zhang,
Jiye Liu,
Wendong Chen,
Changyuan Wen,
Meng Liu,
Shuailin Lv,
Yunchao Zhang,
Zhihong Pan,
Baopu Li,
Teng Xi,
Yanwen Fan,
Xiyu Yu,
Gang Zhang,
**gtuo Liu,
Junyu Han,
Errui Ding,
Songhyun Yu,
Bumjun Park
, et al. (65 additional authors not shown)
Abstract:
This paper reviews the NTIRE 2020 challenge on real image denoising with focus on the newly introduced dataset, the proposed methods and their results. The challenge is a new version of the previous NTIRE 2019 challenge on real image denoising that was based on the SIDD benchmark. This challenge is based on a newly collected validation and testing image datasets, and hence, named SIDD+. This chall…
▽ More
This paper reviews the NTIRE 2020 challenge on real image denoising with focus on the newly introduced dataset, the proposed methods and their results. The challenge is a new version of the previous NTIRE 2019 challenge on real image denoising that was based on the SIDD benchmark. This challenge is based on a newly collected validation and testing image datasets, and hence, named SIDD+. This challenge has two tracks for quantitatively evaluating image denoising performance in (1) the Bayer-pattern rawRGB and (2) the standard RGB (sRGB) color spaces. Each track ~250 registered participants. A total of 22 teams, proposing 24 methods, competed in the final phase of the challenge. The proposed methods by the participating teams represent the current state-of-the-art performance in image denoising targeting real noisy images. The newly collected SIDD+ datasets are publicly available at: https://bit.ly/siddplus_data.
△ Less
Submitted 8 May, 2020;
originally announced May 2020.
-
Superkernel Neural Architecture Search for Image Denoising
Authors:
Marcin Możejko,
Tomasz Latkowski,
Łukasz Treszczotko,
Michał Szafraniuk,
Krzysztof Trojanowski
Abstract:
Recent advancements in Neural Architecture Search(NAS) resulted in finding new state-of-the-art Artificial Neural Network (ANN) solutions for tasks like image classification, object detection, or semantic segmentation without substantial human supervision. In this paper, we focus on exploring NAS for a dense prediction task that is image denoising. Due to a costly training procedure, most NAS solu…
▽ More
Recent advancements in Neural Architecture Search(NAS) resulted in finding new state-of-the-art Artificial Neural Network (ANN) solutions for tasks like image classification, object detection, or semantic segmentation without substantial human supervision. In this paper, we focus on exploring NAS for a dense prediction task that is image denoising. Due to a costly training procedure, most NAS solutions for image enhancement rely on reinforcement learning or evolutionary algorithm exploration, which usually take weeks (or even months) to train. Therefore, we introduce a new efficient implementation of various superkernel techniques that enable fast (6-8 RTX2080 GPU hours) single-shot training of models for dense predictions. We demonstrate the effectiveness of our method on the SIDD+ benchmark for image denoising.
△ Less
Submitted 19 April, 2020;
originally announced April 2020.
-
Limit theorems for integrated trawl processes with symmetric Lévy bases
Authors:
Anna Talarczyk,
Łukasz Treszczotko
Abstract:
We study long time behavior of integrated trawl processes introduced by Barndorff-Nielsen. The trawl processes form a class of stationary infinitely divisible processes, described by an infinitely divisible random measure (Lévy base) and a family of shifts of a fixed set (trawl). We assume that the Lévy base is symmetric and homogeneous and that the trawl set is determined by the trawl function th…
▽ More
We study long time behavior of integrated trawl processes introduced by Barndorff-Nielsen. The trawl processes form a class of stationary infinitely divisible processes, described by an infinitely divisible random measure (Lévy base) and a family of shifts of a fixed set (trawl). We assume that the Lévy base is symmetric and homogeneous and that the trawl set is determined by the trawl function that decays slowly. Depending on the geometry of the trawl set and on the Lévy measure corresponding to the Lévy base we obtain various types of limits in law of the normalized integrated trawl processes for large times. The limit processes are always stable and self-similar with stationary increments. In some cases they have independent increments - they are stable Lévy processes where the index of stability depends on the parameters of the model. We show that stable limits with stability index smaller than 2 may appear even in cases when the underlying Lévy base has all its moments finite. In other cases, the limit process has dependent increments and it may be considered as a new extension of fractional Brownian motion to the class of stable processes.
△ Less
Submitted 30 June, 2019;
originally announced July 2019.
-
From Hawkes-type processes to stochastic volatility
Authors:
Łukasz Treszczotko
Abstract:
We introduce a Hawkes-like process and study its scaling limit as the system becomes increasingly endogenous. We derive functional limit theorems for intensity and fluctuations. Then, we introduce a high-frequency model for a price of a liquid traded financial instrument in which the nearly unstable regime leads to a Heston-type process where the negative correlation between the noise driving the…
▽ More
We introduce a Hawkes-like process and study its scaling limit as the system becomes increasingly endogenous. We derive functional limit theorems for intensity and fluctuations. Then, we introduce a high-frequency model for a price of a liquid traded financial instrument in which the nearly unstable regime leads to a Heston-type process where the negative correlation between the noise driving the proce of the instrument and the volatility can be viewed as a result of high variance of the sell-side order arrivals.
△ Less
Submitted 11 July, 2018;
originally announced July 2018.
-
Random walks in doubly random scenery
Authors:
Łukasz Treszczotko
Abstract:
We provide a random walk in random scenery representation of a new class of stable self-similar processes with stationary increments introduced recently by Jung, Owada and Samorodnitsky. In the functional limit theorem they provided, only a single instance of this class arose as a limit. We construct a model in which a significant portion of processes in this new class is obtained as a limit.
We provide a random walk in random scenery representation of a new class of stable self-similar processes with stationary increments introduced recently by Jung, Owada and Samorodnitsky. In the functional limit theorem they provided, only a single instance of this class arose as a limit. We construct a model in which a significant portion of processes in this new class is obtained as a limit.
△ Less
Submitted 25 February, 2018;
originally announced February 2018.
-
Infinite variance $H$-sssi processes as limits of particle systems
Authors:
Łukasz Treszczotko
Abstract:
We consider a particle system with weights and the scaling limits derived from its occupation time. We let the particles perform independent recurrent Lévy motions and we assume that their initial positions and weights are given by a Poisson point process. In the limit we obtain a number of recently discovered stationary stable self-similar processes recently studied in [SAM1] and [SAM2]. We also…
▽ More
We consider a particle system with weights and the scaling limits derived from its occupation time. We let the particles perform independent recurrent Lévy motions and we assume that their initial positions and weights are given by a Poisson point process. In the limit we obtain a number of recently discovered stationary stable self-similar processes recently studied in [SAM1] and [SAM2]. We also observe very different limit processes depending on whether the function, whose occupation time is considered, integrates to zero or not.
△ Less
Submitted 26 January, 2018; v1 submitted 22 September, 2017;
originally announced September 2017.
-
Particle picture representation of the non-symmetric Rosenblatt process and Hermite processes of any order
Authors:
Łukasz Treszczotko
Abstract:
We provide a particle picture representation for the non-symmetric Rosenblatt process and for Hermite processes of any order, extending the result of Bojdecki, Gorostiza and Talarczyk in~\cite{FILT}. We show that these processes can be obtained as limits in the sense of finite-dimensional distributions of certain functionals of a system of particles evolving according to symmetric stable Lévy moti…
▽ More
We provide a particle picture representation for the non-symmetric Rosenblatt process and for Hermite processes of any order, extending the result of Bojdecki, Gorostiza and Talarczyk in~\cite{FILT}. We show that these processes can be obtained as limits in the sense of finite-dimensional distributions of certain functionals of a system of particles evolving according to symmetric stable Lévy motions. In the case of $k$-Hermite processes the corresponding functional involves $k$-intersection local time of symmetric stable Lévy processes
△ Less
Submitted 3 March, 2017; v1 submitted 2 March, 2017;
originally announced March 2017.