Neural Network Compression for Reinforcement Learning Tasks
Authors:
Dmitry A. Ivanov,
Denis A. Larionov,
Oleg V. Maslennikov,
Vladimir V. Voevodin
Abstract:
In real applications of Reinforcement Learning (RL), such as robotics, low latency and energy efficient inference is very desired. The use of sparsity and pruning for optimizing Neural Network inference, and particularly to improve energy and latency efficiency, is a standard technique. In this work, we perform a systematic investigation of applying these optimization techniques for different RL a…
▽ More
In real applications of Reinforcement Learning (RL), such as robotics, low latency and energy efficient inference is very desired. The use of sparsity and pruning for optimizing Neural Network inference, and particularly to improve energy and latency efficiency, is a standard technique. In this work, we perform a systematic investigation of applying these optimization techniques for different RL algorithms in different RL environments, yielding up to a 400-fold reduction in the size of neural networks.
△ Less
Submitted 13 May, 2024;
originally announced May 2024.
MoRF: Mobile Realistic Fullbody Avatars from a Monocular Video
Authors:
Renat Bashirov,
Alexey Larionov,
Evgeniya Ustinova,
Mikhail Sidorenko,
David Svitov,
Ilya Zakharkin,
Victor Lempitsky
Abstract:
We present a system to create Mobile Realistic Fullbody (MoRF) avatars. MoRF avatars are rendered in real-time on mobile devices, learned from monocular videos, and have high realism. We use SMPL-X as a proxy geometry and render it with DNR (neural texture and image-2-image network). We improve on prior work, by overfitting per-frame war** fields in the neural texture space, allowing to better a…
▽ More
We present a system to create Mobile Realistic Fullbody (MoRF) avatars. MoRF avatars are rendered in real-time on mobile devices, learned from monocular videos, and have high realism. We use SMPL-X as a proxy geometry and render it with DNR (neural texture and image-2-image network). We improve on prior work, by overfitting per-frame war** fields in the neural texture space, allowing to better align the training signal between different frames. We also refine SMPL-X mesh fitting procedure to improve the overall avatar quality. In the comparisons to other monocular video-based avatar systems, MoRF avatars achieve higher image sharpness and temporal consistency. Participants of our user study also preferred avatars generated by MoRF.
△ Less
Submitted 11 December, 2023; v1 submitted 17 March, 2023;
originally announced March 2023.
