-
Artistic style transfer for videos and spherical images
Authors:
Manuel Ruder,
Alexey Dosovitskiy,
Thomas Brox
Abstract:
Manually re-drawing an image in a certain artistic style takes a professional artist a long time. Doing this for a video sequence single-handedly is beyond imagination. We present two computational approaches that transfer the style from one image (for example, a painting) to a whole video sequence. In our first approach, we adapt to videos the original image style transfer technique by Gatys et a…
▽ More
Manually re-drawing an image in a certain artistic style takes a professional artist a long time. Doing this for a video sequence single-handedly is beyond imagination. We present two computational approaches that transfer the style from one image (for example, a painting) to a whole video sequence. In our first approach, we adapt to videos the original image style transfer technique by Gatys et al. based on energy minimization. We introduce new ways of initialization and new loss functions to generate consistent and stable stylized video sequences even in cases with large motion and strong occlusion. Our second approach formulates video stylization as a learning problem. We propose a deep network architecture and training procedures that allow us to stylize arbitrary-length videos in a consistent and stable way, and nearly in real time. We show that the proposed methods clearly outperform simpler baselines both qualitatively and quantitatively. Finally, we propose a way to adapt these approaches also to 360 degree images and videos as they emerge with recent virtual reality hardware.
△ Less
Submitted 5 August, 2018; v1 submitted 13 August, 2017;
originally announced August 2017.
-
Artistic style transfer for videos
Authors:
Manuel Ruder,
Alexey Dosovitskiy,
Thomas Brox
Abstract:
In the past, manually re-drawing an image in a certain artistic style required a professional artist and a long time. Doing this for a video sequence single-handed was beyond imagination. Nowadays computers provide new possibilities. We present an approach that transfers the style from one image (for example, a painting) to a whole video sequence. We make use of recent advances in style transfer i…
▽ More
In the past, manually re-drawing an image in a certain artistic style required a professional artist and a long time. Doing this for a video sequence single-handed was beyond imagination. Nowadays computers provide new possibilities. We present an approach that transfers the style from one image (for example, a painting) to a whole video sequence. We make use of recent advances in style transfer in still images and propose new initializations and loss functions applicable to videos. This allows us to generate consistent and stable stylized video sequences, even in cases with large motion and strong occlusion. We show that the proposed method clearly outperforms simpler baselines both qualitatively and quantitatively.
△ Less
Submitted 19 October, 2016; v1 submitted 28 April, 2016;
originally announced April 2016.
-
Receiver Concepts and Resource Allocation for OSC Downlink Transmission
Authors:
Michael A. Ruder,
Raimund Meyer,
Frank Obernosterer,
Hans Kalveram,
Robert Schober,
Wolfgang H. Gerstacker
Abstract:
Voice services over Adaptive Multi-user channels on One Slot (VAMOS) has been standardized as an extension to the Global System for Mobile Communications (GSM). The aim of VAMOS is to increase the capacity of GSM, while maintaining backward compatibility with the legacy system. To this end, the Orthogonal Sub-channels (OSC) concept is employed, where two Gaussian minimum-shift keying (GMSK) signal…
▽ More
Voice services over Adaptive Multi-user channels on One Slot (VAMOS) has been standardized as an extension to the Global System for Mobile Communications (GSM). The aim of VAMOS is to increase the capacity of GSM, while maintaining backward compatibility with the legacy system. To this end, the Orthogonal Sub-channels (OSC) concept is employed, where two Gaussian minimum-shift keying (GMSK) signals are transmitted in the same time slot and with the same carrier frequency. To fully exploit the possible capacity gain of OSC, new receiver concepts are necessary. In contrast to the base station, where multiple antennas can be employed, the mobile station is typically equipped with only one receive antenna. Therefore, the downlink receiver design is a very challenging task. Different concepts for channel estimation, user separation, and equalization at the receiver of an OSC downlink transmission are introduced in this paper. Furthermore, the system capacity must be improved by suitable downlink power and resource allocation algorithms. Making realistic assumptions on the information available at the base station, an algorithm for joint power and radio resource allocation is proposed. Simulation results show the excellent performance of the proposed channel estimation algorithms, equalization schemes, and joint radio resource and power allocation algorithms in realistic VAMOS environments.
△ Less
Submitted 14 October, 2013; v1 submitted 7 June, 2013;
originally announced June 2013.
-
Cold atoms in a high-Q ring-cavity
Authors:
D. Kruse,
M. Ruder,
J. Benhelm,
C. von Cube,
C. Zimmermann,
Ph. W. Courteille,
Th. Elsaesser,
B. Nagorny,
A. Hemmerich
Abstract:
We report the confinement of large clouds of ultra-cold 85-Rb atoms in a standing-wave dipole trap formed by the two counter-propagating modes of a high-Q ring-cavity. Studying the properties of this trap we demonstrate loading of higher-order transverse cavity modes and excite recoil-induced resonances.
We report the confinement of large clouds of ultra-cold 85-Rb atoms in a standing-wave dipole trap formed by the two counter-propagating modes of a high-Q ring-cavity. Studying the properties of this trap we demonstrate loading of higher-order transverse cavity modes and excite recoil-induced resonances.
△ Less
Submitted 12 February, 2003;
originally announced February 2003.
