FVV Live: A real-time free-viewpoint video system with consumer electronics hardware
Authors:
Pablo Carballeira,
Carlos Carmona,
César Díaz,
Daniel Berjón,
Daniel Corregidor,
Julián Cabrera,
Francisco Morán,
Carmen Doblado,
Sergio Arnaldo,
María del Mar Martín,
Narciso García
Abstract:
FVV Live is a novel end-to-end free-viewpoint video system, designed for low cost and real-time operation, based on off-the-shelf components. The system has been designed to yield high-quality free-viewpoint video using consumer-grade cameras and hardware, which enables low deployment costs and easy installation for immersive event-broadcasting or videoconferencing.
The paper describes the archi…
▽ More
FVV Live is a novel end-to-end free-viewpoint video system, designed for low cost and real-time operation, based on off-the-shelf components. The system has been designed to yield high-quality free-viewpoint video using consumer-grade cameras and hardware, which enables low deployment costs and easy installation for immersive event-broadcasting or videoconferencing.
The paper describes the architecture of the system, including acquisition and encoding of multiview plus depth data in several capture servers and virtual view synthesis on an edge server. All the blocks of the system have been designed to overcome the limitations imposed by hardware and network, which impact directly on the accuracy of depth data and thus on the quality of virtual view synthesis. The design of FVV Live allows for an arbitrary number of cameras and capture servers, and the results presented in this paper correspond to an implementation with nine stereo-based depth cameras.
FVV Live presents low motion-to-photon and end-to-end delays, which enables seamless free-viewpoint navigation and bilateral immersive communications. Moreover, the visual quality of FVV Live has been assessed through subjective assessment with satisfactory results, and additional comparative tests show that it is preferred over state-of-the-art DIBR alternatives.
△ Less
Submitted 1 July, 2020;
originally announced July 2020.
FVV Live: Real-Time, Low-Cost, Free Viewpoint Video
Authors:
Daniel Berjón,
Pablo Carballeira,
Julián Cabrera,
Carlos Carmona,
Daniel Corregidor,
César Díaz,
Francisco Morán,
Narciso García
Abstract:
FVV Live is a novel real-time, low-latency, end-to-end free viewpoint system including capture, transmission, synthesis on an edge server and visualization and control on a mobile terminal. The system has been specially designed for low-cost and real-time operation, only using off-the-shelf components.
FVV Live is a novel real-time, low-latency, end-to-end free viewpoint system including capture, transmission, synthesis on an edge server and visualization and control on a mobile terminal. The system has been specially designed for low-cost and real-time operation, only using off-the-shelf components.
△ Less
Submitted 30 June, 2020;
originally announced June 2020.
