-
Quality-Aware Dynamic Resolution Adaptation Framework for Adaptive Video Streaming
Authors:
Amritha Premkumar,
Prajit T Rajendran,
Vignesh V Menon,
Adam Wieckowski,
Benjamin Bross,
Detlev Marpe
Abstract:
Traditional per-title encoding schemes aim to optimize encoding resolutions to deliver the highest perceptual quality for each representation. XPSNR is observed to correlate better with the subjective quality of VVC-coded bitstreams. Towards this realization, we predict the average XPSNR of VVC-coded bitstreams using spatiotemporal complexity features of the video and the target encoding configura…
▽ More
Traditional per-title encoding schemes aim to optimize encoding resolutions to deliver the highest perceptual quality for each representation. XPSNR is observed to correlate better with the subjective quality of VVC-coded bitstreams. Towards this realization, we predict the average XPSNR of VVC-coded bitstreams using spatiotemporal complexity features of the video and the target encoding configuration using an XGBoost-based model. Based on the predicted XPSNR scores, we introduce a Quality-A ware Dynamic Resolution Adaptation (QADRA) framework for adaptive video streaming applications, where we determine the convex-hull online. Furthermore, kee** the encoding and decoding times within an acceptable threshold is mandatory for smooth and energy-efficient streaming. Hence, QADRA determines the encoding resolution and quantization parameter (QP) for each target bitrate by maximizing XPSNR while constraining the maximum encoding and/ or decoding time below a threshold. QADRA implements a JND-based representation elimination algorithm to remove perceptually redundant representations from the bitrate ladder. QADRA is an open-source Python-based framework published under the GNU GPLv3 license. Github: https://github.com/PhoenixVideo/QADRA Online documentation: https://phoenixvideo.github.io/QADRA/
△ Less
Submitted 16 March, 2024;
originally announced March 2024.
-
Video Super-Resolution for Optimized Bitrate and Green Online Streaming
Authors:
Vignesh V Menon,
Prajit T Rajendran,
Amritha Premkumar,
Benjamin Bross,
Detlev Marpe
Abstract:
Conventional per-title encoding schemes strive to optimize encoding resolutions to deliver the utmost perceptual quality for each bitrate ladder representation. Nevertheless, maintaining encoding time within an acceptable threshold is equally imperative in online streaming applications. Furthermore, modern client devices are equipped with the capability for fast deep-learning-based video super-res…
▽ More
Conventional per-title encoding schemes strive to optimize encoding resolutions to deliver the utmost perceptual quality for each bitrate ladder representation. Nevertheless, maintaining encoding time within an acceptable threshold is equally imperative in online streaming applications. Furthermore, modern client devices are equipped with the capability for fast deep-learning-based video super-resolution (VSR) techniques, enhancing the perceptual quality of the decoded bitstream. This suggests that opting for lower resolutions in representations during the encoding process can curtail the overall energy consumption without substantially compromising perceptual quality. In this context, this paper introduces a video super-resolution-based latency-aware optimized bitrate encoding scheme (ViSOR) designed for online adaptive streaming applications. ViSOR determines the encoding resolution for each target bitrate, ensuring the highest achievable perceptual quality after VSR within the bound of a maximum acceptable latency. Random forest-based prediction models are trained to predict the perceptual quality after VSR and the encoding time for each resolution using the spatiotemporal features extracted for each video segment. Experimental results show that ViSOR targeting fast super-resolution convolutional neural network (FSRCNN) achieves an overall average bitrate reduction of 24.65 % and 32.70 % to maintain the same PSNR and VMAF, compared to the HTTP Live Streaming (HLS) bitrate ladder encoding of 4 s segments using the x265 encoder, when the maximum acceptable latency for each representation is set as two seconds. Considering a just noticeable difference (JND) of six VMAF points, the average cumulative storage consumption and encoding energy for each segment is reduced by 79.32 % and 68.21 %, respectively, contributing towards greener streaming.
△ Less
Submitted 5 February, 2024;
originally announced February 2024.
-
Energy-efficient Adaptive Video Streaming with Latency-Aware Dynamic Resolution Encoding
Authors:
Vignesh V Menon,
Amritha Premkumar,
Prajit T Rajendran,
Adam Wieckowski,
Benjamin Bross,
Christian Timmerer,
Detlev Marpe
Abstract:
Traditional per-title encoding schemes aim to optimize encoding resolutions to deliver the highest perceptual quality for each representation. However, kee** the encoding time within an acceptable threshold for a smooth user experience is important to reduce the carbon footprint and energy consumption on encoding servers in video streaming applications. Toward this realization, we introduce an e…
▽ More
Traditional per-title encoding schemes aim to optimize encoding resolutions to deliver the highest perceptual quality for each representation. However, kee** the encoding time within an acceptable threshold for a smooth user experience is important to reduce the carbon footprint and energy consumption on encoding servers in video streaming applications. Toward this realization, we introduce an encoding latency-a ware dynamic resolution encoding scheme (LADRE) for adaptive video streaming applications. LADRE determines the encoding resolution for each target bitrate by utilizing a random forest-based prediction model for every video segment based on spatiotemporal features and the acceptable target latency. Experimental results show that LADRE achieves an overall average quality improvement of 0.58 dB PSNR and 0.43 dB XPSNR while maintaining the same bitrate, compared to the HTTP Live Streaming (HLS) bitrate ladder encoding of 200 s segments using the VVenC encoder, when the encoding latency for each representation is set to remain below the 200 s threshold. This is accompanied by an 84.17 % reduction in overall encoding energy consumption.
△ Less
Submitted 27 January, 2024;
originally announced January 2024.
-
Generative Diffusion From An Action Principle
Authors:
Akhil Premkumar
Abstract:
Generative diffusion models synthesize new samples by reversing a diffusive process that converts a given data set to generic noise. This is accomplished by training a neural network to match the gradient of the log of the probability distribution of a given data set, also called the score. By casting reverse diffusion as an optimal control problem, we show that score matching can be derived from…
▽ More
Generative diffusion models synthesize new samples by reversing a diffusive process that converts a given data set to generic noise. This is accomplished by training a neural network to match the gradient of the log of the probability distribution of a given data set, also called the score. By casting reverse diffusion as an optimal control problem, we show that score matching can be derived from an action principle, like the ones commonly used in physics. We use this insight to demonstrate the connection between different classes of diffusion models.
△ Less
Submitted 6 October, 2023;
originally announced October 2023.
-
Large Deviations in the Early Universe
Authors:
Timothy Cohen,
Daniel Green,
Akhil Premkumar
Abstract:
Fluctuations play a critical role in cosmology. They are relevant across a range of phenomena from the dynamics of inflation to the formation of structure. In many cases, these fluctuations are coarse grained and follow a Gaussian distribution as a consequence of the Central Limit Theorem. Yet, some classes of observables are dominated by rare fluctuations and are sensitive to the details of the u…
▽ More
Fluctuations play a critical role in cosmology. They are relevant across a range of phenomena from the dynamics of inflation to the formation of structure. In many cases, these fluctuations are coarse grained and follow a Gaussian distribution as a consequence of the Central Limit Theorem. Yet, some classes of observables are dominated by rare fluctuations and are sensitive to the details of the underlying microphysics. In this paper, we argue that the Large Deviation Principle can be used to diagnose when one must to appeal to the fundamental description. Concretely, we investigate the regime of validity for the Fokker-Planck equation that governs Stochastic Inflation. For typical fluctuations, this framework leads to the central limit-type behavior expected of a random walk. However, fluctuations in the regime of the Large Deviation Principle are determined by instanton-like saddle points accompanied by a new energy scale. When this energy scale is above the UV cutoff of the EFT, the tail is only calculable in the microscopic description. We explicitly demonstrate this phenomenon in the context of determining the phase transition to eternal inflation, the distribution of scalar field fluctuations in de Sitter, and the production of primordial black holes.
△ Less
Submitted 8 May, 2023; v1 submitted 5 December, 2022;
originally announced December 2022.
-
A Tail of Eternal Inflation
Authors:
Timothy Cohen,
Daniel Green,
Akhil Premkumar
Abstract:
Non-trivial inflaton self-interactions can yield calculable signatures of primordial non-Gaussianity that are measurable in cosmic surveys. Surprisingly, we find that the phase transition to slow-roll eternal inflation is often incalculable in the same models. Instead, this transition is sensitive to the non-Gaussian tail of the distribution of scalar fluctuations, which probes physics inside the…
▽ More
Non-trivial inflaton self-interactions can yield calculable signatures of primordial non-Gaussianity that are measurable in cosmic surveys. Surprisingly, we find that the phase transition to slow-roll eternal inflation is often incalculable in the same models. Instead, this transition is sensitive to the non-Gaussian tail of the distribution of scalar fluctuations, which probes physics inside the horizon, potentially beyond the cutoff scale of the Effective Field Theory of Inflation. We demonstrate this fact directly by calculating non-Gaussian corrections to Stochastic Inflation within the framework of Soft de Sitter Effective Theory, from which we derive the associated probability distribution for the scalar fluctuations. We find parameter space consistent with current observations and weak coupling at horizon crossing in which the large fluctuations relevant for eternal inflation can only be determined by appealing to a UV completion. We also show this breakdown of the perturbative description is required for the de Sitter entropy to reflect the number of de Sitter microstates.
△ Less
Submitted 19 December, 2021; v1 submitted 17 November, 2021;
originally announced November 2021.
-
Regulating loops in de Sitter spacetime
Authors:
Akhil Premkumar
Abstract:
Perturbative quantum field theory (QFT) calculations in de Sitter space are riddled with contributions that diverge over time. These contributions often arise from loop integrals, which are notoriously hard to compute in de Sitter. We discuss an approach to evaluate loop integrals that contribute to equal-time correlators of a scalar field theory in a fixed de Sitter background. Our method is base…
▽ More
Perturbative quantum field theory (QFT) calculations in de Sitter space are riddled with contributions that diverge over time. These contributions often arise from loop integrals, which are notoriously hard to compute in de Sitter. We discuss an approach to evaluate loop integrals that contribute to equal-time correlators of a scalar field theory in a fixed de Sitter background. Our method is based on the Mellin-Barnes representation of correlation functions, which allows us to regulate loop divergences by adjusting the masses of the fields, or by gently deforming the underlying de Sitter spacetime. The resulting expressions have a similar structure as a standard answer from dimensional regularization in flat space QFT. These features of the regulator are illustrated with two examples, worked out in detail. Along the way, we illuminate the physical origin of these divergences and their interpretation with the machinery of the dynamical renormalization group. Our approach regulates the IR divergences of massless and massive particles in the same way. For massless scalars, the loop corrections can be incorporated as systematic improvements to the stochastic inflation framework, allowing for a more precise description of the IR dynamics of such fields in de Sitter.
△ Less
Submitted 2 February, 2024; v1 submitted 24 October, 2021;
originally announced October 2021.
-
Stochastic Inflation at NNLO
Authors:
Timothy Cohen,
Daniel Green,
Akhil Premkumar,
Alexander Ridgway
Abstract:
Stochastic Inflation is an important framework for understanding the physics of de Sitter space and the phenomenology of inflation. In the leading approximation, this approach results in a Fokker-Planck equation that calculates the probability distribution for a light scalar field as a function of time. Despite its successes, the quantum field theoretic origins and the range of validity for this e…
▽ More
Stochastic Inflation is an important framework for understanding the physics of de Sitter space and the phenomenology of inflation. In the leading approximation, this approach results in a Fokker-Planck equation that calculates the probability distribution for a light scalar field as a function of time. Despite its successes, the quantum field theoretic origins and the range of validity for this equation have remained elusive, and establishing a formalism to systematically incorporate higher order effects has been an area of active study. In this paper, we calculate the next-to-next-to-leading order (NNLO) corrections to Stochastic Inflation using Soft de Sitter Effective Theory (SdSET). In this effective description, Stochastic Inflation manifests as the renormalization group evolution of composite operators. The leading impact of non-Gaussian quantum fluctuations appears at NNLO, which is presented here for the first time; we derive the coefficient of this term from a two-loop anomalous dimension calculation within SdSET. We solve the resulting equation to determine the NNLO equilibrium distribution and the low-lying relaxation eigenvalues. In the process, we must match the UV theory onto SdSET at one-loop order, which provides a non-trivial confirmation that the separation into Wilson-coefficient corrections and contributions to initial conditions persists beyond tree level. Furthermore, these results illustrate how the naive factorization of time and momentum integrals in SdSET no longer holds in the presence of logarithmic divergences. It is these effects that ultimately give rise to the renormalization group flow that yields Stochastic Inflation.
△ Less
Submitted 22 September, 2021; v1 submitted 17 June, 2021;
originally announced June 2021.
-
Combining Geometric and Information-Theoretic Approaches for Multi-Robot Exploration
Authors:
Aravind Preshant Premkumar,
Kevin Yu,
Pratap Tokekar
Abstract:
We present an algorithm to explore an orthogonal polygon using a team of $p$ robots. This algorithm combines ideas from information-theoretic exploration algorithms and computational geometry based exploration algorithms. We show that the exploration time of our algorithm is competitive (as a function of $p$) with respect to the offline optimal exploration algorithm. The algorithm is based on a si…
▽ More
We present an algorithm to explore an orthogonal polygon using a team of $p$ robots. This algorithm combines ideas from information-theoretic exploration algorithms and computational geometry based exploration algorithms. We show that the exploration time of our algorithm is competitive (as a function of $p$) with respect to the offline optimal exploration algorithm. The algorithm is based on a single-robot polygon exploration algorithm, a tree exploration algorithm for higher level planning and a submodular orienteering algorithm for lower level planning. We discuss how this strategy can be adapted to real-world settings to deal with noisy sensors. In addition to theoretical analysis, we investigate the performance of our algorithm through simulations for multiple robots and experiments with a single robot.
△ Less
Submitted 14 April, 2020;
originally announced April 2020.
-
Microscopic Relaxation Channels in Materials for Superconducting Qubits
Authors:
Anjali Premkumar,
Conan Weiland,
Sooyeon Hwang,
Berthold Jaeck,
Alexander P. M. Place,
Iradwikanari Waluyo,
Adrian Hunt,
Valentina Bisogni,
Jonathan Pelliciari,
Andi Barbour,
Mike S. Miller,
Paola Russo,
Fernando Camino,
Kim Kisslinger,
Xiao Tong,
Mark S. Hybertsen,
Andrew A. Houck,
Ignace Jarrige
Abstract:
Despite mounting evidence that materials imperfections are a major obstacle to practical applications of superconducting qubits, connections between microscopic material properties and qubit coherence are poorly understood. Here, we perform measurements of transmon qubit relaxation times $T_1$ in parallel with spectroscopy and microscopy of the thin polycrystalline niobium films used in qubit fabr…
▽ More
Despite mounting evidence that materials imperfections are a major obstacle to practical applications of superconducting qubits, connections between microscopic material properties and qubit coherence are poorly understood. Here, we perform measurements of transmon qubit relaxation times $T_1$ in parallel with spectroscopy and microscopy of the thin polycrystalline niobium films used in qubit fabrication. By comparing results for films deposited using three techniques, we reveal correlations between $T_1$ and grain size, enhanced oxygen diffusion along grain boundaries, and the concentration of suboxides near the surface. Physical mechanisms connect these microscopic properties to residual surface resistance and $T_1$ through losses arising from the grain boundaries and from defects in the suboxides. Further, experiments show that the residual resistance ratio can be used as a figure of merit for qubit lifetime. This comprehensive approach to understanding qubit decoherence charts a pathway for materials-driven improvements of superconducting qubit performance.
△ Less
Submitted 6 April, 2020;
originally announced April 2020.
-
New material platform for superconducting transmon qubits with coherence times exceeding 0.3 milliseconds
Authors:
Alex P. M. Place,
Lila V. H. Rodgers,
Pranav Mundada,
Basil M. Smitham,
Mattias Fitzpatrick,
Zhaoqi Leng,
Anjali Premkumar,
Jacob Bryon,
Sara Sussman,
Guangming Cheng,
Trisha Madhavan,
Harshvardhan K. Babla,
Berthold Jaeck,
Andras Gyenis,
Nan Yao,
Robert J. Cava,
Nathalie P. de Leon,
Andrew A. Houck
Abstract:
The superconducting transmon qubit is a leading platform for quantum computing and quantum science. Building large, useful quantum systems based on transmon qubits will require significant improvements in qubit relaxation and coherence times, which are orders of magnitude shorter than limits imposed by bulk properties of the constituent materials. This indicates that relaxation likely originates f…
▽ More
The superconducting transmon qubit is a leading platform for quantum computing and quantum science. Building large, useful quantum systems based on transmon qubits will require significant improvements in qubit relaxation and coherence times, which are orders of magnitude shorter than limits imposed by bulk properties of the constituent materials. This indicates that relaxation likely originates from uncontrolled surfaces, interfaces, and contaminants. Previous efforts to improve qubit lifetimes have focused primarily on designs that minimize contributions from surfaces. However, significant improvements in the lifetime of two-dimensional transmon qubits have remained elusive for several years. Here, we fabricate two-dimensional transmon qubits that have both lifetimes and coherence times with dynamical decoupling exceeding 0.3 milliseconds by replacing niobium with tantalum in the device. We have observed increased lifetimes for seventeen devices, indicating that these material improvements are robust, paving the way for higher gate fidelities in multi-qubit processors.
△ Less
Submitted 28 February, 2020;
originally announced March 2020.
-
Dynamical RG and Critical Phenomena in de Sitter Space
Authors:
Daniel Green,
Akhil Premkumar
Abstract:
Perturbative quantum field theory in de Sitter space is known to give rise to a variety of contributions that diverge with time (secular terms). Despite significant progress, a complete understanding of the physical origin of these divergences remains an outstanding problem. In this paper, we will study the origin of secular divergences in de Sitter space for interacting theories that are near att…
▽ More
Perturbative quantum field theory in de Sitter space is known to give rise to a variety of contributions that diverge with time (secular terms). Despite significant progress, a complete understanding of the physical origin of these divergences remains an outstanding problem. In this paper, we will study the origin of secular divergences in de Sitter space for interacting theories that are near attractive conformal fixed points. We show that the secular divergences are determined by the anomalous dimensions of the same theory in flat space and can be re-summed using the dynamical renormalization group. This behavior is mandatory at the conformal fixed point but we show that it holds away from the fixed point as well. We analyze this problem in general using conformal perturbation theory and study conformally coupled scalar fields in four and $4-ε$ dimensions as examples.
△ Less
Submitted 27 January, 2020; v1 submitted 16 January, 2020;
originally announced January 2020.
-
Distributed Computation of the Conditional PCRLB for Quantized Decentralized Particle Filters
Authors:
Arash Mohammadi,
Amir Asif,
Xionghu Zhong,
A. B. Premkumar
Abstract:
The conditional posterior Cramer-Rao lower bound (PCRLB) is an effective sensor resource management criteria for large, geographically distributed sensor networks. Existing algorithms for distributed computation of the PCRLB (dPCRLB) are based on raw observations leading to significant communication overhead to the estimation mechanism. This letter derives distributed computational techniques for…
▽ More
The conditional posterior Cramer-Rao lower bound (PCRLB) is an effective sensor resource management criteria for large, geographically distributed sensor networks. Existing algorithms for distributed computation of the PCRLB (dPCRLB) are based on raw observations leading to significant communication overhead to the estimation mechanism. This letter derives distributed computational techniques for determining the conditional dPCRLB for quantized, decentralized sensor networks (CQ/dPCRLB). Analytical expressions for the CQ/dPCRLB are derived, which are particularly useful for particle filter-based estimators. The CQ/dPCRLB is compared for accuracy with its centralized counterpart through Monte-Carlo simulations.
△ Less
Submitted 20 July, 2013;
originally announced July 2013.