Modeling the impact of frame rate and quantization stepsizes and their temporal variations on perceptual video quality: A review of recent works

In networked video applications where the sustainable bandwidths vary greatly among the receivers and in time, one must be able to code a video or adapt a precoded-bitstream to a wide range of bit rates. It is critical to choose appropriate frame size, frame rate and quantization stepsize (QS) to optimize the perceptual quality for a target bit rate. Furthermore, it is important to understand the effect of temporal variation of these parameters, so that appropriate constraints can be imposed when adapting these parameters in response to bandwidth changes. However, well-established models that relate the perceptual quality with the spatial, temporal, and amplitude resolutions (STAR) and the variation of STAR do not exist today. We will review prior works in this area with a focus on our own recent findings, which has so far considered the effect of frame rate and QS as well as the temporal variation of the frame rate on the perceptual quality.