LIVE-Facebook Technologies-Foveated / Compressed VR VQA Database
Description
In Virtual Reality (VR), the requirements of much higher resolution and smooth viewing experiences under rapid and often real-time changes in viewing direction, leads to significant challenges in compression and communication. To reduce the stresses of very high bandwidth consumption, the concept of foveated video compression is being accorded renewed interest. By exploiting the space-variant property of retinal visual acuity, foveation has the potential to substantially reduce video resolution in the visual periphery, with hardly noticeable perceptual quality degradations. Accordingly, foveated image / video quality predictors are also becoming increasingly important, as a practical way to monitor and control future foveated compression algorithms. Towards advancing the development of foveated image / video quality assessment (FIQA / FVQA) algorithms, we have constructed 2D and (stereoscopic) 3D VR databases of foveated / compressed videos, and conducted a human study of perceptual quality on each database. Each database includes 10 reference videos and 180 foveated videos, which were processed by 3 levels of foveation on the reference videos. Foveation was applied by increasing compression with increased eccentricity. In the 2D study, each video was of resolution 7680x3840 and was viewed and quality-rated by 36 subjects, while in the 3D study, each video was of resolution 5376x5376 and rated by 34 subjects. Both studies were conducted on top of a foveated video player having low motion-to-photon latency (50ms). Both DMOS and MOS are provided.
Investigators
Yize Jin (yizejin@utexas.edu) -- Graduate Student, Dept. of ECE, UT Austin
Meixu Chen (chenmx@utexas.edu) -- Graduate Student, Dept. of ECE, UT Austin
Todd Goodall (beyondmetis@gmail.com), Apple Inc.
Anjul Patney (anjul@fb.edu), Facebook Technologies.
Alan Bovik (bovik@ece.utexas.edu)
-- Professor, Dept. of ECE, UT Austin
Download
We are making the LIVE-FBT-FCVR Database available to the research community free of charge. If you use this database in your research, we kindly ask that you reference our papers listed below:
- Y. Jin, M. Chen, T. Goodall, A. Patney, and A. C. Bovik, "Subjective and objective quality assessment of 2D and 3D foveated video compression in virtual reality," IEEE Transactions on Image Processing, to appear.
- Y. Jin, M. Chen, T. Goodall, Z. Wan, and A.C. Bovik, "Study of 2D foveated video quality in virtual reality," SPIE Aplications of Digital Image Processing, pp. 18-26, Aug. 2020.[paper]
- Y. Jin, M. Chen, T. Goodall, A. Patney, and A. C. Bovik, "LIVE-Facebook Technologies-Compressed Virtual Reality (LIVE-FBT-FCVR) Databases," Online: http://live.ece.utexas.edu/research/LIVEFBTFCVR/index.html, 2019.
Please fill THIS FORM to download our database.
Copyright Notice
-----------COPYRIGHT NOTICE STARTS WITH THIS LINE------------
Copyright (c) 2020 The University of Texas at Austin
All rights reserved.
Permission is hereby granted, without written agreement and without license or royalty fees, to use, copy, modify, and distribute this database (the images, the results and the source files) and its documentation for any purpose, provided that the copyright notice in its entirety appear in all copies of this database, and the original source of this database, Laboratory for Image and Video Engineering (LIVE,
http://live.ece.utexas.edu
) at the University of Texas at Austin (UT Austin,
http://www.utexas.edu
), is acknowledged in any publication that reports research using this database.
The following papers are to be cited in the bibliography whenever the database is used as:
- Y. Jin, M. Chen, T. Goodall, A. Patney, and A. C. Bovik, "Subjective and objective quality assessment of 2D and 3D foveated video compression in virtual reality," IEEE Transactions on Image Processing, in review.
- Y. Jin, M. Chen, T. Goodall, Z. Wan, and A.C. Bovik, "Study of 2D foveated video quality in virtual reality," SPIE Aplications of Digital Image Processing, pp. 18-26, Aug. 2020.[paper]
- Y. Jin, M. Chen, T. Goodall, A. Patney, and A. C. Bovik, "LIVE-Facebook Technologies-Compressed Virtual Reality (LIVE-FBT-FCVR) Databases," Online: http://live.ece.utexas.edu/research/LIVEFBTFCVR/index.html, 2020.
IN NO EVENT SHALL THE UNIVERSITY OF TEXAS AT AUSTIN BE LIABLE TO ANY PARTY FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE USE OF THIS DATABASE AND ITS DOCUMENTATION, EVEN IF THE UNIVERSITY OF TEXAS AT AUSTIN HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
THE UNIVERSITY OF TEXAS AT AUSTIN SPECIFICALLY DISCLAIMS ANY WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. THE DATABASE PROVIDED HEREUNDER IS ON AN "AS IS" BASIS, AND THE UNIVERSITY OF TEXAS AT AUSTIN HAS NO OBLIGATION TO PROVIDE MAINTENANCE, SUPPORT, UPDATES, ENHANCEMENTS, OR MODIFICATIONS.
-----------COPYRIGHT NOTICE ENDS WITH THIS LINE------------
Back to Quality Assessment Research page