Welcome to the LIVE HDR vs SDR Video Quality Assessment Database
LIVE HDR vs SDR Video Quality Assessment Database
Introduction
We conducted a large-scale study of human perceptual quality judgments of High Dynamic Range (HDR) and Standard Dynamic Range (SDR) videos subjected to scaling and compression levels and viewed on three different display devices. HDR videos are able to present wider color gamuts, better contrasts, and brighter whites and darker blacks than SDR videos. While conventional expectations are that HDR quality is better than SDR quality, we have found subject preference of HDR versus SDR depends heavily on the display device, as well as on resolution scaling and bitrate. To study this question, we collected more than 23,000 quality ratings from 67 volunteers who watched 356 videos on OLED, QLED, and LCD televisions. Since it is of interest to be able to measure the quality of videos under these scenarios, e.g. to inform decisions regarding scaling, compression, and SDR vs HDR, we tested several well-known full-reference and no-reference video quality models on the new database. Towards advancing progress on this problem, we also developed a novel no-reference model called HDRPatchMAX, that uses both classical and bit-depth sensitive distortion statistics more accurately than existing metrics. The publicly licensed portion of the database is made available on this page.
We are making the videos and the subjective annotations of the publicly licensed portion of the LIVE HDR vs SDR Video Quality Assessment Database available to the research community free of charge. If you use this database in your research, we ask that you kindly cite our paper listed below:
- Ebenezer, J. P., Shang, Z., Chen, Y., Wu, Y., Wei, H., Sethuraman, S., & Bovik, A. C. (2023). HDR or SDR? A Subjective and Objective Study of Scaled and Compressed Videos. arXiv preprint arXiv:2304.13162.
Download Link Here! Please fill the Google Form to get access to the database.
Database Description
The LIVE HDR vs SDR Database contains 356 videos with 3 Mean Opinion Scores (each corresponding to a different TV) for each video, of which 212 videos with their accompanying MOS are being made publicly available here. The videos were rated on three TVs with differing HDR capabilities by 67 subjects. More details can be found in the paper.
Investigators
The investigators in this research are:
- Joshua P. Ebenezer( joshua_ebenezer@utexas.edu ) -- Graduate alumnus, Dept. of ECE, UT Austin.
- Zaixi Shang( zxshang@utexas.edu ) -- Graduate alumnus, Dept. of ECE, UT Austin.
- Yongjun Wu ( yongjuw@amazon.com ) Amazon Prime Video, Seattle, WA
- Hai Wei ( haiwei@amazon.com ) Amazon Prime Video, Seattle, WA
- Sriram Sethuraman ( sssethur@amazon.com ) Amazon Prime Video, Seattle, WA
- Alan C. Bovik ( bovik@ece.utexas.edu ) -- Professor, Dept. of ECE, UT Austin
Copyright Notice
-----------COPYRIGHT NOTICE STARTS WITH THIS LINE------------
Copyright (c) 2024 The University of Texas at Austin
All rights reserved.
Permission is hereby granted, without written agreement and without license or royalty fees, to use, copy, modify, and distribute this database (the videos, the results and the source files) and its documentation for any purpose, provided that the copyright notice in its entirety appear in all copies of this database, and the original source of this database, Laboratory for Image and Video Engineering (LIVE,
http://live.ece.utexas.edu
) at the University of Texas at Austin (UT Austin,
http://www.utexas.edu
), is acknowledged in any publication that reports research using this database.
The following paper/website are to be cited in the bibliography whenever the database is used as:
- Ebenezer, J. P., Shang, Z., Chen, Y., Wu, Y., Wei, H., Sethuraman, S., & Bovik, A. C. (2023). HDR or SDR? A Subjective and Objective Study of Scaled and Compressed Videos. arXiv preprint arXiv:2304.13162.
IN NO EVENT SHALL THE UNIVERSITY OF TEXAS AT AUSTIN BE LIABLE TO ANY PARTY FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE USE OF THIS DATABASE AND ITS DOCUMENTATION, EVEN IF THE UNIVERSITY OF TEXAS AT AUSTIN HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
THE UNIVERSITY OF TEXAS AT AUSTIN SPECIFICALLY DISCLAIMS ANY WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. THE DATABASE PROVIDED HEREUNDER IS ON AN "AS IS" BASIS, AND THE UNIVERSITY OF TEXAS AT AUSTIN HAS NO OBLIGATION TO PROVIDE MAINTENANCE, SUPPORT, UPDATES, ENHANCEMENTS, OR MODIFICATIONS.
-----------COPYRIGHT NOTICE ENDS WITH THIS LINE------------
Back to Quality Assessment Research page