ut ut

Laboratory for Image & Video Engineering

Welcome to the LIVE Public-Domain Subjective Mobile Video Quality Database

LIVE Mobile Video Quality Database

Introduction

Video content delivery and consumption over wireless networks grow exponentially as mobile devices and video applications are widely used. We developed a new video quality database that models video distortions in heavily-trafficked wireless networks and that contains measurements of human subjective impressions of the quality of videos on mobile phones and tablets. The new LIVE Mobile Video Quality Assessment (VQA) database consists of 200 distorted videos created from 10 RAW HD reference videos obtained using a RED ONE digital cinematographic camera. While the LIVE Mobile VQA database includes distortions that have been previously studied such as compression and wireless packet-loss, it also incorporates dynamically varying distortions that change as a function of time, such as frame-freezes and temporally varying compression rates. LIVE Mobile VQA database includes the subjective study, the human behavioral analysis, and the evaluation of current objective image and video quality assessment (IQA/VQA) algorithm with regards to their efficacy in predicting visual quality. LIVE has developed a Mobile VQA database that will supplement the LIVE Image/Video Quality Database, to provide researchers with a much-needed tool to advance the state-of-the-art in objective video quality assessment.

Download

We are making the LIVE Mobile Video Quality Database available to the research community free of charge. If you use this database in your research, we kindly ask that you reference our papers listed below:

· A. K. Moorthy, L. K. Choi, A. C. Bovik and G. deVeciana, “Video Quality Assessment on Mobile Devices: Subjective, Behavioral and Objective Studies”, IEEE Journal of Selected Topics in Signal Processing, to appear in October 2012.

· A. K. Moorthy, L. K. Choi, G. deVeciana, and A. C. Bovik, “Mobile Video Quality Assessment Database,” IEEE ICC Workshop on Realizing Advanced Video Optimized Wireless Networks, Ottawa, Canada, June 10-15, 2012.

· A. K. Moorthy, L. K. Choi, G. deVeciana, and A. C. Bovik, “Subjective Analysis of Video Quality on Mobile Devices,” Sixth International Workshop on Video Processing and Quality Metrics for Consumer Electronics (VPQM) (invited article), Scottsdale, Arizona, January 15-16, 2012.

If you want to download the database, please fill THIS form and the information will be sent to you. Pre-prints of the papers are also available upon request, please contact Lark Kwon Choi ( larkkwonchoi@utexas.edu ).

Database Description

The goal of our study was to develop a database of videos that will challenge automatic VQA algorithms that models video distortions in heavily-trafficked wireless networks and to gauge the human perception of quality on mobile devices. The LIVE Mobile VQA database consists of 10 RAW HD reference videos and 200 distorted videos (4 compression + 4 wireless packet-loss + 4 frame-freezes + 3 rate-adapted + 5 temporal dynamics per reference), each of resolution 1280 × 720 at a frame rate of 30 fps, and of duration 15 seconds each. Since the video content is quite varied, the bit-rates for each of 4 SNR layers (R1,R2,R3,R4; R1< R2< R3< R4) varies across videos; all videos were compressed with rates between 0.7 Mbps and 6 Mbps. The choices of rates were based on commonly-used parameters for transmission of HD videos over networks as well as rates that are generally seen on Wi-Fi networks. The study involved over 50 subjects and resulted in 5,300 summary subjective scores and time-sampled subjective traces of quality. Each video in the LIVE Mobile Video Quality Database was assessed in a single-stimulus continuous quality evaluation (SSCQE) with hidden reference. The database includes both the differential mean opinion scores (DMOS) computed from the ratings that the subjects provided at the end of each video clip, as well as the continuous temporal scores. We also analyze human opinion using statistical techniques, and also study a variety of models of temporal pooling that may reflect strategies that the subjects used to make the final decision on video quality. Further, we compare the quality ratings obtained from the tablet and the mobile phone studies in order to study the impact of these different display modes on quality. We also evaluate several objective image and video quality assessment (IQA/VQA) algorithms with regards to their efficacy in predicting visual quality. A detailed correlation analysis and statistical hypothesis testing is carried out.

Investigators

Quality Assessment research at LIVE is being conducted in collaboration with the Video Aware Wireless Networks ( VAWN ) program of the Intel & Cisco.

The investigators in this research are:

Copyright Notice

-----------COPYRIGHT NOTICE STARTS WITH THIS LINE------------
Copyright (c) 2012 The University of Texas at Austin
All rights reserved.

Permission is hereby granted, without written agreement and without license or royalty fees, to use, copy, modify, and distribute this database (the images, the results and the source files) and its documentation for any purpose, provided that the copyright notice in its entirety appear in all copies of this database, and the original source of this database, Laboratory for Image and Video Engineering (LIVE, http://live.ece.utexas.edu ) and Center for Perceptual Systems (CPS, http://www.cps.utexas.edu ) at the University of Texas at Austin (UT Austin, http://www.utexas.edu ), is acknowledged in any publication that reports research using this database.

The following papers are to be cited in the bibliography whenever the database is used as:

· A. K. Moorthy, L. K. Choi, A. C. Bovik and G. deVeciana, “Video Quality Assessment on Mobile Devices: Subjective, Behavioral and Objective Studies”, IEEE Journal of Selected Topics in Signal Processing, to appear in October 2012.
· URL: http://live.ece.utexas.edu/research/quality/live_mobile_video.html

IN NO EVENT SHALL THE UNIVERSITY OF TEXAS AT AUSTIN BE LIABLE TO ANY PARTY FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE USE OF THIS DATABASE AND ITS DOCUMENTATION, EVEN IF THE UNIVERSITY OF TEXAS AT AUSTIN HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

THE UNIVERSITY OF TEXAS AT AUSTIN SPECIFICALLY DISCLAIMS ANY WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. THE DATABASE PROVIDED HEREUNDER IS ON AN "AS IS" BASIS, AND THE UNIVERSITY OF TEXAS AT AUSTIN HAS NO OBLIGATION TO PROVIDE MAINTENANCE, SUPPORT, UPDATES, ENHANCEMENTS, OR MODIFICATIONS.

-----------COPYRIGHT NOTICE ENDS WITH THIS LINE------------

Back to Quality Assessment Research page