Welcome to the LIVE-Meta Mobile Cloud Gaming Video Quality Assessment Database
LIVE-Meta Mobile Cloud Gaming Video Quality Assessment Database
Introduction
We present the outcomes of a recent large-scale subjective study of Mobile Cloud Gaming Video Quality Assessment (MCG-VQA) on a diverse set of gaming videos. Rapid advancements in cloud services, faster video encoding technologies, and increased access to high-speed, low-latency wireless internet have all contributed to exponential growth of the Mobile Cloud Gaming industry. Consequently, the development of methods to assess the quality of real-time video feeds to end-users of cloud gaming platforms has become increasingly important. However, due to the lack of a large-scale public Mobile Cloud Gaming Video dataset containing a diverse set of distorted videos with corresponding subjective scores, there has been limited work on the development of MCG-VQA models. Towards accelerating progress towards these goals, we created a new dataset, named the LIVE-Meta Mobile Cloud Gaming (LIVE-Meta-MCG) video quality database, composed of 600 landscape and portrait gaming videos, on which we collected 14,400 subjective quality ratings from an in-lab subjective study. Additionally, to demonstrate the usefulness of the new resource, we benchmarked multiple state-of-the-art VQA algorithms on the database.
We are making the LIVE-Meta MCG Video Quality Assessment Database available to the research community free of charge. If you use this database in your research, we kindly ask that you to cite our paper and website listed below:
- A. Saha, Y. Chen, C. Davis, B. Qiu, X. Wang, R. Gowda, I. Katsavounidis, A. C. Bovik, "Study of Subjective and Objective Quality Assessment of Mobile Cloud Gaming Videos", IEEE Transactions on Image Processing 2023 [IEEE Xplore] [Arxiv]
- A. Saha, Y. Chen, C. Davis, B. Qiu, X. Wang, R. Gowda, I. Katsavounidis, A. C. Bovik, "LIVE-Meta Mobile Cloud Gaming Video Quality Assessment Database," Online: https://live.ece.utexas.edu/research/LIVE-Meta-Mobile-Cloud-Gaming/index.html, 2023.
Download Link Here! Please fill the Google Form to get access to the database.
Database Description
The LIVE-Meta MCG Database contains 600 video sequences generated from 30 high-quality (pristine) reference source videos by compressing each video using 20 different resolution-bitrate protocols. We performed a subjective quality study using the new database, whereby more than 14,400 human opinions were gathered from 72 subjects. Our database comprised of both portrait and landscape videos of spatial resolution ranging from 360p to 720p. The videos were encoded at bitrates in the range 250kbps to 2mbps. We demonstrate the usefulness of the new data resource by evaluating a number of publicly available No-Reference (NR-VQA) algorithms on the LIVE-Meta MCG database.
Investigators
The investigators in this research are:
- Avinab Saha ( avinab.saha@utexas.edu ) -- Graduate student, Dept. of ECE, UT Austin.
- Yu-Chih Chen ( berriechen@utexas.edu ) -- Graduate student, Dept. of ECE, UT Austin.
- Chase Davis ( chased@fb.com ) -- Product Manager, Meta Platforms Inc.
- Bo Qiu ( quib@fb.com ) -- Software Engineer, Meta Platforms Inc.
- Xiaoming Wang ( xmwang@fb.com ) -- Software Engineer, Meta Platforms Inc.
- Rahul Gowda ( rahulgowda@fb.com ) -- Software Engineer, Meta Platforms Inc.
- Ioannis Katsavounidis ( ikatsavounidis@fb.com ) -- Research Scientist, Meta Platforms Inc.
- Alan C. Bovik ( bovik@ece.utexas.edu ) -- Professor, Dept. of ECE, UT Austin
Copyright Notice
-----------COPYRIGHT NOTICE STARTS WITH THIS LINE------------
Copyright (c) 2023 The University of Texas at Austin
All rights reserved.
Permission is hereby granted, without written agreement and without license or royalty fees, to use, copy, modify, and distribute this database (the videos, the results and the source files) and its documentation for any purpose, provided that the copyright notice in its entirety appear in all copies of this database, and the original source of this database, Laboratory for Image and Video Engineering (LIVE,
http://live.ece.utexas.edu
) at the University of Texas at Austin (UT Austin,
http://www.utexas.edu
), is acknowledged in any publication that reports research using this database.
The following paper/website are to be cited in the bibliography whenever the database is used as:
- A. Saha, Y. Chen, C. Davis, B. Qiu, X. Wang, R. Gowda, I. Katsavounidis, A. C. Bovik, "Study of Subjective and Objective Quality Assessment of Mobile Cloud Gaming Videos", IEEE Transactions on Image Processing 2023, [IEEE Xplore] [Arxiv]
- A. Saha, Y. Chen, C. Davis, B. Qiu, X. Wang, R. Gowda, I. Katsavounidis, A. C. Bovik, "LIVE-Meta Mobile Cloud Gaming Video Quality Assessment Database," Online: https://live.ece.utexas.edu/research/LIVE-Meta-Mobile-Cloud-Gaming/index.html, 2023.
IN NO EVENT SHALL THE UNIVERSITY OF TEXAS AT AUSTIN BE LIABLE TO ANY PARTY FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE USE OF THIS DATABASE AND ITS DOCUMENTATION, EVEN IF THE UNIVERSITY OF TEXAS AT AUSTIN HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
THE UNIVERSITY OF TEXAS AT AUSTIN SPECIFICALLY DISCLAIMS ANY WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. THE DATABASE PROVIDED HEREUNDER IS ON AN "AS IS" BASIS, AND THE UNIVERSITY OF TEXAS AT AUSTIN HAS NO OBLIGATION TO PROVIDE MAINTENANCE, SUPPORT, UPDATES, ENHANCEMENTS, OR MODIFICATIONS.
-----------COPYRIGHT NOTICE ENDS WITH THIS LINE------------
Back to Quality Assessment Research page