中央研究院  |  資訊科學研究所  |  多媒體網路與系統實驗室
Online Game QoE Evaluation using Paired Comparisons
(NOTE: Sheng-Wei Chen is also known as Kuan-Ta Chen.)

Abstract
To satisfy players' gaming experience, there is a strong need for a technique that can measure a game's quality systemically, efficiently, and reliably. In this paper, we propose to use paired comparisons and probabilistic choice models to quantify online games's QoE under various network situations. The advantages of our methodology over the traditional MOS ratings are 1) the rating procedure is simpler thus less burden is on experiment participants, 2) it derives ratio-scale scores, and 3) it enables systematic verification of participants' inputs.<p> As a demonstration, we apply our methodology to evaluate three popular FPS (first-person-shooter) games, namely, Alien Arena (Alien), Halo, and Unreal Tournament (UT), and investigate their network robustness. The results indicate that Halo performs the best in terms of their network robustness against packet delay and loss. However, if we take the degree of the games' sophistication into account, we consider that the robustness of UT against downlink delays should able be improved. We also show that our methodology can be a helpful tool for making decisions about design alternatives, such how dead reckoning algorithms and time synchronization mechanisms should be implemented.

Materials
Citation
Yu-Chun Chang, Kuan-Ta Chen, Chen-Chi Wu, Chien-Ju Ho and Chin-Laung Lei, "Online Game QoE Evaluation using Paired Comparisons," In Proceedings of IEEE CQR 2010, June 2010.

BibTex
@INPROCEEDINGS{chang10:game_qoe,
  TITLE      = {Online Game {QoE} Evaluation using Paired Comparisons},
  AUTHOR     = {Yu-Chun Chang and Kuan-Ta Chen and Chen-Chi Wu and Chien-Ju Ho and Chin-Laung Lei},
  BOOKTITLE  = {Proceedings of IEEE CQR 2010},
  MONTH      = {June},
  YEAR       = {2010}
}