中央研究院  |   資訊科學研究所  |   多媒體網路與系統實驗室 
KissKissBan: a competitive human computation game for image annotation
(NOTE: Sheng-Wei Chen is also known as Kuan-Ta Chen.)

Abstract
In this paper, we propose a competitive human computation game, KissKissBan (KKB), for image annotation. KKB is different from other human computation games since it integrates both collaborative and competitive elements in the game design. In a KKB game, one player, the blocker, competes with the other two collaborative players, the couples; while the couples try to find consensual descriptions about an image, the blocker’s mission is to prevent the couples from reaching consensus. Because of its design, KKB possesses two nice properties over the traditional human computation game. First, since the blocker is encouraged to stop the couples from reaching consensual descriptions, he will try to detect and prevent coalition between the couples; therefore, these efforts naturally form a player-level cheating-proof mechanism. Second, to evade the restrictions set by the blocker, the couples would endeavor to bring up a more diverse set of image annotations. Experiments hosted on Amazon Mechanical Turk and a gameplay survey involving 17 participants have shown that KKB is a fun and efficient game for collecting diverse image annotations.

Citation
Ho Chien-Ju, Chang Tao-Hsuan, Lee Jong-Chuan, Hsu Jane Yung-jen, and Chen Kuan-Ta, "KissKissBan: a competitive human computation game for image annotation," In Proceedings of Human Computation Workshop 2009, pages 11-14, 2009.

BibTex
@INPROCEEDINGS{ho09:kkb,
  AUTHOR     = {Ho Chien-Ju and Chang Tao-Hsuan and Lee Jong-Chuan and Hsu Jane Yung-jen and Chen Kuan-Ta},
  TITLE      = {{KissKissBan}: a competitive human computation game for image annotation},
  BOOKTITLE  = {Proceedings of Human Computation Workshop 2009},
  PAGES      = {11--14},
  YEAR       = {2009},
  ISBN       = {978-1-60558-672-4},
  LOCATION   = {Paris France},
  DOI        = {http://doi.acm.org/10.1145/1600150.1600153}
}
Downloads