Increasing Payments in Crowdsourcing: Don't look a gift horse in the mouth (CROSBI ID 599817)
Prilog sa skupa u zborniku | izvorni znanstveni rad | međunarodna recenzija
Podaci o odgovornosti
Varela, Martin ; Maki, Toni ; Skorin-Kapov, Lea ; Hossfeld, Tobias
engleski
Increasing Payments in Crowdsourcing: Don't look a gift horse in the mouth
A commonly cited maxim states that “you get what you pay for”, implying that there is a strong correlation between the price paid for something, and its quality. In this paper, we examine whether this often-cited wisdom applies to using crowdsourcing for conducting subjective QoE experiments, and if so, how. As part of a large-scale user study designed to assess Web QoE, we conducted two crowdsourced campaigns to collect user ratings and study the influence of certain website design parameters related to typography and color on the overall visual appeal of the site. While the test content was exactly the same across both campaigns, the second campaign was set up to pay participants three times the reward of the first one. The goal was to analyze the impact of payment on a number of parameters, including the ratio of reliable users and obtained MOS values. With respect to QoE modeling, we found that while payment levels influenced absolute MOS values, there was no significant impact on the actual model.
crowdsourcing; web QoE; incentives; QoE model
nije evidentirano
nije evidentirano
nije evidentirano
nije evidentirano
nije evidentirano
nije evidentirano
Podaci o prilogu
2013.
objavljeno
Podaci o matičnoj publikaciji
Proc. of the 4th International Workshop on Perceptual Quality of Systems, PQS 2013
Podaci o skupu
4th International Workshop on Perceptual Quality of Systems (PQS)
predavanje
02.09.2013-04.09.2013
Beč, Austrija