You can manage bookmarks using lists, please log in to your user account for this.
Media type:
E-Article
Title:
Measurement practices in user experience (UX) research: a systematic quantitative literature review
Contributor:
Perrig, Sebastian A. C.;
Aeschbach, Lena Fanya;
Scharowski, Nicolas;
von Felten, Nick;
Opwis, Klaus;
Brühlmann, Florian
Published:
Frontiers Media SA, 2024
Published in:
Frontiers in Computer Science, 6 (2024)
Language:
Without Specification
DOI:
10.3389/fcomp.2024.1368860
ISSN:
2624-9898
Origination:
Footnote:
Description:
User experience (UX) research relies heavily on survey scales to measure users' subjective experiences with technology. However, repeatedly raised concerns regarding the improper use of survey scales in UX research and adjacent fields call for a systematic review of current measurement practices. Therefore, we conducted a systematic literature review, screening 153 papers from four years of the ACM Conference on Human Factors in Computing Systems proceedings (ACM CHI 2019 to 2022), of which 60 were eligible empirical studies using survey scales to study users' experiences. We identified 85 different scales and 172 distinct constructs measured. Most scales were used once (70.59%), and most constructs were measured only once (66.28%). The System Usability Scale was the most popular scale, followed by the User Experience Questionnaire, and the NASA Task Load Index. Regarding constructs, usability was the most frequently measured, followed by attractiveness, effort, and presence. Furthermore, results show that papers rarely contained complete rationales for scale selection (20.00%) and seldom provided all scale items used (30.00%). More than a third of all scales were adapted (34.19%), while only one-third of papers reported any scale quality investigation (36.67%). On the basis of our results, we highlight questionable measurement practices in UX research and suggest opportunities to improve scale use for UX-related constructs. Additionally, we provide six recommended steps to promote enhanced rigor in following best practices for scale-based UX research.