Developing an Emoji-Based User Experience Questionnaire:  UEQ-Emoji

Ashley Colley; Sven Mayer; Jonna Häkkilä

doi:10.1145/3626705.3627767

Developing an Emoji-Based User Experience Questionnaire: UEQ-Emoji

Ashley Colley, Sven Mayer, Jonna Häkkilä

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

107 Downloads (Pure)

Abstract

Emojis are increasingly used in tools to evaluate user opinions, typically through happy-to-sad rating scales. We extended this concept by developing an emoji-based User Experience Questionnaire (UEQ), a well-established UX evaluation tool. Our design process involved selecting emojis corresponding to UEQ adjectives and creating bipolar emoji scales. The final tool covered 11 scales but could not represent the novelty subscale due to limitations of the emoji language. A comparative user study showed statistically similar results for 7 out of 11 scales between the emoji-based and word-based UEQs. Although the word-based version was preferred, our findings suggest that emoji-based scales can be a viable alternative for UX evaluation. Our work provides new insights into the potential and limitations of using emojis in UX research. Supplementary materials include a ready-to-use UEQ-Emoji form and an analysis tool.

Original language	English
Title of host publication	MUM '23: Proceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia
Editors	Florian Michahelles, Pascal Knierim, Jonna Häkkilä
Place of Publication	New York
Publisher	ACM
Pages	65–73
ISBN (Electronic)	979-8-4007-0921-0
DOIs	https://doi.org/10.1145/3626705.3627767
Publication status	Published - 2023
MoEC publication type	A4 Article in a conference publication
Event	International Conference on Mobile and Ubiquitous Multimedia - Vienna, Austria Duration: 3 Dec 2023 → 6 Dec 2023 https://mum-conf.org/2023/index.php

Conference

Conference	International Conference on Mobile and Ubiquitous Multimedia
Country/Territory	Austria
City	Vienna
Period	03.12.2023 → 06.12.2023
Internet address	https://mum-conf.org/2023/index.php

Keywords

Emojis
Bipolar Differential Rating Scales
User Study
User Experience Questionnaire (UEQ)
User Experience (UX)
UX Evaluation Tools
Survey Design

Field of science

Computer and information sciences
Visual arts and design

Access to research output

10.1145/3626705.3627767Licence: CC BY

Developing an Emoji-based User Experience QuestionnaireFinal published version, 4.29 MBLicence: CC BY

Citation for this output

@inproceedings{364ccfe1499f4160bb1710eb4301d664,

title = "Developing an Emoji-Based User Experience Questionnaire: UEQ-Emoji",

abstract = "Emojis are increasingly used in tools to evaluate user opinions, typically through happy-to-sad rating scales. We extended this concept by developing an emoji-based User Experience Questionnaire (UEQ), a well-established UX evaluation tool. Our design process involved selecting emojis corresponding to UEQ adjectives and creating bipolar emoji scales. The final tool covered 11 scales but could not represent the novelty subscale due to limitations of the emoji language. A comparative user study showed statistically similar results for 7 out of 11 scales between the emoji-based and word-based UEQs. Although the word-based version was preferred, our findings suggest that emoji-based scales can be a viable alternative for UX evaluation. Our work provides new insights into the potential and limitations of using emojis in UX research. Supplementary materials include a ready-to-use UEQ-Emoji form and an analysis tool.",

keywords = "Emojis, Bipolar Differential Rating Scales, User Study, User Experience Questionnaire (UEQ), User Experience (UX), UX Evaluation Tools, Survey Design",

author = "Ashley Colley and Sven Mayer and Jonna H{\"a}kkil{\"a}",

year = "2023",

doi = "10.1145/3626705.3627767",

language = "English",

pages = "65–73",

editor = "Florian Michahelles and Pascal Knierim and Jonna H{\"a}kkil{\"a}",

booktitle = "MUM '23: Proceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia",

publisher = "ACM ",

address = "Australia",

note = "International Conference on Mobile and Ubiquitous Multimedia ; Conference date: 03-12-2023 Through 06-12-2023",

url = "https://mum-conf.org/2023/index.php",

}

Colley, A, Mayer, S & Häkkilä, J 2023, Developing an Emoji-Based User Experience Questionnaire: UEQ-Emoji. in F Michahelles, P Knierim & J Häkkilä (eds), MUM '23: Proceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia. ACM , New York, pp. 65–73, International Conference on Mobile and Ubiquitous Multimedia, Vienna, Austria, 03.12.2023. https://doi.org/10.1145/3626705.3627767

Developing an Emoji-Based User Experience Questionnaire: UEQ-Emoji. / Colley, Ashley; Mayer, Sven; Häkkilä, Jonna.
MUM '23: Proceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia. ed. / Florian Michahelles; Pascal Knierim; Jonna Häkkilä. New York: ACM , 2023. p. 65–73.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

TY - GEN

T1 - Developing an Emoji-Based User Experience Questionnaire

T2 - International Conference on Mobile and Ubiquitous Multimedia

AU - Colley, Ashley

AU - Mayer, Sven

AU - Häkkilä, Jonna

PY - 2023

Y1 - 2023

N2 - Emojis are increasingly used in tools to evaluate user opinions, typically through happy-to-sad rating scales. We extended this concept by developing an emoji-based User Experience Questionnaire (UEQ), a well-established UX evaluation tool. Our design process involved selecting emojis corresponding to UEQ adjectives and creating bipolar emoji scales. The final tool covered 11 scales but could not represent the novelty subscale due to limitations of the emoji language. A comparative user study showed statistically similar results for 7 out of 11 scales between the emoji-based and word-based UEQs. Although the word-based version was preferred, our findings suggest that emoji-based scales can be a viable alternative for UX evaluation. Our work provides new insights into the potential and limitations of using emojis in UX research. Supplementary materials include a ready-to-use UEQ-Emoji form and an analysis tool.

AB - Emojis are increasingly used in tools to evaluate user opinions, typically through happy-to-sad rating scales. We extended this concept by developing an emoji-based User Experience Questionnaire (UEQ), a well-established UX evaluation tool. Our design process involved selecting emojis corresponding to UEQ adjectives and creating bipolar emoji scales. The final tool covered 11 scales but could not represent the novelty subscale due to limitations of the emoji language. A comparative user study showed statistically similar results for 7 out of 11 scales between the emoji-based and word-based UEQs. Although the word-based version was preferred, our findings suggest that emoji-based scales can be a viable alternative for UX evaluation. Our work provides new insights into the potential and limitations of using emojis in UX research. Supplementary materials include a ready-to-use UEQ-Emoji form and an analysis tool.

KW - Emojis

KW - Bipolar Differential Rating Scales

KW - User Study

KW - User Experience Questionnaire (UEQ)

KW - User Experience (UX)

KW - UX Evaluation Tools

KW - Survey Design

UR - https://dl.acm.org/doi/fullHtml/10.1145/3626705.3627767

UR - http://www.scopus.com/inward/record.url?scp=85180128177&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85180128177&partnerID=8YFLogxK

U2 - 10.1145/3626705.3627767

DO - 10.1145/3626705.3627767

M3 - Conference contribution

SP - 65

EP - 73

BT - MUM '23: Proceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia

A2 - Michahelles, Florian

A2 - Knierim, Pascal

A2 - Häkkilä, Jonna

PB - ACM

CY - New York

Y2 - 3 December 2023 through 6 December 2023

ER -

Developing an Emoji-Based User Experience Questionnaire: UEQ-Emoji

Abstract

Conference

Keywords

Field of science

Access to research output

Other files and links

Fingerprint

AWARE: Human Augmentation through Aware Extended Reality

Lapland Robotics

Citation for this output

Developing an Emoji-Based User Experience Questionnaire: UEQ-Emoji

Abstract

Conference

Keywords

Field of science

Access to research output

Other files and links

Fingerprint

Projects

AWARE: Human Augmentation through Aware Extended Reality

Lapland Robotics

Citation for this output