TY - GEN
T1 - PQual
T2 - 33rd Annual ACM Symposium on User Interface Software and Technology, UIST 2020
AU - Hashmi, Waleed
AU - Chaqfeh, Moumena
AU - Subramanian, Lakshmi
AU - Zaki, Yasir
N1 - Publisher Copyright:
© 2020 Owner/Author.
PY - 2020/10/20
Y1 - 2020/10/20
N2 - The increasing complexity of web pages has brought a number of solutions to offer simpler or lighter versions of these pages. The qualitative evaluation of the new versions is commonly carried out relying on user studies. In addition to the associated costs, running user studies might become extremely challenging due to health, travel, and financial constraints. Moreover, user studies are prone to subjectivity, which makes it difficult to compare the results of different studies. In this paper, we propose PQual, a tool that enables the automation of the qualitative evaluation of web pages using computer vision. Results show that PQual computes comparable similarity scores to the scores provided by human raters. In addition, it can effectively evaluate all the functionality of a web page, whereas humans might skip many of the functional elements during the evaluation.
AB - The increasing complexity of web pages has brought a number of solutions to offer simpler or lighter versions of these pages. The qualitative evaluation of the new versions is commonly carried out relying on user studies. In addition to the associated costs, running user studies might become extremely challenging due to health, travel, and financial constraints. Moreover, user studies are prone to subjectivity, which makes it difficult to compare the results of different studies. In this paper, we propose PQual, a tool that enables the automation of the qualitative evaluation of web pages using computer vision. Results show that PQual computes comparable similarity scores to the scores provided by human raters. In addition, it can effectively evaluate all the functionality of a web page, whereas humans might skip many of the functional elements during the evaluation.
KW - qualitative evaluation
KW - similarity score
KW - web pages
UR - http://www.scopus.com/inward/record.url?scp=85095574395&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85095574395&partnerID=8YFLogxK
U2 - 10.1145/3379350.3416163
DO - 10.1145/3379350.3416163
M3 - Conference contribution
AN - SCOPUS:85095574395
T3 - UIST 2020 - Adjunct Publication of the 33rd Annual ACM Symposium on User Interface Software and Technology
SP - 148
EP - 150
BT - UIST 2020 - Adjunct Publication of the 33rd Annual ACM Symposium on User Interface Software and Technology
PB - Association for Computing Machinery, Inc
Y2 - 20 October 2020 through 23 October 2020
ER -