Assessing the Visual Esthetics of User Interfaces: A Ten-Year Systematic Mapping

Visual esthetics is recognized as an essential factor of perceived usability, credibility, and overall quality of software systems user interfaces. Thus, it is crucial to assess this factor as part of the development process to improve graphical user interface (GUI) quality. And, although there exist diverse approaches to assess visual esthetics today, they significantly differ in their definition and techniques for measuring it. Therefore, we performed a systematic mapping to provide an overview comparing the existing approaches from the last ten years (2010-2020). We encountered 27 articles reporting different approach types, including assessments measuring user perception of visual esthetics via human responses, metrics based on GUI elements, extracting handcrafted features from GUI screenshots, and deep-learning-based approaches. Most of them implement objective approaches, either using metrics or feature extraction. The majority of the approaches are aimed at web GUIs, with only three focusing on mobile GUIs, considering their smaller screen size, less use of color, and a more vertical element alignment. Few approaches have been comprehensively evaluated regarding reliability and validity. These results indicate the need for further research considering the importance of visual esthetics as part of software quality. The results of this study present an overview and comparison of these approaches from the last decade providing a systematic basis for researchers to better understand the challenges for GUI visual esthetics assessments and the enhancement of these approaches.