Evaluating the efectiveness of sonifcation in science education using Edukoi

Personal and Ubiquitous Computing (2024) Science, Technology, Engineering, and Mathematics classes are mainly taught using visual supports. However, the advancement of technology and the increasing eforts to equip schools with digital instrumentation have opened up the possibility of exploring new teaching avenues, such as sonifcation. We explored the efcacy of sonifcation in education using a novel interactive tool, Edukoi, in the context of astronomy, which is predominantly disseminated through spectacular images, animations, and visuals. Edukoi is a motion-sensing sonifcation tool that converts images to sound in real-time for educational applications. Our study, conducted with nearly 150 middle-school students, included a preliminary questionnaire investigating the perception, engagement, and motivation of students towards science; two sessions dedicated to testing Edukoi and assessing the potentiality of the software for the recognition of the colour and the shape of real and sketchy images; and a fnal second administration of the questionnaire to capture a possible benefcial efect of the use of the tool in the engagement towards science. Results showed the efectiveness of Edukoi in colour recognition and reasonable efcacy in shape identifcation. Although the questionnaire did not reveal an increment in science engagement over the time of the study, oral feedback from the students was positive. Edukoi presents a possible alternative teaching aid, potentially benefting diverse learners, including the visually impaired. Further developments of the software are needed to enhance its efectiveness in conveying more complex features such as composite colours or shapes.