Evaluating the effectiveness of sonification in science education using Edukoi

Science, Technology, Engineering, and Mathematics classes are mainly taught using visual supports. However, the advancement of technology and the increasing efforts to equip schools with digital instrumentation have opened up the possibility of exploring new teaching avenues, such as sonification. We explored the efficacy of sonification in education using a novel interactive tool, Edukoi, in the context of astronomy, which is predominantly disseminated through spectacular images, animations, and visuals. Edukoi is a motion-sensing sonification tool that converts images to sound in real-time for educational applications. Our study, conducted with nearly 150 middle-school students, included a preliminary questionnaire investigating the perception, engagement, and motivation of students towards science; two sessions dedicated to testing Edukoi and assessing the potentiality of the software for the recognition of the colour and the shape of real and sketchy images; and a final second administration of the questionnaire to capture a possible beneficial effect of the use of the tool in the engagement towards science. Results showed the effectiveness of Edukoi in colour recognition and reasonable efficacy in shape identification. Although the questionnaire did not reveal an increment in science engagement over the time of the study, oral feedback from the students was positive. Edukoi presents a possible alternative teaching aid, potentially benefiting diverse learners, including the visually impaired. Further developments of the software are needed to enhance its effectiveness in conveying more complex features such as composite colours or shapes.