Speech-Enabled Tools for Augmented Interaction in E-Learning Applications

This article presents systems that use speech technology, to emulate the one-on-one interaction a student can get from a virtual instructor. A web-based learning tool, the Learn IN Context (LINC+) system, designed and used in a real mixed-mode learning context for a computer (C++ language) programming course taught at the Université de Moncton (Canada) is described here. It integrates an Internet Voice Searching and Navigating (IVSN) system that helps learners to search and navigate both the web and their desktop environment through voice commands and dictation. LINC+ also incorporates an Automatic User Profile Building and Training (AUPB&T) module that allows users to increase speech recognition performance without having to go through the long and fastidious manual training process. The findings show that the majority of learners seem to be satisfied with this new media, and confirm that it does not negatively affect their cognitive load.