Dual-task interference while receiving information on a head mounted display and manual tracking with and without auditory warnings

Dual-task interference is a concern when users attempt to use head mounted displays (HMD) while performing seated manual control tasks. Auditory warnings of information displayed on the HMD may or may not assist users while multi-tasking. In this study, we investigated the dual-task interference of words, to be remembered later, presented on a HMD and motor control in a manual tracking task. The word presentations were warned or not warned with auditory signals and the impact of audio warnings were examined. Participants were required to perform five tasks: (1) a compensatory tracking task performed alone, (2) a word memory task performed alone, (3) a tracking and word memory task, (4) a word memory task with words preceded by audial signals, and (5) a tracking and word memory task with words preceded by audial signals. In addition, in the dual-tasks, half of the word presentations were paired with directions changes in the tracking task to test for immediate perceptual interference. There were significant dual task costs for both mean tracking error and later word recall. Additionally, participants took significantly longer to respond to motion changes paired with word presentations than motion changes not paired with word presentations. However, the impact of auditory warnings on tracking performance was nuanced. Even with an in field of view transparent HMD momentary and sustained cognitive dual-task interference remains. Reaction times are affected most in the worst case scenario, when task critical events occur at the same time as a text message. The use of HMDs in time critical manual control tasks (such as operating machinery) should be limited. The use of audial warnings to alert operators to information displayed on an HMD requires further research; it may disrupt appropriate or natural task ordering. •Reading HMD presented words causes users to react slower to changes in a tracking task.•Dual-task impairment occurs even when users do not need to physically interact with the HMD.•Audial warnings for word presentations on a HMD have nuanced effects on tracking performance.•Manual tracking impairs later word recall for HMD presented words.