Accessory control using keywords

A system configured to use keywords to augment audio playback with visual effects and/or other effects to provide an immersive audio experience. For example, a device can detect a keyword and control a color and intensity of external lights to provide visual feedback. In addition to visual effects, the device can trigger additional effects using smart plugs or other smart devices. In a listening enhancement mode in which the device outputs audio content, the device performs keyword detection by monitoring playback audio data for preconfigured keywords. In a storytelling mode in which a user reads a book out loud, the device may perform keyword detection by monitoring microphone audio data for the preconfigured keywords. Controlling the visual effects in response to keyword detection is enabled by a new pipeline that sends information back from a wakeword engine to an audio processor.