MULTIMODAL USER EXPERIENCE DEGRADATION DETECTION

A degraded user experience, such as a user having to wait for an unresponsive application, can be automatically detected and classified. A user experience degradation detection network detects a degraded user experience based on a state of the computing system and a user interaction state. The computing system state can be based on telemetry data provided by the operating system, processor units, and other computing system components and resources, and the user interaction state can be based on user interactions with one or more input devices (e.g., keyboard, touchpad, mouse, touchscreen). A root cause of the degradation event (e.g., hardware, memory, network, or general responsiveness issue) can be classified using a multi-label classifier. An output report can include a snapshot of the system telemetry and user interaction data before, during, and after the degradation event.