LATENCY-AWARE RESOURCE ALLOCATION FOR STREAM PROCESSING APPLICATIONS

Systems and methods are provided for dynamically adjusting computing resources allocated to tasks within a stream processing application, including initiating monitoring of application-specific characteristics for each task, the characteristics including processor (CPU) usage and processing time, assessing resource allocation needs for each task based on the monitored characteristics to determine discrepancies between current resource allocation and optimal performance requirements, and implementing exploratory resource adjustments by incrementally modifying CPU resources allocated to a subset of tasks and analyzing an impact of the exploratory resource adjustments on task performance metrics. Optimal resource allocations are determined for each task using a regression model that incorporates historical and real-time performance data, and the optimal resource allocations are applied to the tasks to minimize processing time and maximize resource use efficiency. The optimal resource allocations are iteratively updated in response to changes in task characteristics or application demands.