Explainable process prediction

A method and system are provided in which predictions are generated, using one or more machine learning-based prediction models, for one or more process parameters associated with a running process. Explanation-oriented data elements are generated that correspond to the generated predictions and include confidence indicators associated with the generated predictions. The explanation-oriented data elements are presented in one or more dashboards of a visualization platform. The explanation-oriented data elements are representative of an explanation framework for explaining the predicted business process parameters generated by a machine learning-based prediction model and in a manner so that a user can understand and trust the basis for the predictions to facilitate effective and appropriate intervention in a running process.