Multimodel Ensemble Forecasts of Precipitation Based on an Object-Based Diagnostic Evaluation

We analyzed 24-h accumulated precipitation forecasts over the 4-month period from 1 May to 31 August 2013 over an area located in East Asia covering the region 15.05°–58.95°N, 70.15°–139.95°E generated with the ensemble prediction systems (EPS) from ECMWF, NCEP, UKMO, JMA, and CMA contained in the TIGGE dataset. The forecasts are first evaluated with the Method for Object-Based Diagnostic Evaluation (MODE). Then a multimodel ensemble (MME) forecast technique that is based on weights derived from object-based scores is investigated and compared with the equally weighted MME and the traditional gridpoint-based MME forecast using weights derived from the point-to-point metric, mean absolute error (MAE). The object-based evaluation revealed that attributes of objects derived from the ensemble members of the five individual EPS forecasts and the observations differ consistently. For instance, their predicted centroid location is more southwestward, their shape is more circular, and their orientation is more meridional than in the observations. The sensitivity of the number of objects and their attributes to methodological parameters is also investigated. An MME prediction technique that is based on weights computed from the object-based scores, median of maximum interest, and object-based threat score is explored and the results are compared with the ensemble forecasts of the individual EPS, the equally weighted MME forecast, and the traditional superensemble forecast. When using MODE statistics for the forecast evaluation, the object-based MME prediction outperforms all other predictions. This is mainly because of a better prediction of the objects’ centroid locations. When using the precipitation-based fractions skill score, which is not used in either of the weighted MME forecasts, the object-based MME forecasts are slightly better than the equally weighted MME forecasts but are inferior to the traditional superensemble forecast that is based on weights derived from the point-to-point metric MAE.