Remember Me
Or use your Academic/Social account:


Or use your Academic/Social account:


You have just completed your registration at OpenAire.

Before you can login to the site, you will need to activate your account. An e-mail will be sent to you with the proper instructions.


Please note that this site is currently undergoing Beta testing.
Any new content you create is not guaranteed to be present to the final version of the site upon release.

Thank you for your patience,
OpenAire Dev Team.

Close This Message


Verify Password:
Verify E-mail:
*All Fields Are Required.
Please Verify You Are Human:
fbtwitterlinkedinvimeoflicker grey 14rssslideshare1
Nipen, Thomas; Stull, Roland (2011)
Publisher: Co-Action Publishing
Journal: Tellus A
Languages: English
Types: Article

Classified by OpenAIRE into

arxiv: Physics::Atmospheric and Oceanic Physics
A post-processing method for calibrating probabilistic forecasts of continuous weather variables is presented. The method takes an existing probability distribution and adjusts it such that it becomes calibrated in the long run. The original probability distributions can be ones such as are generated from a numerical weather prediction (NWP) ensemble combined with a description of how uncertainty is represented by this ensemble. The method uses a calibration function to relabel raw cumulative probabilities into calibrated cumulative probabilities based on where past observations verified on past raw probability forecasts. Applying the calibration method to existing probabilistic forecasts can be beneficial in cases where the underlying assumptions used to construct the probabilistic forecast are not in line with nature’s generating process of the ensemble and corresponding observation. The method was tested on a forecast data set with five different forecast variables and was verified against the corresponding analyses. The calibration method reduced the calibration deficiency of the forecasts down to the level expected for perfectly calibrated forecasts. When the raw forecasts exhibited calibration deficiencies, the calibration method improved the ignorance score significantly. It was also found that the ensemble-uncertainty model used to create the original probability distribution affected the ignorance score.
  • The results below are discovered through our pilot algorithms. Let us know how we are doing!

    • AMS 2008. Enhancing weather information with probability forecasts. Bull. Am. Meteor. Soc. 89, 1049-1053.
    • Anderson, J. L. 1996. A method for producing and evaluating probabilistic precipitation forecasts from ensemble model integrations. J. Clim. 9, 1518-1530.
    • Bremnes, J. B. 2007. Improved calibration of precipitation forecasts using ensemble techniques. Part 2: statistical calibration methods, Technical report, Norwegian Meteorological Institute.
    • Bro¨cker, J. and Smith, L. A. 2007. Increasing the reliability of reliability diagrams. Wea. Forecasting 22, 651-661.
    • Eckel, F. A. and Walters, M. K. 1998. Calibrated probabilistic quantitative precipitation forecasts based on the MRF ensemble. Wea. Forecasting 13, 1132-1147.
    • Gneiting, T., Balabdaoui, F. and Raftery, A. E. 2007. Probabilistic forecasts, calibration and sharpness. J. R. Stat. Soc., B 69, 243-268.
    • Gneiting, T. and Raftery, A. E. 2007. Strictly proper scoring rules, prediction, and estimation. J. Am. Stat. Assoc. 102, 359-378.
    • Good, I. J. 1952. Rational decisions. J. R. Stat. Soc., B 14, 107-114.
    • Hamill, T. M. 2001. Interpretation of rank histograms for verifying ensemble forecasts. Mon. Wea. Rev. 129, 550-560.
    • Hamill, T. M. 2007. Comments on “calibrated surface temperature forecasts from the Canadian ensemble prediction system using Bayesian model averaging”. Mon. Wea. Rev. 135, 4226-4230.
    • Hamill, T. M. and Colucci, S. J. 1997. Verification of Eta-RSM shortrange ensemble forecasts. Mon. Wea. Rev. 125, 1312-1327.
    • Hamill, T. M. and Colucci, S. J. 1998. Evaluation of Eta-RSM ensemble probabilistic precipitation forecasts. Mon. Wea. Rev. 126, 711-724.
    • Hamill, T. M. and Whitaker, J. S. 2006. Probabilistic quantitative precipitation forecasts based on reforecast analogs: theory and application. Mon. Wea. Rev. 134, 3209-3229.
    • Hamill, T. M., Whitaker, J. S. and Mullen, S. L. 2006. Reforecasts: an important dataset for improving weather predictions. Bull. Am. Meteor. Soc. 87, 33-46.
    • Hoeting, J. A., Madigan, M., Raftery, A. E. and Volinsky, C. T. 1999. Bayesian model averaging: a tutorial. Stat. Sci. 14, 382-401.
    • Hopson, T. M. and Webster, P. J. 2010. A 1-10-day ensemble forecasting scheme for the major river basins of Bangladesh: forecasting severe floods of 2003-07. J. Hydrometeor. 11, 618-641.
    • Jewson, S., Brix, A. and Ziehmann, C. 2005. Weather Derivative Valuation (eds. Jewson, S., Brix, A. and Ziehmann, C.). Cambridge, Cambridge University Press.
    • Johnson, C. and Swinbank, R. 2009. Medium-range multimodel ensemble combination and calibration. Q. J. R. Meteor. Soc. 135, 777- 794.
    • Murphy, A. H. 1973. A new vector partition of the probability score. J. Appl. Meteor. 12, 595-600.
    • Nielsen, H. A., Nielsen, T. S., Madsen, H., Giebel, G., Badger, J. and co-authors. 2006. From wind ensembles to probabilistic information about future wind power production: results from an actual application, In: 9th International Conference on Probabilistic Methods Applied to Power Systems, Stockholm, Sweden.
    • Pinson, P., McSharry, P. and Madsen, H. 2010. Reliability diagrams for non-parametric density forecasts of continuous variables: accounting for serial correlation. Q. J. R. Meteor. Soc. 136, 77-90.
    • Raftery, A. E., Gneiting, T., Balabdaoui, F. and Polakowski, M. 2005. Using Bayesian model averaging to calibrate forecast ensembles. Mon. Wea. Rev. 133, 1155-1174.
    • Roulston, M. S. and Smith, L. A. 2002. Evaluating probabilistic forecasts using information theory. Mon. Wea. Rev. 130, 1653-1660.
    • Sloughter, J. M., Raftery, A. E. and Gneiting, T. 2007. Probabilistic quantitative precipitation forecasting using Bayesian model averaging. Mon. Wea. Rev. 135, 3209-3220.
    • Talagrand, O., Vautard, R. and Strauss, B. 1997. Evaluation of probabilistic prediction systems, In: Proc. ECMWF Workshop on Predictability, Reading, United Kingdom, ECMWF, pp. 1-25.
    • Wilson, L. J., Beauregard, S., Raftery, A. E. and Verret, R. 2007. Calibrated surface temperature forecasts from the Canadian ensemble prediction system using Bayesian model averaging. Mon. Wea. Rev. 135, 1364-1385.
  • No related research data.
  • No similar publications.

Share - Bookmark

Cite this article

Collected from