Remember Me
Or use your Academic/Social account:


Or use your Academic/Social account:


You have just completed your registration at OpenAire.

Before you can login to the site, you will need to activate your account. An e-mail will be sent to you with the proper instructions.


Please note that this site is currently undergoing Beta testing.
Any new content you create is not guaranteed to be present to the final version of the site upon release.

Thank you for your patience,
OpenAire Dev Team.

Close This Message


Verify Password:
Verify E-mail:
*All Fields Are Required.
Please Verify You Are Human:
fbtwitterlinkedinvimeoflicker grey 14rssslideshare1
Decremer, Damien; Chung, Chul E.; Ekman, Annica M. L.; Brandefelt, Jenny (2014)
Publisher: Co-Action Publishing
Journal: Tellus A
Languages: English
Types: Article
Subjects: climate model; statistics; significance testing; internal variability, climate; climate modeling
Climate change simulated with climate models needs a significance testing to establish the robustness of simulated climate change relative to model internal variability. Student’s t-test has been the most popular significance testing technique despite more sophisticated techniques developed to address autocorrelation. We apply Student’s t-test and four advanced techniques in establishing the significance of the average over 20 continuous-year simulations, and validate the performance of each technique using much longer (375–1000 yr) model simulations. We find that all the techniques tend to perform better in precipitation than in surface air temperature. A sizable performance gain using some of the advanced techniques is realised in the model Ts output portion with strong positive lag-1 yr autocorrelation (> + 0.6), but this gain disappears in precipitation. Furthermore, strong positive lag-1 yr autocorrelation is found to be very uncommon in climate model outputs. Thus, there is no reason to replace Student’s t-test by the advanced techniques in most cases.Keywords: autocorrelation, temporal correlation, internal variability, climate noise, significance test, Student’s t-test(Published: 25 January 2014)Citation: Tellus A 2014, 66, 23139, http://dx.doi.org/10.3402/tellusa.v66.23139
  • The results below are discovered through our pilot algorithms. Let us know how we are doing!

    • Akaike, H. 1974. A new look at the statistical model identification. IEEE Trans. Automat. Contr. 19, 716 723.
    • Box, G. E. P. and Jenkins, G. M. 1976. Time Series Analysis: Forecasting and Control. Holden-Day, the University of Michigan, Ann Arbor, MI, USA, 575 pp.
    • Chung, C. E., Ramanathan, V. and Kiehl, J. T. 2002. Effects of the South Asian absorbing haze on the northeast monsoon and surface air heat exchange. J. Clim. 15, 2462 2476.
    • Collins, W. D., Rasch, P. J., Boville, B. A., Hack, J. J., McCaa, J. R. and co-authors. 2006. The formulation and atmospheric simulation of the Community Atmosphere Model Version 3 (CAM3). J. Clim. 19, 2144 2161.
    • Efron, B. 1982. The Jackknife, the Bootstrap, and Other Resampling Plans. Society for Industrial Mathematics, Philadelphia, PA, USA, 92 pp.
    • Efron, B. and Tibshirani, R. J. 1993. An Introduction to the Bootstrap. Chapman and Hall, New York, NY, USA, 436 pp.
    • Elmore, K. L., Baldwin, M. E. and Schultz, D. M. 2006. Field significance revisited: spatial bias errors in forecasts as applied to the Eta Model. Mon. Weather Rev. 134, 519 531.
    • Fraedrich, K. and Blender, R. 2003. Scaling of atmosphere and ocean temperature correlations in observations and climate models. Phys. Rev. Lett. 90, 108501.
    • Gent, P. R., Danabasoglu, G., Donner, L. J., Holland, M. M., Hunke, E. C. and co-authors. 2011. The Community Climate System Model Version 4. J. Clim. 24, 4973 4991.
    • Jin, C. S., Ho, C. H., Kim, J. H., Lee, D. K., Cha, D. H. and co-authors. 2013. Critical role of northern off-equatorial sea surface temperature forcing associated with central pacific el Nin˜ o in more frequent tropical cyclone movements toward East Asia. J. Clim. 26, 2534 2545.
    • Koscielny-Bunde, E., Bunde, A., Havlin, S., Roman, H. E., Goldreich, Y. and co-authors. 1998. Indication of a universal persistence law governing atmospheric variability. Phys. Rev. Lett. 81, 729 732.
    • Kunkel, K. E., Liang, X. Z. and Zhu, J. 2010. Regional climate model projections and uncertainties of U.S. summer heat waves. J. Clim. 23, 4447 4458.
    • Ku¨ nsch, H. R. 1989. The Jackknife and the Bootstrap for general stationary observations. Ann. Stat. 17, 25.
    • Lee, T., Ouarda, T. B. M. J. and Ousmane, S. 2011. Predictability of climate indices with time series models. In: Stochastic Hydrology of the Great Lakes A Systemic Analysis (ed. S. M. A. Moin), International Upper Great Lakes Study (IUGLS), Joint Commission Resources, Oak Brook, IL, USA, p. 45.
    • Mearns, L. O. 1997. On the statistical evaluation of climate model experiments; an editorial comment. Clim Change. 37, 443 448.
    • Roeckner, E., Ba¨ uml, G., Bonaventura, L., Brokopf, R., Esch, M. and co-authors. 2003. The atmospheric general circulation model ECHAM 5. PART I: model description. Max-Planck-Institut fu¨ r Meteorologie, Hamburg, Germany.
    • Schwarz, G. 1978. Estimating the dimension of a model. Ann. Stat. 6, 4.
    • Solow, R. A. 1985. Bootstrapping correlated data. J. Int. Assoc. Math. Geol. 17, 769 775.
    • Soltani, S., Modarres, R. and Eslamian, S. S. 2007. The use of time series modeling for the determination of rainfall climates of Iran. Int. J. Clim. 27, 819 829.
    • Von Storch, H. and Zwiers, F. W. 1999. Statistical Analysis in Climate Research. Cambridge University Press, Cambridge, UK, 484 pp.
    • Vyushin, D., Zhidkov, I., Havlin, S., Bunde, A. and Brenner, S. 2004. Volcanic forcing improves atmosphere-ocean coupled general circulation model scaling performance. Geophys. Res. Lett. 31, L10206.
    • Wei, J., Dirmeyer, P. A., Guo, Z., Zhang, L. and Misra, V. 2010. How much do different land models matter for climate simulation? Part I: climatology and variability. J. Clim. 23, 3120 3134.
    • Wilks, D. S. 1997. Resampling hypothesis tests for autocorrelated fields. J. Clim. 10, 65 82.
    • Wilks, D. S. 2011. Statistical Methods in the Atmospheric Sciences. Academic Press, Elsevier, Waltham, MA, USA, 676 pp.
    • Zorita, E., Gonza´ lez-Rouco, F. and Legutke, S. 2003. Testing the Mannetal. (1998) Approach to paleoclimate reconstructions in the context of a 1000-Yr control simulation with the ECHO-G coupled climate model. J. Clim. 16, 1378 1390.
    • Zwiers, F. W. 1987. Statistical considerations for climate experiments. Part II: multivariate tests. J. Clim. Appl. Meteorol. 26, 477 487.
    • Zwiers, F. W. and Thie´ baux, H. J. 1987. Statistical considerations for climate experiments. Part I: scalar tests. J. Clim. Appl. Meteorol. 26, 464 476.
    • Zwiers, F. W. and Von Storch, H. 1990. Regime-dependent autoregressive time series modeling of the Southern Oscillation. J. Clim. 3, 1347 1363.
    • Zwiers, F. W. and Von Storch, H. 1995. Taking serial correlation into account in tests of the mean. J. Clim. 8, 336 351.
  • No related research data.
  • No similar publications.

Share - Bookmark

Cite this article

Collected from