Conda-forge (NEW, recommended):

PCMDI Conda Channel (halted):

The PCMDI Metrics Package (PMP) is used to provide "quick-look" objective comparisons of Earth System Models (ESMs) with one another and available observations. Results are produced in the context of all model simulations contributed to CMIP6 and earlier CMIP phases. Among other purposes, this enables modeling groups to evaluate changes during the development cycle in the context of the structural error distribution of the multi-model ensemble. Currently, the comparisons emphasize metrics of large- to global-scale annual cycle, tropical and extra-tropical modes of variability, ENSO, MJO, regional monsoons, high frequency characteristics of simulated precipitation, and cloud feedback.

PCMDI uses the PMP to produce quick-look simulation summaries across generations of CMIP.

The metrics package consists of the following parts:

• Analysis software
• Observation-based reference database of global (or near global, land or ocean) time series and climatologies
• Package documentation and interactive jupyter notebook demos
• Database of performance metrics computed for CMIP models

The package expects model data to be CF-compliant. To successfully use the package some input data "conditioning" may be required. We provide several demo scripts within the package.

Getting Started

• Installation requirements and instructions are available on the Install page

• Users will need to contact the PMP developers ([email protected]) to obtain supporting datasets and get started using the package.

• An overview for using the package and template scripts are detailed on the Using-the-package page

• View Demo

References

Latest:

• Lee, J., Gleckler, P. J., Ahn, M.-S., Ordonez, A., Ullrich, P. A., Sperber, K. R., Taylor, K. E., Planton, Y. Y., Guilyardi, E., Durack, P., Bonfils, C., Zelinka, M. D., Chao, L.-W., Dong, B., Doutriaux, C., Zhang, C., Vo, T., Boutte, J., Wehner, M. F., Pendergrass, A. G., Kim, D., Xue, Z., Wittenberg, A. T., and Krasting, J.: Systematic and objective evaluation of Earth system models: PCMDI Metrics Package (PMP) version 3, Geosci. Model Dev., 17, 3919–3948, https://doi.org/10.5194/gmd-17-3919-2024, 2024.

Earlier versions:

• Gleckler, P. J., Doutriaux, C., Durack, P. J., Taylor, K. E., Zhang, Y., Williams, D. N., Mason, E., and Servonnat, J.: A more powerful reality test for climate models, Eos T. Am. Geophys. Un., 97, https://doi.org/10.1029/2016eo051663, 2016. 

• Gleckler, P. J., Taylor, K. E., and Doutriaux, C.: Performance metrics for climate models, J. Geophys. Res., 113, D06104, https://doi.org/10.1029/2007jd008972, 2008. 

Report Bug

Request Feature

Some installation support for CMIP participating modeling groups is available: [email protected]

Content in this repository is developed by climate and computer scientists from the Program for Climate Model Diagnosis and Intercomparison (PCMDI) at Lawrence Livermore National Laboratory (LLNL). This work is sponsored by the Regional and Global Model Analysis (RGMA) program, of the Earth and Environmental Systems Sciences Division (EESSD) in the Office of Biological and Environmental Research (BER) within the Department of Energy's Office of Science. The work is performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under Contract DE-AC52-07NA27344.

Distributed under the BSD 3-Clause License. See LICENSE for more information.

• Jiwoo Lee
• Ana Ordonez
• Peter Gleckler
• Paul Ullrich
• Bo Dong
• Kristin Chang

Thanks goes to these wonderful people (emoji key):

Jiwoo Lee 💻 📖 👀 ⚠️ ✅ 🔬 🤔 🚇	Peter Gleckler 💻 📖 🔬 👀 ⚠️ 🔣 🤔	Ana Ordonez 💻 📖 👀 ⚠️ ✅ 🚇	Min-Seop Ahn 💻 📖 👀 ⚠️ ✅ 🔬	Paul Ullrich 🤔 🔬	Charles Doutriaux 💻	Karl Taylor 🔬 🤔
Paul J. Durack 💻	Mark Zelinka 💻	Celine Bonfils 🔬	Curtis C. Covey 💻 🔬	Zeshawn Shaheen 💻	Lina Muryanto 🚇	Tom Vo 🚇
Jason Boutte 🚇	Jeffrey Painter 🔣 🚇 💻	Stephen Po-Chedley 🔣 🚇	Xylar Asay-Davis 🚇	John Krasting 💻 ⚠️	Angeline G Pendergrass 💻 🔬 🤔	Michael Wehner 💻 🔬
Daehyun Kim 💻 🔬	Bo Dong 💻	Shixuan Zhang 💻	Kristin Chang 💻

This project follows the all-contributors specification.