TY - JOUR
T1 - Exploratory Precipitation Metrics
T2 - Spatiotemporal Characteristics, Process-Oriented, and Phenomena-Based
AU - Leung, L. Ruby
AU - Boos, William R.
AU - Catto, Jennifer L.
AU - Demott, Charlotte A.
AU - Martin, Gill M.
AU - Neelin, J. David
AU - O’Brien, Travis A.
AU - Xie, Shaocheng
AU - Feng, Zhe
AU - Klingaman, Nicholas P.
AU - Kuo, Yi Hung
AU - Lee, Robert W.
AU - Martinez-Villalobos, Cristian
AU - Vishnu, S.
AU - Priestley, Matthew D.K.
AU - Tao, Cheng
AU - Zhou, Yang
N1 - Funding Information:
This study represents a collaborative effort as an outgrowth of a workshop on “Benchmarking Simulated Precipitation in Earth System Models” sponsored by the Office of Science of the U.S. Department of Energy (DOE) Biological and Environmental Research through the Regional and Global Model Analysis (RGMA) program area. RGMA also supported Leung and Feng under the WACCEM scientific focus area, O’Brien and Zhou under the CASCADE scientific focus area, Boos and Vishnu under Award DE-SC0019367, DeMott under Award DE-SC0020092, and Klingaman and Lee under Award DE-SC0020324. O’Brien’s efforts were also partially supported by the Environmental Resilience Institute, funded by Indiana University’s Prepared for Environmental Change Grand Challenge initiative. Neelin, Kuo, and Martinez-Villalobos were supported by National Science Foundation Grant AGS-1936810 and National Oceanic and Atmospheric Administration Grants NA18OAR4310280 and NA21OAR 4310354. Martinez-Villalobos was also supported by Proyecto Corfo Ingeniería 2030 código 14ENI2-26865. Catto and Priestley were supported by the UK Natural Environment Research Council Grant NE/S004645/1. Work at LLNL was supported by the DOE Office of Science Biological and Environmental Research through the Earth System Model Development program area and the Atmospheric Radiation Measurement program, and performed under the auspices of the U.S. DOE by Lawrence Livermore National Laboratory under Contract DE-AC52-07NA27344. Pacific Northwest National Laboratory is operated for the Department of Energy by Battelle Memorial Institute under Contract DE-AC05-76RL01830. Martin was supported by the U.K.–China Research and Innovation Partnership Fund through the Met Office Climate Science for Service Partnership (CSSP) China, as part of the Newton Fund, and by the Weather and Climate Science for Service Partnership (WCSSP) India, a collaborative initiative between the Met Office, supported by the U.K. Government’s Newton Fund, and the Indian Ministry of Earth Sciences (MoES). This research used resources of the National Energy Research Scientific Computing Center (NERSC), also supported by the Office of Science of the U.S. Department of Energy under Contract DE-AC02-05CH11231. We acknowledge the World Climate Research Programme, which, through its Working Group on Coupled Modelling, coordinated and promoted CMIP6. We thank the climate modeling groups for producing and making available their model output, the Earth System Grid Federation (ESGF) for archiving the data and providing access, and the multiple funding agencies who support CMIP6 and ESGF. We thank DOE’s RGMA program area, the Data Management program, and NERSC for making this coordinated CMIP6 analysis activity possible.
Funding Information:
Acknowledgments. This study represents a collaborative effort as an outgrowth of a workshop on “Benchmarking Simulated Precipitation in Earth System Models” sponsored by the Office of Science of the U.S. Department of Energy (DOE) Biological and Environmental Research through the Regional and Global Model Analysis (RGMA) program area. RGMA also supported Leung and Feng under the WACCEM scientific focus area, O’Brien and Zhou under the CASCADE scientific focus area, Boos and Vishnu under Award DE-SC0019367, DeMott under Award DE-SC0020092, and Klingaman and Lee under Award DE-SC0020324. O’Brien’s efforts were also partially supported by the Environmental Resilience Institute, funded by Indiana University’s Prepared for Environmental Change Grand Challenge initiative. Neelin, Kuo, and Martinez-Villalobos were supported by National Science Foundation Grant AGS-1936810 and National Oceanic and Atmospheric Administration Grants NA18OAR4310280 and NA21OAR 4310354. Martinez-Villalobos was also supported by Proyecto Corfo Ingeniería 2030 código 14ENI2-26865. Catto and Priestley were supported by the UK Natural Environment Research Council Grant NE/S004645/1. Work at LLNL was supported by the DOE Office of Science Biological and Environmental Research through the Earth System Model Development program area and the Atmospheric Radiation Measurement program, and performed under the auspices of the U.S. DOE by Lawrence Livermore National Laboratory under Contract DE-AC52-07NA27344. Pacific Northwest National Laboratory is operated for the Department of Energy by Battelle Memorial Institute under Contract DE-AC05-76RL01830. Martin was supported by the U.K.–China Research and Innovation Partnership Fund through the Met Office Climate Science for Service Partnership (CSSP) China, as part of the Newton Fund, and by the Weather and Climate Science for Service Partnership (WCSSP) India, a collaborative initiative between the Met Office, supported by the U.K. Government’s Newton Fund, and the Indian Ministry of Earth Sciences (MoES). This research used resources of the National Energy Research Scientific Computing Center (NERSC), also supported by the Office of Science of the U.S. Department of Energy under Contract DE-AC02-05CH11231. We acknowledge the World Climate Research Programme, which, through its Working Group on Coupled Modelling, coordinated and promoted CMIP6. We thank the climate modeling groups for producing and making available their model output, the Earth System Grid Federation (ESGF) for archiving the data and providing access, and the multiple funding agencies who support CMIP6 and ESGF. We thank DOE’s RGMA program area, the Data Management program, and NERSC for making this coordinated CMIP6 analysis activity possible.
Publisher Copyright:
© 2022 American Meteorological Society.
PY - 2022/6/15
Y1 - 2022/6/15
N2 - Precipitation sustains life and supports human activities, making its prediction one of the most societally relevant challenges in weather and climate modeling. Limitations in modeling precipitation underscore the need for diagnostics and metrics to evaluate precipitation in simulations and predictions. While routine use of basic metrics is important for documenting model skill, more sophisticated diagnostics and metrics aimed at connecting model biases to their sources and revealing precipitation characteristics relevant to how model precipitation is used are critical for improving models and their uses. This paper illustrates examples of exploratory diagnostics and metrics including 1) spatiotemporal characteristics metrics such as diurnal variability, probability of extremes, duration of dry spells, spectral characteristics, and spatiotemporal coherence of precipitation; 2) process-oriented metrics based on the rainfall–moisture coupling and temperature–water vapor environments of precipitation; and 3) phenomena-based metrics focusing on precipitation associated with weather phenomena including low pressure systems, mesoscale convective systems, frontal systems, and atmospheric rivers. Together, these diagnostics and metrics delineate the multifaceted and multiscale nature of precipitation, its relations with the environments, and its generation mechanisms. The metrics are applied to historical simulations from phases 5 and 6 of the Coupled Model Intercomparison Project. Models exhibit diverse skill as measured by the suite of metrics, with very few models consistently ranked as top or bottom performers compared to other models in multiple metrics. Analysis of model skill across metrics and models suggests possible relationships among subsets of metrics, motivating the need for more systematic analysis to understand model biases for informing model development.
AB - Precipitation sustains life and supports human activities, making its prediction one of the most societally relevant challenges in weather and climate modeling. Limitations in modeling precipitation underscore the need for diagnostics and metrics to evaluate precipitation in simulations and predictions. While routine use of basic metrics is important for documenting model skill, more sophisticated diagnostics and metrics aimed at connecting model biases to their sources and revealing precipitation characteristics relevant to how model precipitation is used are critical for improving models and their uses. This paper illustrates examples of exploratory diagnostics and metrics including 1) spatiotemporal characteristics metrics such as diurnal variability, probability of extremes, duration of dry spells, spectral characteristics, and spatiotemporal coherence of precipitation; 2) process-oriented metrics based on the rainfall–moisture coupling and temperature–water vapor environments of precipitation; and 3) phenomena-based metrics focusing on precipitation associated with weather phenomena including low pressure systems, mesoscale convective systems, frontal systems, and atmospheric rivers. Together, these diagnostics and metrics delineate the multifaceted and multiscale nature of precipitation, its relations with the environments, and its generation mechanisms. The metrics are applied to historical simulations from phases 5 and 6 of the Coupled Model Intercomparison Project. Models exhibit diverse skill as measured by the suite of metrics, with very few models consistently ranked as top or bottom performers compared to other models in multiple metrics. Analysis of model skill across metrics and models suggests possible relationships among subsets of metrics, motivating the need for more systematic analysis to understand model biases for informing model development.
KW - Climate models
KW - Diagnostics
KW - Model evaluation/performance
KW - Precipitation
UR - http://www.scopus.com/inward/record.url?scp=85128350648&partnerID=8YFLogxK
U2 - 10.1175/JCLI-D-21-0590.1
DO - 10.1175/JCLI-D-21-0590.1
M3 - Article
AN - SCOPUS:85128350648
SN - 0894-8755
VL - 35
SP - 3659
EP - 3686
JO - Journal of Climate
JF - Journal of Climate
IS - 12
ER -