Working Group: Evaluation

 [Overview] [Tasks] [WG Meetings] [Coordinated Strategy] [ Reports ] [ Utilities] [Members]


Ivonne Anders (ZAMG, Chair), Klaus Keuler (BTU Cottbus, Co-Chair)



Evaluation of model results is everybodys task applying or developing the model. Often the biggest challenge is to find on one hand suitable observations (stations the same as gridded data) and on the other hand to define the measures fitting the needs of the evaluation in the best way.

The WG-EVAL brings all people together who are interested in discussing datasets, evaluation methods or want to discuss results. 


Tasks and Challenges

The need of more exchange and systematic comparison between different evaluation experiments was revealed as one crucial aspect to be discussed and organized within this COSMO-CLM WG.

This is based on the common interests:

- to better understand the model deficiencies

- to find out ways to overcome them

- to enhance communication of evaluation results (collecting and exchanging information about evaluation from various groups for various regions)

- to define and introduce a standard evaluation tool (simple rudimentary tool based on CDO or NCO utilities for a small set of common evaluation parameters)


Coordinated Evaluation Strategy

One main task in the WG is to develop a coordinated evaluation strategy for testing the new model versions and the newly introduced namelist parameters and access the influence on the climate change signal.

The process aims in a new recommended and evaluated standard model version of COSMO CLM.


The evaluation of cosmo5.0 is completed. The process was divided into 3 phases and is documented at 3 appropriate web entries :

 Phase 1: testing of new parameters

 Phase 2: testing of promising parameter combinations (started in Jan/2015)

 Phase 3: tuning on the basis of CON607 following the Omar Bellbrat routine (2012), started Jun/2015 at ETHZ .

The namelist settings are included under the entry 'CCLM-EU165_5.0_clm6' in the Namelist-Tool (list and start of the tool).


WG Meetings

WG meeting take place regularly at the COSMO User Seminar in Offenbach, Germany in spring and at the CCLM General Assembly in Autumn. All communitiy members are kindly invited to come to these meetings. 


Minutes from last meetings:

- 2016-03-10 at COSMO User Seminar 2016, Offenbach (D)

- 2015-10-01 at CCLM General Assembly 2015, Belvaux (L)

- 2015-06-05 webconference Coordinated Evaluation Project - COSMO5.0-CLM 

- 2015-05-27 workshop on the Coordinated Evaluation Project - COSMO5.0-CLM, Offenbach (D)

- 2015-03-05 at COSMO User Seminar 2015, Offenbach (D) (You are not authorised to download.)

- 2015-01-20 Coordinated Evaluation Project - COSMO5.0-CLM (You are not authorised to download.), Offenbach (D)

- 2014-09-03 at CCLM General Assembly 2014, Frankfurt (D) (You are not authorised to download.)

- 2014-03-20 at COSMO User Seminar 2014, Offenbach (D) (You are not authorised to download.)

- 2013-09-29 at CCLM General Assembly 2013, Zurich (CH)  (You are not authorised to download.)

  (You are not authorised to download.)


Summary of evaluation results for COSMO-CLM version 4.8_clm13 (clm17): Comparison of three different configurations over Europe driven by ECMWF reanalysis data ERA40 for the period 1979-2000

Evaluation report for 4.8_clm17: evaluation_report_cclm_4.8_v8.pdf (You are not authorised to download.)




Evaluation Utilities

 - Observation data -

Everybody needs reliable observation data to evaluate the model results. Carrying out simulations in different areas often opens up questions on available observational data sets for the specific region. We started to collect informations on data sets. A list will be published soon but needs your input.


 - Evaluation Tool - 

ETOOL Version 2.0: Peter Berg developed a basic evaluation tool at KIT and provided it to the CLM-Community. Susanne Brienen and Andrew Ferrone extended it by more functions. The tool script is available here.





Bodo Ahrens, Ivonne Anders, Nico Becker, Omar Bellprat, Marcus Breil, Susanne Brienen, Erwan Brisson, Edoardo Bucchignani, Ernesto Caetano, Fabien Chatterjee, Edouard Davin, Matthias Demuzere, Mame Diarra Bousso Dieng, Andreas Dobler, Alessandro Dosio, Hendrik Feldmann, Barbara Früh, Beate Geyer, Oliver Gutjahr, Klaus Haslinger,  Anja Hermans, Klaus Keuler, Simon Krichak, Nico Kröner, Gregor Leckebusch, Daniel Lüthi, Mariano Mertens, Annika Obermann, Hans-Jürgen Panitz, Dirk Pavlik, Vladimir Platonov, Andreas Prein, Kai Radtke, Mohammad Rahimi, Burkhardt Rockel, Sajjad Saeed, Abdoulaye Sarr, Pasquale Schiano, Jan-Peter Schulz, Sonia Seneviratne, Wim Thiery,  Heimo Truhetz, Nicole van Lipzig, Sebastian Wagner, Andreas Walter, Stefan Weiher, Andreas Will, Hendrik Wouters, Johann Züger


= CLM-Community login required