Coder Social home page Coder Social logo

eucp_wp5_lines_of_evidence's Introduction

EUCP_WP5_Lines_of_Evidence

This is a repo for work on the EUCP WP5 lines of evidence work

Contents:

  • esmvaltool/ - ESMValtool related stuff
    • recipes/ - ESMValtool recipes
    • diagnostics/ - diagnostics

Config files for use with these ESMValtool recipes:

  • config-developer.yml
  • config-user.yml

A recipe to calculate temporally averaged statistics of CMIP5/6, CORDEX and EUCP CMP data.

I have defined some extra modules beyond the ones expected by ESMValtool to create "base" versions of e.g. variables and preprocessors that the actual ones used for the recipe can then inherit from. There are also long lists of datasets defined seperately that are then intended to be used via the additional_datasets: key in the recipe, this is because e.g. we need to process both historical and future versions of the datasets, but for CMIP5 / CORDEX the future experiment type is "rcp85" and for CMIP6 it is "ssp585". Since there is no "if" type logic in YAML I've taken the approach of having 0 global datasets in the recipe, and then explicitly specifying the datasets for each variable in the diagnostic section.. On the other hand, it might be possible to go back to the "normal" approach of having some global datasets and using the "--skip_nonexistent" option when running the recipe.

There are two sets of variables inclucded. The "clim_periods" ones and the "decades" ones. The "clim_periods" ones are used for the normal way of running the recipe where all the processing is done in one go, and the preprocessor does as much as it can before the diagnostic takes over. The "decades" ones are designed for the use case of where we just want to run some basic pre-processing of the files into decadal chunks, with the intention they can be used later when combined with other data that has been processed elsewhere. E.g. MO processes some files for CMIP5/6 EUR-11, and SMHI provides files from the CPM runs. Then another diagnostic runs to combine all this data together and do the remaining processing and plotting that the user requires.

A diagnostic to take the data from the processor. Calculate anomalies and then create a boxplot. This could do with some refactoring, and it probably makes sense to move bits (if not all) of the plotting code into a seperate plotting module of some sort. I have also made a start on code to work on dealing with the decadal chunks of data produced by the "decades" variables from the recipe but this is not finished yet.

A simple diagnostic that simply prints some info about the files that have been produced by the pre-processor.

eucp_wp5_lines_of_evidence's People

Contributors

thomascrocker avatar

Watchers

 avatar  avatar  avatar  avatar  avatar

Forkers

uk-gov-mirror

eucp_wp5_lines_of_evidence's Issues

Review of recipe_GCM_and_RCM_ALP-3.yml

as a first task in QA of the work here, I will start with the recipe_GCM_and_RCM_ALP-3.yml recipe file. I note that some aspects of this are planned to change with the refactoring to a single recipe but I wanted to start somewhere

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.