esgf / config Goto Github PK
View Code? Open in Web Editor NEWESGF configuration files
ESGF configuration files
Should be a simple list rather than the experiment list.
experiment can be extracted from the global attributes for indexing the full name
As it is provided on the repo esgf_shards_static.xml includes duplicated entries for the local shard.
For instance, on the IPSL index node :
<value>localhost/solr</value>
and <value>esgf-node.ipsl.upmc.fr/solr</value>
stand for the same shard.
I suggest to remove the default <value>localhost/solr</value>
and only keep the index node hostname (more readable).
We could keep the <value>localhost/solr</value>
notation only for other dedicated local shards as described here.
It seems to me that the current cmip6 config file does use ensemble instead of member_id in the DRS and the dataset_id.
The global attributes, DRS etc. paper (http://goo.gl/v1drZl ) specifies the member_id as:
if sub_experiment_id = “none”
member_id = <variant_label>
else
member_id = <sub_experiment_id>-<variant_label>
endif
where variant_label complys with the ensemble_pattern of the cmip6 config file. It is usually fine to use the variant_label (ensemble), except for the DCPP (decadal) data, which has the start year as sub_experiment_id (see examples given in the global attributes paper).
f9929a4 addresses these
TODO: categories list needs to use target facet rather than : separated pair
@glevava can you check that my latest commit is reasonable?
esgmapfile and other options needing experiment_options to be parsed, results in the following error:
NoConfigValue: Value not found
<value: 'historical'>
<option: 'experiment_options'>
<section: 'config:cordex'>
add to the esg.cmip6.ini gen script for extract global attributes
@alaniwi has made some observations of the current esg.cmip6.ini
file in the devel branch. I have captured them all in this Issue:
filename_format
meant to represent? I think the whole thing is meant to be a regexp.ini
files have a leading /
in directory_format
frequency
is used in dataset_name_format
but it doesn't seem to be defined anywhere.'
and "
symbols in the text in the descriptions column of experiment_options table. I wonder if they might need escaping with \
to avoid breaking ini
file parsing (I haven't tested this, but the colourisation in emacs is treating them as string delimiters, rightly or wrongly).A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.