Comments (15)
Created new branch: feature/metplus
from global-workflow.
Pulled config.metp into feature/metplus branch. Adjusted config.vrfy to remove METplus entries. Saw adjustment in setup_expt.py for default config and liked it so pulled it in.
Pulled in METplus changes for setup_workflow_fcstonly.py. @malloryprow would you mind pulling the setup_workflow.py changes for METplus from feature/gfsv16b into the copy in the feature/metplus branch? I saw other changes in feature/gfsv16b's setup_workflow.py script for v16 work (e.g. GLDAS) so I need your help picking out the METplus changes. Thanks!
@malloryprow What other METplus files/changes need to get brought into feature/metplus from feature/gfsv16b?
from global-workflow.
Sure, changes were made for the metatask too in setup_workflow_fcstonly.py. Going off the top of my head here, I have a nice piece of paper of the files and scripts adjusted for the metatask....jobs/rocoto/metp.sh will need pulled in...config.resources had changes in there as well. I can do the changes. I'll be at AMS next week, so I can look at it the following week if that is okay. Is there an immediate deadline coming up?
from global-workflow.
The week after AMS is fine, thanks! No rush, just wanted to get this started and logged in GitHub.
from global-workflow.
Updates to feature/metplus...
-
Added jobs/rocoto/metp.sh.
-
Updated ush/rocoto/setup_workflow.py to bring in gfsmetp metask and its tasks
-
Update sorc/checkout.sh check out EMC_verif-global tag to 1.4.0
-
Update config.resources for resources for gfsmetp
-
Update files in env for various supported machines for gfsmetp
from global-workflow.
After inital testing some changes were made and committed to feature/metplus...
-
in feature/gfsv16b, the online archive pgb files are saved as grib2, so they have ".grib2" at the end. It looks like in feature/metplus (branched off of develop?) still has them saved as grib1 with no suffix at the end of the pbg files. This is a simple change in conf.metp to tell the code what file format to look for, just something that will be needed to be updated later if/when the files are saved with ".grib2" at the end like in version 16.
-
For the grid-to-obs verification, the prepbufr files needed for the dates of my testing were not located online on Hera, so it tried to get them from HPSS but a mismatching of variables in the mediator script between the global workflow and EMC_verif-global for the transfer queue caused it to use the default "dev_transfer", and so it failed because that doesn't exist on Hera! I have fixed this and since the mediator script resides in EMC_verif-global I cut a new tag for EMC_verif-global (1.4.1) and updated the checkout in sorc/checkout.sh .
from global-workflow.
One more commit to feature/metplus...
- Related to 1. in above comment, forgot to update in a few other places in config.metp
from global-workflow.
Single cycle free-forecast testing on Hera successful!
from global-workflow.
Updated tase for EMC_verif_global checkout to verif_global_v1.5.0. This tag is mostly things that wouldn't affect the workflow like plotting, but one thing that may be important for the workflow are some soon-to-be-old Phase 1/2 paths to some production data were replaced with their new locations on WCOSS, particularly for the observation data used for the precipitation verification, but this doesn't affect things on Hera. This is the tag that is being used in the latest branch for GFSv16 testing, feature/gfsv16b_paranetcdf.
from global-workflow.
Pull request #26 completed and changes committed to develop branch at 1b359db. Thanks Mallory! Closing issue now.
from global-workflow.
Realized we never set up a switch to turn on/off the MET+ metatask. Will add, test setup scripts, and commit.
from global-workflow.
Created feature/metplus2 branch to make switch changes.
from global-workflow.
PR #28 initiated. Requested review from Mallory before commit.
from global-workflow.
PR submitted. Closing ticket.
from global-workflow.
Deleted feature/metplus and feature/metplus2 branches.
from global-workflow.
Related Issues (20)
- GFSv16.4.0 - Remove WAFS from GFS
- CICE 100 files on hera are incorrect HOT 3
- gdasfcst fails for C96C48_hybatmDA when using develop at 6ca106e6 HOT 1
- update hash for gsi_utils.fd HOT 1
- Connect Multiselect Parameter tool to run job parameter interface in Jenkins Controller
- Update g-w to run JEDI ATM CI on WCOSS2 HOT 1
- Disable archiving on half cycles and clean up yamls
- zeros in ocean post grib2 files on hera HOT 94
- fcst temp directories are not removed
- Add 1deg structured grid for waves for SFS application HOT 4
- Add observation file preparation job for aerosols to workflow
- add the capability to use slurm "reservation” nodes
- The gfsgenesis task failed on Jet HOT 1
- Need to update ufs_model to hash#281b32f or newer HOT 1
- Link both global-nest fix files and non-nest ones at the same time
- Script from cron for persistent Jenkins Java Agent
- Remove multi-grid wave support HOT 2
- Re-enable tracker jobs on Hercules
- Update gdas.cd and jcb hashes HOT 2
- Reenable METplus in config.base HOT 10
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from global-workflow.