ncar / esmlab-regrid

ESMLab Regridding Utilities. ⚠️⚠️ ESMLab-regrid functionality has been moved into <https://github.com/NCAR/geocat-comp>. ⚠️⚠️

⚠️⚠️ ESMLab-regrid functionality has been moved into https://github.com/NCAR/geocat-comp. ⚠️⚠️ ====

ESMLab-regrid

ESMLab regridding utitilies. See documentation for more information.

Installation

ESMLab-regrid can be installed from PyPI with pip:

pip install esmlab-regrid

It is also available from conda-forge for conda installations:

conda install -c conda-forge esmlab-regrid

esmlab-regrid's Issues

map file generation is slow and fails for big problems

I recently wanted to generate weights to map ETOPO1 (1-minute data) to 0.1° POP. The esmlab.regrid function failed.

I resorted to running ESMF_RegridWeightGen in MPI on 12 Cheyenne nodes.

#!/bin/bash
#PBS -N ESMF_RegridWeightGen
#PBS -q regular
#PBS -A NCGD0011
#PBS -l select=12:ncpus=36:mpiprocs=4:mem=109GB
#PBS -l walltime=06:00:00
#PBS -o logs/
#PBS -e logs/
#PBS -j oe

module purge
module load ncarenv/1.2
module load intel/17.0.1
module load netcdf/4.6.1
module load mpt/2.19

module load esmf_libs/7.1.0r
module load esmf-7.1.0r-ncdfio-mpi-O

SRC=/glade/work/mclong/esmlab-regrid/etopo1.nc
DST=/glade/work/mclong/esmlab-regrid/POP_tx0.1v3.nc

WEIGHT_FILE=/glade/work/mclong/esmlab-regrid/etopo1_to_POP_tx0.1v3_conservative.nc
METHOD=conserve

# Remove previous log files
rm -f PET*.RegridWeightGen.Log

mpirun -np 48 ESMF_RegridWeightGen --netcdf4 --ignore_unmapped -s ${SRC} -d ${DST} -m ${METHOD} -w ${WEIGHT_FILE}

Registry for grid, topography, region mask files

It appears that all grid, topography, region mask files used in regrid.py are hosted in various locations on Glade. I was wondering if it would be feasible to have some kind of central registry for these? How big can these files get? Can we curate them in a public place (GitHub repo)?

https://github.com/NCAR/esmlab/blob/538185f5f0dd75f243f39008da947a4a14d707c1/esmlab/grid_definitions.yml#L14-L16

https://github.com/NCAR/esmlab/blob/538185f5f0dd75f243f39008da947a4a14d707c1/esmlab/grid_definitions.yml#L149

Cc @matt-long

Generate grids

We have support for a regridding workflow, now we need the ability to generate grids files/objects.

Currently the workflow is based on SCRIP, but it doesn't have to be.