noaa-ocs-modeling / coastalapp Goto Github PK

CoastalApp will be deprecated. Please switch to https://github.com/oceanmodeling/ufs-coastal . CoastalApp is a NUOPC application implemented following UFS best practices to couple coastal ocean models and other domains (Sea Ice, Atmosphere, Wave, Inland Hydrology, ...)

Home Page: https://github.com/oceanmodeling/ufs-coastal

License: Creative Commons Zero v1.0 Universal

Shell 17.57% C 0.19% Gnuplot 5.46% CMake 1.37% Makefile 1.24% M4 0.79% Fortran 72.61% C++ 0.78%

coastalapp's People

Contributors

Stargazers

Watchers

coastalapp's Issues

CoastalApp priorities

CoastalApp priorities:

merge branch to main
incorporate latest version of WaveWatch III into CoastalApp
upgrade NUOPC / NEMS drivers
include CDAPS into CoastalApp + include HYCOM in ADCIRC

@pvelissariou1

Originally posted by @zacharyburnettNOAA in #57 (comment)

Updates for ADCIRC regional meshs (e.g. ATL and PAC) - do not close this issue

location of the latest 120 m mesh for ATL + PR inset
location of the PAC mesh

Related closed issues:
#40
#39

Include data cap for coupling GRTOFS with ADCIRC

Stability issue in the GESTOFS_Pacific_v2 grid

NWM and ADCIRC tests on Orion.

Assigned to @ps2epsi

v55 build fails on Hera

In branch feature/adcirc_v55, at /scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS, when running the following command:

sh build.sh --plat "hera" --components "ADCIRC ATMESH WW3DATA"

the build fails with the following error:

make[1]: Leaving directory `/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work'
ifort -O3 -i4   -c -o estofs_tide_fac.o estofs_tide_fac.f
ifort -mkl    -o estofs_tide_fac estofs_tide_fac.o
rm -f estofs_tide_fac.o
echo No module selected. ; cd /scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/ADCIRC/thirdparty/nuopc ; exec make COMP_SRCDIR="/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/ADCIRC" COMP_BINDIR="/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/ADCIRC_INSTALL" MACHINE_ID="linux" -f makefile.adc_cap.nuopc nuopcinstall \
          DESTDIR=/ "INSTDIR=/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/ADCIRC_INSTALL"
No module selected.
make[1]: Entering directory `/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/ADCIRC/thirdparty/nuopc'
makefile.adc_cap.nuopc:18: Environment variable ADCDIR was not set.
Setting to /scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/ADCIRC

c     -I. -I/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odircp -I/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -I/apps/netcdf/4.6.1/intel/16.1.150/include    -I/apps/hdf5/1.10.4/intel/16.1.150/include    -L. -L/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/ADCIRC  -L/apps/netcdf/4.6.1/intel/16.1.150/lib -L/apps/hdf5/1.10.4/intel/16.1.150/lib -DWITHPETLISTS_on  -g  -traceback  -DESMF_VERSION_MAJOR= couple2swan_modif.F
make[1]: c: Command not found
make[1]: [couple2swan_modif.o] Error 127 (ignored)

c     -I. -I/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odircp -I/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -I/apps/netcdf/4.6.1/intel/16.1.150/include    -I/apps/hdf5/1.10.4/intel/16.1.150/include    -L. -L/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/ADCIRC  -L/apps/netcdf/4.6.1/intel/16.1.150/lib -L/apps/hdf5/1.10.4/intel/16.1.150/lib -DWITHPETLISTS_on  -g  -traceback  -DESMF_VERSION_MAJOR= adc_mod.F90
make[1]: c: Command not found
make[1]: [adc_mod.o] Error 127 (ignored)

c     -I. -I/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odircp -I/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -I/apps/netcdf/4.6.1/intel/16.1.150/include    -I/apps/hdf5/1.10.4/intel/16.1.150/include    -L. -L/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/ADCIRC  -L/apps/netcdf/4.6.1/intel/16.1.150/lib -L/apps/hdf5/1.10.4/intel/16.1.150/lib -DWITHPETLISTS_on  -g  -traceback  -DESMF_VERSION_MAJOR= adc_cap.F90
make[1]: c: Command not found
make[1]: [adc_cap.o] Error 127 (ignored)
ar rv libadc_cap.a adc_cap.o adc_mod.o couple2swan_modif.o
ar: adc_cap.o: No such file or directory
make[1]: *** [libadc_cap.a] Error 1
make[1]: Leaving directory `/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/ADCIRC/thirdparty/nuopc'
make: *** [/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/ADCIRC_INSTALL/adcirc.mk] Error 2

The build appears to have completed ADCIRC, but not built NEMS.

Baroclinic - CAP for wrapping HYCOM/GRTOFS:

Envisioned cap capability (@WPringle @pvelissariou1 @cblakely97 )

Interpolation will be done by cap by wrapping native structured HYCOM netcdf file
Downloda the hycom/GRTOFS out side of the cap
We need to compute depth integrated temp salt
- to compute before sending to adcirc
- as a part of adcirc

error when building on Orion

when building with the following updated modules from #49 :
https://github.com/noaa-ocs-modeling/ADC-WW3-NWM-NEMS/blob/31eae131e21446907e016b9d315f44809628e5d6/modulefiles/envmodules_intel.orion#L10-L17

sh build.sh --plat orion --component "ADCIRC" --compiler intel

The following variables are defined:
    CLEAN          = 0
    COMPILER       = intel
    NEMS_COMPILER  = intel
    MODULES FILE   = envmodules_intel.orion
    COMPONENTS     = ADCIRC
    OS             = linux
    PLATFORM       = orion
    VERBOSE        =

    HDF5HOME       = /apps/intel-2020/hdf5-1.10.5-parallel
    NETCDFHOME     = /apps/intel-2020/netcdf-4.7.2-parallel
    NETCDF_INCDIR  = /apps/intel-2020/netcdf-4.7.2-parallel/include
    NETCDF_LIBDIR  = /apps/intel-2020/netcdf-4.7.2-parallel/lib

    ESMFMKFILE     = /apps/intel-2020/esmf-8.0.0/lib/esmf.mk


Currently Loaded Modules:
  1) intel/2020   3) hdf5/1.10.5-parallel   5) pnetcdf/1.12.0          7) esmf/8.0.0
  2) szip/2.1.1   4) impi/2020              6) netcdf/4.7.2-parallel   8) cmake/3.18.1



Are these values correct? [y/n]:

the following error (Name in only-list does not exist or is not accessible.) occurs well into the build, when calling mpiifort:

mpiifort -c -mcmodel=medium -O -fPIC -assume realloc_lhs -m64  -threads -I/apps/intel-2020/intel-2020/compilers_and_libraries_2020.0.166/linux/mpi/intel64/include -I/apps/intel-2020/esmf-8.0.0/mod -I/apps/intel-2020/esmf-8.0.0/include -I/apps/intel-2020/netcdf-4.7.2-parallel/include -I/apps/intel-2020/pnetcdf-1.12.0/include  -DESMF_NO_INTEGER_1_BYTE -DESMF_NO_INTEGER_2_BYTE -DESMF_LAPACK=1 -DESMF_MOAB=1 -DESMF_NO_ACC_SOFTWARE_STACK=1 -DESMF_NETCDF=1 -DESMF_PNETCDF=1 -DESMF_YAMLCPP=1 -DESMF_YAML=1 -DESMF_PIO=1 -DESMF_MPIIO -DESMF_NO_OPENMP -DESMF_NO_OPENACC -DESMF_BOPT_O -DESMF_TESTCOMPTUNNEL -DSx86_64_small=1 -DESMF_OS_Linux=1 -DESMF_COMM=intelmpi -DESMF_DIR=/tmp/esmf -I. -I/work/noaa/nosofs/share/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odircp -I/work/noaa/nosofs/share/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -I/apps/intel-2020/netcdf-4.7.2-parallel/include    -I/apps/intel-2020/hdf5-1.10.5-parallel/include    -L. -L/work/noaa/nosofs/share/repositories/ADC-WW3-NWM-NEMS/ADCIRC  -L/apps/intel-2020/netcdf-4.7.2-parallel/lib -L/apps/intel-2020/hdf5-1.10.5-parallel/lib -DWITHPETLISTS_on  -g  -traceback  -DESMF_VERSION_MAJOR=8 couple2swan_modif.F
couple2swan_modif.F(17): error #7002: Error in opening the compiled module file.  Check INCLUDE paths.   [SIZES]
      USE SIZES,  ONLY: SZ
----------^
couple2swan_modif.F(18): error #7002: Error in opening the compiled module file.  Check INCLUDE paths.   [WRITE_OUTPUT]
      USE WRITE_OUTPUT, ONLY : terminate
----------^
couple2swan_modif.F(19): error #7002: Error in opening the compiled module file.  Check INCLUDE paths.   [GLOBAL]
      USE GLOBAL, ONLY : DEBUG, ECHO, INFO, WARNING, ERROR,
----------^
couple2swan_modif.F(27): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ) ,ALLOCATABLE :: ADCIRC_SXX(:,:)
-----------^
couple2swan_modif.F(28): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ) ,ALLOCATABLE :: ADCIRC_SXY(:,:)
-----------^
couple2swan_modif.F(29): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ) ,ALLOCATABLE :: ADCIRC_SYY(:,:)
-----------^
couple2swan_modif.F(37): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ) :: InterpoWeight
-----------^
couple2swan_modif.F(50): error #7002: Error in opening the compiled module file.  Check INCLUDE paths.   [GLOBAL]
      USE GLOBAL, ONLY: NODECODE, NOFF, RSNX2, RSNY2
----------^
couple2swan_modif.F(51): error #7002: Error in opening the compiled module file.  Check INCLUDE paths.   [SIZES]
      USE SIZES, ONLY: SZ
----------^
couple2swan_modif.F(52): error #7002: Error in opening the compiled module file.  Check INCLUDE paths.   [MESH]
      USE MESH, ONLY : NE, NM, NP, X, Y, AREAS, NODELE, NEITABELE
----------^
couple2swan_modif.F(53): error #7002: Error in opening the compiled module file.  Check INCLUDE paths.   [BOUNDARIES]
      USE BOUNDARIES, ONLY : NBDV, NBOU, NBVV, NOPE, NVDLL, NVELL
----------^
couple2swan_modif.F(68): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ),ALLOCATABLE :: DSXXDX(:)
-----------^
couple2swan_modif.F(69): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ),ALLOCATABLE :: DSXYDY(:)
-----------^
couple2swan_modif.F(70): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ),ALLOCATABLE :: DSXYDX(:)
-----------^
couple2swan_modif.F(71): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ),ALLOCATABLE :: DSYYDY(:)
-----------^
couple2swan_modif.F(73): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ)             :: NCELE
-----------^
couple2swan_modif.F(75): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ),ALLOCATABLE :: TEMP_SXX(:)
-----------^
couple2swan_modif.F(76): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ),ALLOCATABLE :: TEMP_SXY(:)
-----------^
couple2swan_modif.F(77): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ),ALLOCATABLE :: TEMP_SYY(:)
-----------^
couple2swan_modif.F(79): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ) :: TOTALAREA
-----------^
couple2swan_modif.F(19): error #6580: Name in only-list does not exist or is not accessible.   [ERROR]
      USE GLOBAL, ONLY : DEBUG, ECHO, INFO, WARNING, ERROR,
-----------------------------------------------------^
couple2swan_modif.F(19): error #6580: Name in only-list does not exist or is not accessible.   [DEBUG]
      USE GLOBAL, ONLY : DEBUG, ECHO, INFO, WARNING, ERROR,
-------------------------^
couple2swan_modif.F(17): error #6580: Name in only-list does not exist or is not accessible.   [SZ]
      USE SIZES,  ONLY: SZ
------------------------^
couple2swan_modif.F(18): error #6580: Name in only-list does not exist or is not accessible.   [TERMINATE]
      USE WRITE_OUTPUT, ONLY : terminate
-------------------------------^
couple2swan_modif.F(19): error #6580: Name in only-list does not exist or is not accessible.   [ECHO]
      USE GLOBAL, ONLY : DEBUG, ECHO, INFO, WARNING, ERROR,
--------------------------------^
couple2swan_modif.F(19): error #6580: Name in only-list does not exist or is not accessible.   [INFO]
      USE GLOBAL, ONLY : DEBUG, ECHO, INFO, WARNING, ERROR,
--------------------------------------^
couple2swan_modif.F(19): error #6580: Name in only-list does not exist or is not accessible.   [WARNING]
      USE GLOBAL, ONLY : DEBUG, ECHO, INFO, WARNING, ERROR,
--------------------------------------------^
couple2swan_modif.F(20): error #6580: Name in only-list does not exist or is not accessible.   [SETMESSAGESOURCE]
     &          setMessageSource, unsetMessageSource, allMessage,
----------------^
couple2swan_modif.F(20): error #6580: Name in only-list does not exist or is not accessible.   [UNSETMESSAGESOURCE]
     &          setMessageSource, unsetMessageSource, allMessage,
----------------------------------^
couple2swan_modif.F(20): error #6580: Name in only-list does not exist or is not accessible.   [ALLMESSAGE]
     &          setMessageSource, unsetMessageSource, allMessage,
------------------------------------------------------^
/tmp/ifortq19im1.i(276): catastrophic error: Too many errors, exiting
compilation aborted for couple2swan_modif.F (code 1)
make[1]: *** [couple2swan_modif.o] Error 1
make[1]: Leaving directory `/work/noaa/nosofs/share/repositories/ADC-WW3-NWM-NEMS/ADCIRC/thirdparty/nuopc'
make: *** [/work/noaa/nosofs/share/repositories/ADC-WW3-NWM-NEMS/ADCIRC_INSTALL/adcirc.mk] Error 2

Include NUOPC cap for Pahm.

Test NEMS workflow with v55 adcirc for ATL+PR 120 m mesh for the stroms

build error

when cloning https://github.com/pvelissariou1/ADC-WW3-NWM-SCHISM-NEMS/ and running

sh build.sh --component "SCHISM" --plat hera --compiler intel

the following error occurs:

The following variables are defined:
    CLEAN          = 0
    COMPILER       = intel
    NEMS_COMPILER  = intel
    MODULES FILE   = envmodules_intel.hera
    COMPONENTS     = SCHISM
    OS             = linux
    PLATFORM       = hera
    VERBOSE        =

    HDF5HOME       = /scratch1/NCEPDEV/nems/emc.nemspara/soft/netcdf_parallel_release
    NETCDFHOME     = /scratch1/NCEPDEV/nems/emc.nemspara/soft/netcdf_parallel_release
    NETCDF_INCDIR  = /scratch1/NCEPDEV/nems/emc.nemspara/soft/netcdf_parallel_release/include
    NETCDF_LIBDIR  = /scratch1/NCEPDEV/nems/emc.nemspara/soft/netcdf_parallel_release/lib

    ESMFMKFILE     = /scratch1/NCEPDEV/nems/emc.nemspara/soft/esmf/8.1.0bs36g-intel18.0.5.274-impi2018.0.4-netcdf4.7.4_parallel.release/lib/esmf.mk


Currently Loaded Modules:
  1) intel/18.0.5.274   3) szip/2.1                       5) netcdf_parallel/4.7.4.release
  2) impi/2018.0.4      4) hdf5_parallel/1.10.6.release   6) esmf/8.1.0bs36g



Are these values correct? [y/n]: y

compileNems :: Cleaning: make -f GNUmakefile clean COMPONENTS="SCHISM"
NOTE: Skipping appbuilder.mk creation; no appbuilder file in use.
echo 'SCHISM' > "/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-SCHISM-NEMS/NEMS/src/conf/components.mk"
if ! test -f /scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-SCHISM-NEMS/NEMS/src/conf/configure.nems.NUOPC ; then       \
  cat /dev/null > /scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-SCHISM-NEMS/NEMS/src/conf/configure.nems.NUOPC       ; \
  delete_nuopc=yes                                      ; \
fi                                                      ; \
cd /scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-SCHISM-NEMS/NEMS/src ; make "COMPONENTS=SCHISM"    \
  INCLUDES_ARE_OPTIONAL=YES clean                       ; \
if [ "$delete_nuopc" = yes ] ; then                      \
  rm -f /scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-SCHISM-NEMS/NEMS/src/conf/configure.nems.NUOPC                 ; \
fi
Components in linker order: SCHISM
SCHISM: include /home/takis/CSDL/NEMS-APPS/ADC-WW3-NWM-SCHISM-NEMS/SCHISM_INSTALL/schism.mk
make[1]: Entering directory `/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-SCHISM-NEMS/NEMS/src'
GNUmakefile:70: /home/takis/CSDL/NEMS-APPS/ADC-WW3-NWM-SCHISM-NEMS/SCHISM_INSTALL/schism.mk: component SCHISM makefile fragment is missing
CPPFLAGS += ESMF_VERSION_STRING_GIT="ESMF_8_1_0_beta_snapshot_36"
CPPFLAGS += ESMF_VERSION_MINOR="1"
CPPFLAGS += ESMF_VERSION_BETASNAPSHOT="'T'"
CPPFLAGS += ESMF_VERSION_PATCHLEVEL="0"
CPPFLAGS += ESMF_VERSION_STRING="8.1.0 beta snapshot"
CPPFLAGS += ESMF_VERSION_REVISION="0"
CPPFLAGS += ESMF_VERSION_MAJOR="8"
CPPFLAGS += ESMF_VERSION_PUBLIC="'F'"
rm -f *.tmp.f90 *.lst *.o *.mod lm map
cd ENS_Cpl ; make clean
make[2]: Entering directory `/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-SCHISM-NEMS/NEMS/src/ENS_Cpl'
rm -f ENS_Cpl.a *.f90 *.o *.mod *.lst lm map depend
make[2]: Leaving directory `/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-SCHISM-NEMS/NEMS/src/ENS_Cpl'
make[1]: Leaving directory `/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-SCHISM-NEMS/NEMS/src'

compileNems :: Compiling: make  -f GNUmakefile build COMPONENTS="SCHISM"
NOTE: Skipping appbuilder.mk creation; no appbuilder file in use.
echo 'SCHISM' > "/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-SCHISM-NEMS/NEMS/src/conf/components.mk"
echo No module selected.; echo "SCHISM_SRCDIR = /scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-SCHISM-NEMS/SCHISM/src"; exec cmake -S /scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-SCHISM-NEMS/SCHISM/src -B /scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-SCHISM-NEMS/SCHISM/build -DCMAKE_VERBOSE_MAKEFILE=TRUE
No module selected.
SCHISM_SRCDIR = /scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-SCHISM-NEMS/SCHISM/src
CMake Error: The source directory "/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-SCHISM-NEMS/SCHISM/build" does not exist.
Specify --help for usage, or press the help button on the CMake GUI.
make: *** [/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-SCHISM-NEMS/SCHISM_INSTALL/schism.mk] Error 1

this example is at the following location:

/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-SCHISM-NEMS

test `ADCIRC` + `ATMESH` on Hera

/scratch2/COASTAL/coastal/save/shared/working/takis/atmesh-adcirc-sandy_hera_20210713

@pvelissariou1 I will put this on Orion when completed

Orion computation swap with Hera

Baroclinic - Initial condition

(@WPringle @pvelissariou1 @cblakely97 )

implementation options

Spin up from zero
Initial the fields:
WL
CUR

Since GRTOFS does not have tides we need to super impose tides

Global:

bodyforce

Run NEMS with ADC v55 for Pacific case for Iselle

https://en.wikipedia.org/wiki/Hurricane_Iselle

`compileNems` not found when building on Hera in `feature/pahm`

it appears that calling find on Hera sorts the output alphabetically by default

https://github.com/noaa-ocs-modeling/ADC-WW3-NWM-NEMS/blob/4c30abf684be8946810d1daa2d419c98aab6a710/scripts/build-v1.1.sh#L27
when trying to get the path to ./scripts/functions_build, since PAHM also has a scripts/functions_build, and since PAHM is before scripts alphabetically, the PAHM one is found first

izwh10m is missing for ATMESH leads to segmentation fault on femto

Running ATMESH standalone or coupled on femto results in segmentation fault.

@JosephZhang @moghimis @zacharyburnettNOAA @pvelissariou1

/sciclone/home20/clemmen/setups/NEMS/RUN01b/NEMS-SCHISM% ./NEMS-atmesh.x
  FILE_NAME  >
 ./wind_atm_fin_ch_time_vec.nc



------>Advancing ATMESH from: 2020  6  1  0  0  0   0
------------------ATMESH-------------> to: 2020  6  1  1  0  0   0
ATMESH refTime=  1982  9 11  0  0  0   0
forrtl: severe (174): SIGSEGV, segmentation fault occurred
Image              PC                Routine            Line        Source
NEMS-atmesh.x      00000000005375BD  for__signal_handl     Unknown  Unknown
libpthread-2.17.s  00002ABB3642D630  Unknown               Unknown  Unknown
NEMS-atmesh.x      00000000005031C5  Unknown               Unknown  Unknown
libesmf.so         00002ABB374D7E09  _ZN5ESMCI13Method     Unknown  Unknown
libesmf.so         00002ABB374D7D2B  _ZN5ESMCI11Method     Unknown  Unknown
libesmf.so         00002ABB374D7212  c_esmc_methodtabl     Unknown  Unknown
libesmf.so         00002ABB3770D966  esmf_attachmethod     Unknown  Unknown
libesmf.so         00002ABB37F327B9  nuopc_modelbase_m     Unknown  Unknown
libesmf.so         00002ABB37160279  _ZN5ESMCI6FTable1     Unknown  Unknown
libesmf.so         00002ABB37163E4B  ESMCI_FTableCallE     Unknown  Unknown
libesmf.so         00002ABB37631365  _ZN5ESMCI2VM5ente     Unknown  Unknown
libesmf.so         00002ABB371618DA  c_esmc_ftablecall     Unknown  Unknown
libesmf.so         00002ABB3785DA81  esmf_compmod_mp_e     Unknown  Unknown
libesmf.so         00002ABB37A59EBF  esmf_gridcompmod_     Unknown  Unknown
libesmf.so         00002ABB37EDC85B  nuopc_driver_mp_r     Unknown  Unknown
libesmf.so         00002ABB37160279  _ZN5ESMCI6FTable1     Unknown  Unknown
libesmf.so         00002ABB37163E4B  ESMCI_FTableCallE     Unknown  Unknown
libesmf.so         00002ABB37631365  _ZN5ESMCI2VM5ente     Unknown  Unknown
libesmf.so         00002ABB371618DA  c_esmc_ftablecall     Unknown  Unknown
libesmf.so         00002ABB3785DA81  esmf_compmod_mp_e     Unknown  Unknown
libesmf.so         00002ABB37A59EBF  esmf_gridcompmod_     Unknown  Unknown
NEMS-atmesh.x      00000000004F93A5  Unknown               Unknown  Unknown
libesmf.so         00002ABB37160279  _ZN5ESMCI6FTable1     Unknown  Unknown
libesmf.so         00002ABB37163E4B  ESMCI_FTableCallE     Unknown  Unknown
libesmf.so         00002ABB37631365  _ZN5ESMCI2VM5ente     Unknown  Unknown
libesmf.so         00002ABB371618DA  c_esmc_ftablecall     Unknown  Unknown
libesmf.so         00002ABB3785DA81  esmf_compmod_mp_e     Unknown  Unknown
libesmf.so         00002ABB37A59EBF  esmf_gridcompmod_     Unknown  Unknown
NEMS-atmesh.x      00000000004149E3  Unknown               Unknown  Unknown
NEMS-atmesh.x      000000000041241E  Unknown               Unknown  Unknown
libc-2.17.so       00002ABB3B0F5555  __libc_start_main     Unknown  Unknown
NEMS-atmesh.x      0000000000412329  Unknown               Unknown  Unknown

NWM to ADCIRC test case

Assigned to @ps2epsi

Build system incorrectly chooses intel compiler executable despite -compiler gnu option set

When choosing a gnu compiler, the build system chooses mpiifort (intel).

$> bash ./build.sh -plat macports -component SCHISM -compiler gnu

...
mpiifort -g -qopenmp -mkl=sequential -align array32byte -lmkl_intel_lp64 -lmkl_core -lmkl_sequential -lpthread -qopenmp -convert big_endian -assume byterecl -mkl=sequential  -I/opt/local/include/esmf -I/opt/local/include/esmf -I/opt/local/include -I/opt/local/include -I/incmod/nemsio -I/opt/local/include -fp-model strict -c ENS_CplComp_ESMFMod_STUB.f90

and fails with mpiifort not found

Add Zach and Yuji to orion coastal group.

`MPI_Abort` when running on TACC

running the newest compilation from Takis's patch, in /work/07531/zrb/stampede2/runs/hsofs/sandy/coldstart

The preprocessing seems to work fine, but when spinning up parallel jobs it fails with MPI_Abort

removed ‘PET0.ESMF_LogFile’
removed ‘PET1.ESMF_LogFile’
removed ‘PET2.ESMF_LogFile’
removed ‘PET3.ESMF_LogFile’
removed ‘PET4.ESMF_LogFile’
removed ‘PET5.ESMF_LogFile’
removed ‘PET6.ESMF_LogFile’
removed ‘PET7.ESMF_LogFile’
 INFO: Processing --np
 INFO: Processing --partmesh
 File                                                      fort.14
 WAS FOUND!  Opening & Processing file

 from alloc_main1:

 memory currently allocated =    834350176  bytes
 memory high water mark     =   1618677332  bytes


 memory currently allocated =    928059968  bytes
 memory high water mark     =   1618677332  bytes

 Global Grid file read successfully.
INFO: This mesh has 7698 weir node pairs.
INFO: Maximum number of duals for any weir node is 2.
 maximum co-nodes for any node =           21
 edge count =      5385262

 Grid Partition Data
 METIS 4.0 will require approximately    604899540  bytes
 Total Edges Cut =        72899
INFO: Writing mesh partition to partmesh.txt.
 INFO: METIS has partitioned nodes successfully.

 memory currently allocated =    928059968  bytes
 memory high water mark     =   1618677332  bytes

 INFO: Processing --np
 INFO: Processing --prepall
 File                                                      fort.14
 WAS FOUND!  Opening & Processing file

 File fort.15
 WAS FOUND!  Opening & Processing file

 Elevation Station Locations contained in fort.15
 Velocity Station Locations Contained in fort.15
 NHSTAR =            5
 *****************************************************
 *   Based on input and information extracted from   *
 *   the ADCIRC UNIT 14 and 15 (grid and horiz run   *
 *   info) files the following paramter values will  *
 *   be set:                                         *
 *                                                   *
 *       MNPROC =     8                             *
 *       MNE =  3564104      MNP =  1813443          *
 *       MNEI =       9                               *
 *       MNOPE =      1      MNETA =    186          *
 *       MNBOU =    186      MNVEL =  62973          *
 *       MNTIF =      8      MNBFR =     13          *
 *       MNSTAE =   398      MNSTAV =     1          *
 *       MNSTAC =     1      MNSTAM =     1          *
 *       MNWP =       1                               *
 *       MNWLAT =     1      MNWLON =     1          *
 *       MNFFR =      1                              *
 *                                                   *
 *   Also, NO wind forcing will be used,             *
 *   means and variance calculation will NOT be made,*
 *   the GWCE matrix will be left in consistent form *
 *   the model will be set up for a 2DDI run,        *
 *   and an iterative solver will be used            *
 *****************************************************

 from alloc_main1:

 memory currently allocated =    835157964  bytes
 memory high water mark     =   1620292908  bytes


 memory currently allocated =    928867756  bytes
 memory high water mark     =   1620292908  bytes

 Global Grid file read successfully.
 INFO: Opening file partmesh.txt
 INFO: Closed partmesh.txt file.
 INFO: Start reading in fort.15.
 nstae=         398
 Elevation Station Locations contained in fort.15
 Velocity Station Locations Contained in fort.15

 memory currently allocated =    928867776  bytes
 memory high water mark     =   1620292908  bytes

 INFO: Fulldomain fort.15 file read successfully.
 INFO: Initializing the netCDF output files.

 Determine the parameters MNPP and MNEP
  Setting MNPP =       234076
  Setting MNEP =       462069
 Allocate arrays dimensioned by MNPP and MNEP
 from alloc_main2:

 memory currently allocated =    995965109  bytes
 memory high water mark     =   1620292908  bytes


 Decomposition of grid begins
 Decomposition Data
 DOMAIN  RES_NODES  GHOST_NODES  TOT_NODES  ELEMENTS
 ------  ---------  -----------  ---------  --------
 GLOBAL                           1813443    3564104
 PE0000    227289        470       227759     440713
 PE0001    225597        670       226267     445040
 PE0002    231831        784       232615     462069
 PE0003    219811        760       220571     434603
 PE0004    232899       1177       234076     460421
 PE0005    221280        441       221721     433178
 PE0006    222149       1047       223196     432613
 PE0007    232587        784       233371     461564
 Decomposition successful
 Writing Local UNIT 14 (Grid) File for each PE

 Boundary Node Decomposition Data
 DOMAIN      NOPE    NETA    NBOU  NVEL    NWEIR
 GLOBAL       1     186     186   62972    7698
 PE0000       0       0      75   14462    5844
 PE0001       0       0      36    6870    1867
 PE0002       0       0       7    2395       0
 PE0003       0       0      11    5808       0
 PE0004       0       0       2    6557       0
 PE0005       0       0       5    9835       0
 PE0006       1     186      69   12749       0
 PE0007       0       0       1    4394       0
 Writing Local UNIT 15 (Run Info) File for each PE

 Station Data
 DOMAIN      NSTAE   NSTAV    NSTAC    NSTAM
 GLOBAL     398       0       0       0
 PE0000      32       0       0       0
 PE0001      26       0       0       0
 PE0002      29       0       0       0
 PE0003      32       0       0       0
 PE0004      29       0       0       0
 PE0005      76       0       0       0
 PE0006     136       0       0       0
 PE0007      38       0       0       0
 Writing Message-Passing Info Files for each PE

 Communication Data
 DOMAIN  COMM_PE  %(SURF/VOL)
 ------  -------  -----------
 PE0000        2      0.21
 PE0001        2      0.30
 PE0002        4      0.34
 PE0003        4      0.35
 PE0004        4      0.51
 PE0005        2      0.20
 PE0006        4      0.47
 PE0007        2      0.34

 memory currently allocated =    995965109  bytes
 memory high water mark     =   1620292908  bytes



 Writing subdomain Nodal Attributes (unit 13)
 file for each PE.
File fort.13
 WAS FOUND!  Opening & Processing file.

     Finished processing mannings_n_at_sea_floor
 for processor range            1  to            8
     Finished processing primitive_weighting_in_continuity_equation
 for processor range            1  to            8
     Finished processing surface_canopy_coefficient
 for processor range            1  to            8
     Finished processing surface_directional_effective_roughness_length
 for processor range            1  to            8
     Finished processing surface_submergence_state
 for processor range            1  to            8

 memory currently allocated =    995965089  bytes
 memory high water mark     =   1620292908  bytes

 Writing domain-decomposition file for post-processor

 INFO: Finished pre-processing input files.

 memory currently allocated =    995965089  bytes
 memory high water mark     =   1620292908  bytes

TACC:  Starting up job 6999047
TACC:  Starting parallel tasks...
application called MPI_Abort(comm=0x84000004, 1) - process 0
application called MPI_Abort(comm=0x84000002, 1) - process 1
application called MPI_Abort(comm=0x84000002, 1) - process 2
application called MPI_Abort(comm=0x84000002, 1) - process 3
TACC:  MPI job exited with code: 1
TACC:  Shutdown complete. Exiting.

The requested model 'schism' is an invalid choice!

The requested model 'schism' is an invalid choice! despite compilation with sCHISM enabled.

$> ./build.sh -component SCHISM 
$> ./NEMS-schism.x
$> cat PET0*

20210701 135056.070 ERROR            PET0 module_EARTH_GRID_COMP.F90:3995 Not valid  -  The requested model 'schism' is an invalid choice!

Implement and test BIAS correction for COASTAL Act project

running on Hera: list-directed I/O syntax error

when running the Slurm job in /scratch2/COASTAL/coastal/save/Zachary.Burnett/runs/hsofs/sandy, the process fails with the following error:

forrtl: severe (59): list-directed I/O syntax error, unit 14, file /scratch2/COASTAL/coastal/save/Zachary.Burnett/runs/hsofs/sandy/nems_hsofs_test/coldstart/fort.14

nems_hsofs_test.out.log:

Starting configuration ./nems_hsofs_test/...
 INFO: Processing --np
 INFO: Processing --partmesh
 File                                                      fort.14
 WAS FOUND!  Opening & Processing file

 from alloc_main1:

 memory currently allocated =   1166680952  bytes
 memory high water mark     =  -2011628412  bytes

_______________________________________________________________
Start Epilog v20.08.28 on node h2c14 for job 14906577 :: Mon Dec 28 16:37:38 UTC 2020
Job 14906577 (not serial) finished for user Zachary.Burnett in partition hera with exit code 59:0
_______________________________________________________________
End Epilogue v20.08.28 Mon Dec 28 16:37:38 UTC 2020

nems_hsofs_test.err.log:

forrtl: severe (59): list-directed I/O syntax error, unit 14, file /scratch2/COASTAL/coastal/save/Zachary.Burnett/runs/hsofs/sandy/nems_hsofs_test/coldstart/fort.14
Image              PC                Routine            Line        Source
adcprep            0000000000602DEE  for__io_return        Unknown  Unknown
adcprep            0000000000639B60  for_read_seq_lis_     Unknown  Unknown
adcprep            000000000051F588  Unknown               Unknown  Unknown
adcprep            00000000004290D9  Unknown               Unknown  Unknown
adcprep            0000000000427BC4  Unknown               Unknown  Unknown
adcprep            000000000040B19E  Unknown               Unknown  Unknown
libc-2.17.so       00002B62F0C96555  __libc_start_main     Unknown  Unknown
adcprep            000000000040B0A9  Unknown               Unknown  Unknown

slurm.job:

#!/bin/bash --login
#SBATCH -D .
#SBATCH -J nems_hsofs_test
#SBATCH --mail-type=ALL
#SBATCH [email protected]
#SBATCH --error=nems_hsofs_test.err.log
#SBATCH --output=nems_hsofs_test.out.log
#SBATCH -n 384
#SBATCH --time=06:30:00

#SBATCH --account=coastal
#SBATCH -q batch

set -e

source /scratch2/COASTAL/coastal/save/Zachary.Burnett/nems/ADC-WW3-NWM-NEMS/modulefiles/hera/ESMF_NUOPC

main() {
  for directory in ./*/; do
    echo "Starting configuration $directory..."
    cd "$directory"
    SECONDS=0
    run_coldstart_phase
    if grep -Rq "ERROR: Elevation.gt.ErrorElev, ADCIRC stopping." nems_hsofs_test.out.log; then
      duration=$SECONDS
      echo "ERROR: Elevation.gt.ErrorElev, ADCIRC stopping."
      echo "Wallclock time: $($duration / 60) minutes and $($duration % 60) seconds."
      exit -1
    else
      run_hotstart_phase
      duration=$SECONDS
      if grep -Rq "ERROR: Elevation.gt.ErrorElev, ADCIRC stopping." nems_hsofs_test.out.log; then
        echo "ERROR: Elevation.gt.ErrorElev, ADCIRC stopping."
        echo "Wallclock time: $($duration / 60) minutes and $($duration % 60) seconds."
        exit -1
      fi
    fi
    echo "Wallclock time: $($duration / 60) minutes and $($duration % 60) seconds."
    cd ..
  done
}

run_coldstart_phase() {
  rm -rf ./coldstart/*
  cd ./coldstart
  ln -sf ../fort.13 ./fort.13
  ln -sf ../fort.14 ./fort.14
  ln -sf ../fort.15.coldstart ./fort.15
  ln -sf ../../nems.configure.coldstart ./nems.configure
  ln -sf ../../model_configure.coldstart ./model_configure
  ln -sf ../../atm_namelist.rc.coldstart ./atm_namelist.rc
  ln -sf ../../config.rc.coldstart ./config.rc
  ln -sf ../../NEMS.x ./NEMS.x
  ln -sf ../../adcprep ./adcprep
  ./adcprep --np $SLURM_NTASKS --partmesh
  ./adcprep --np $SLURM_NTASKS --prepall
  ibrun ./NEMS.x
  clean_directory
  cd ..
}

run_hotstart_phase() {
  rm -rf ./hotstart/*
  cd ./hotstart
  ln -sf ../fort.13 ./fort.13
  ln -sf ../fort.14 ./fort.14
  ln -sf ../fort.15.hotstart ./fort.15
  ln -sf ../coldstart/fort.67.nc ./fort.67.nc
  ln -sf ../../nems.configure.hotstart ./nems.configure
  ln -sf ../../nems.configure.hotstart ./nems.configure
  ln -sf ../../model_configure.hotstart ./model_configure
  ln -sf ../../atm_namelist.rc.hotstart ./atm_namelist.rc
  ln -sf ../../config.rc.hotstart ./config.rc
  ln -sf ../../NEMS.x ./NEMS.x
  ln -sf ../../adcprep ./adcprep
  ./adcprep --np $SLURM_NTASKS --partmesh
  ./adcprep --np $SLURM_NTASKS --prepall
  ibrun ./NEMS.x
  clean_directory
  cd ..
}

clean_directory() {
  rm -rf PE*
  rm -rf partmesh.txt
  rm -rf metis_graph.txt
  rm -rf fort.13
  rm -rf fort.14
  rm -rf fort.15
  rm -rf fort.16
  rm -rf fort.80
  rm -rf fort.68.nc
  rm -rf nems.configure
  rm -rf model_configure
  rm -rf atm_namelist.rc
  rm -rf config.rc
}

main

Implement/check nuopc code (nws=17/517)

Test NEMS workflow with v55 adcirc for PAC mesh for the PAC storms

admin access for setting up automated testing

I would like to have admin access to this repository specifically, so that I can add a token for automated CI checkout and testing (currently set up in the feature/tests branch, but I need to input a credentials token in order to properly checkout the ADCIRC repository which is private)

https://github.com/noaa-ocs-modeling/ADC-WW3-NWM-NEMS/blob/5723ccf157ba79821c888b2a7a4a2977cba554b7/.github/workflows/tests.yml#L1-L12

@LiujuanRachelTang could you please do this? You would just need to go to https://github.com/noaa-ocs-modeling/ADC-WW3-NWM-NEMS/settings/access and add me (@zacharyburnettNOAA) as an Admin for this repo

running on Hera: Run-Time Check Failure

when running /scratch2/COASTAL/coastal/save/shared/repositories/CoupledModelDriver/examples/data/configuration/hera_shinnecock_ike/run_hera.sh, the coldstart phase fails with the following error:

forrtl: severe (194): Run-Time Check Failure. The variable 'adc_mod_mp_read14femesh_$LINENUM' is being used in 'adc_mod.F90(685,9)' without being defined

full output from /scratch2/COASTAL/coastal/save/shared/repositories/CoupledModelDriver/examples/data/configuration/hera_shinnecock_ike/coldstart/ADCIRC_COLDSTART.err.log:

forrtl: severe (194): Run-Time Check Failure. The variable 'adc_mod_mp_read14femesh_$LINENUM' is being used in 'adc_mod.F90(685,9)' without being defined
Image              PC                Routine            Line        Source
NEMS.x             0000000000556A10  adc_mod_mp_read14         685  adc_mod.F90
NEMS.x             000000000054F7B1  adc_mod_mp_extrac         321  adc_mod.F90
NEMS.x             0000000000530972  adc_cap_mp_initia         612  adc_cap.F90
libesmf.so         00002B3E11836A40  _ZN5ESMCI6FTable1        2010  ESMCI_FTable.C
libesmf.so         00002B3E11832448  ESMCI_FTableCallE         746  ESMCI_FTable.C
libesmf.so         00002B3E11C67FFE  _ZN5ESMCI3VMK5ent        1916  ESMCI_VMKernel.C
libesmf.so         00002B3E11C557E2  _ZN5ESMCI2VM5ente        1178  ESMCI_VM.C
libesmf.so         00002B3E11832B31  c_esmc_ftablecall         898  ESMCI_FTable.C
libesmf.so         00002B3E122BEFD3  esmf_compmod_mp_e        1209  ESMF_Comp.F90
libesmf.so         00002B3E12B726A9  esmf_gridcompmod_        1405  ESMF_GridComp.F90
libesmf.so         00002B3E134956DE  nuopc_driver_mp_l        2201  NUOPC_Driver.F90
libesmf.so         00002B3E13482EE8  nuopc_driver_mp_i        1565  NUOPC_Driver.F90
libesmf.so         00002B3E1344EDA2  nuopc_driver_mp_i         386  NUOPC_Driver.F90
libesmf.so         00002B3E11836A40  _ZN5ESMCI6FTable1        2010  ESMCI_FTable.C
libesmf.so         00002B3E11832448  ESMCI_FTableCallE         746  ESMCI_FTable.C
libesmf.so         00002B3E11C67FFE  _ZN5ESMCI3VMK5ent        1916  ESMCI_VMKernel.C
libesmf.so         00002B3E11C557E2  _ZN5ESMCI2VM5ente        1178  ESMCI_VM.C
libesmf.so         00002B3E11832B31  c_esmc_ftablecall         898  ESMCI_FTable.C
libesmf.so         00002B3E122BEFD3  esmf_compmod_mp_e        1209  ESMF_Comp.F90
libesmf.so         00002B3E12B726A9  esmf_gridcompmod_        1405  ESMF_GridComp.F90
NEMS.x             00000000004F993D  Unknown               Unknown  Unknown
libesmf.so         00002B3E11836A40  _ZN5ESMCI6FTable1        2010  ESMCI_FTable.C
libesmf.so         00002B3E11832448  ESMCI_FTableCallE         746  ESMCI_FTable.C
libesmf.so         00002B3E11C67FFE  _ZN5ESMCI3VMK5ent        1916  ESMCI_VMKernel.C
libesmf.so         00002B3E11C557E2  _ZN5ESMCI2VM5ente        1178  ESMCI_VM.C
libesmf.so         00002B3E11832B31  c_esmc_ftablecall         898  ESMCI_FTable.C
libesmf.so         00002B3E122BEFD3  esmf_compmod_mp_e        1209  ESMF_Comp.F90
libesmf.so         00002B3E12B726A9  esmf_gridcompmod_        1405  ESMF_GridComp.F90
NEMS.x             00000000004156AB  Unknown               Unknown  Unknown
NEMS.x             000000000041331E  Unknown               Unknown  Unknown
libc-2.17.so       00002B3E17DD7555  __libc_start_main     Unknown  Unknown
NEMS.x             0000000000413229  Unknown               Unknown  Unknown

Create new branch for SCHISM inclusion

Please create a branch for our work towards SCHISM inclusion

add William to organization

@WPringle needs the following:

create @noaa.gov GitHub account
add to noaa-ocs-modeling

NEMS compile error due to duplicate (case insensitive) files ENS_CplComp_ESMFMod_STUB.[fF]90

There are two files with the same name, save for the F90/f90 extension. This is a fundamental problem on non-case-sentitive storage media or file systems.

'NEMS/src/ENS_Cpl/ENS_CplComp_ESMFMod_STUB.F90'
'NEMS/src/ENS_Cpl/ENS_CplComp_ESMFMod_STUB.f90'

add Yuji to organization

create @noaa.gov GitHub account
add to noaa-ocs-modeling

we need a new name

ADC-WW3-NWM-NEMS is unwieldy

perhaps CoastalNEMS or CoastalModelingApplication

ATMESH+ADCIRC NEMS run for 120 and 250m

120 m
250 m

Provide previous storm ATM forcing to VIMS.

Baroclinic - MVP to use Global 1.5 Km as the main test

tidal run (provide by @cblakely97 , reproduce by @pvelissariou1 @WPringle
time dependent internal tide dissipation
- Pressure gradient + time dependent internal tide dissipation
tidal +ATM
- Pressure gradient + time dependent internal tide dissipation + pressure balance adjustment
tidal + ATM + Baroclinic

`error while loading shared libraries: libmkl_intel_lp64.so` when submitting to Slurm on Hera

when submitting a Slurm job (sbatch slurm.sh) in /scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726:

/var/spool/slurmd/job14587258/slurm_script: line 15: source: /scratch2/COASTAL/coastal/save/Zachary.Burnett/ADC-WW3-NWM-NEMS/modulefiles/hera: is a directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
/scratch2/COASTAL/coastal/save/Zachary.Burnett/flo/runs/a70_FLO_ATM_WAV2OCN_v2.1_new_hwrf_land_mask_hera/rt_20200306_h21_m45_s06r726/./NEMS.x: error while loading shared libraries: libmkl_intel_lp64.so: cannot open shared object file: No such file or directory
srun: error: h20c07: tasks 117-155: Exited with exit code 127
srun: Terminating job step 14587258.0
slurmstepd: error: *** STEP 14587258.0 ON h10c01 CANCELLED AT 2020-12-16T17:06:32 ***
srun: error: h10c01: tasks 0-38: Exited with exit code 127
srun: error: h10c14: tasks 39-77: Exited with exit code 127
srun: error: h20c52: tasks 346-383: Exited with exit code 127
srun: error: h20c20: tasks 156-193: Exited with exit code 127
srun: error: h20c25: tasks 232-269: Exited with exit code 127
srun: error: h10c49: tasks 78-116: Exited with exit code 127
srun: error: h20c33: tasks 308-345: Exited with exit code 127
srun: error: h20c31: tasks 270-307: Exited with exit code 127
srun: error: h20c21: tasks 194-231: Terminated
srun: Force Terminated job step 14587258.0

Separate build infrastructure for netcdf-c and netcdf-fortran

The current build infrastructure considers only unified C/Fortran netcdf paths

PlatformFuncs:              export NETCDF="${_var_val}"
PlatformFuncs:              export NETCDFHOME="${_var_val}"
PlatformFuncs:              export NETCDF_DIR="${_var_val}"
PlatformFuncs:              export NETCDF_PATH="${_var_val}"
PlatformFuncs:              export NETCDF_ROOT="${_var_val}"

On many systems, these are located, however in different directories, such that we would need NETCDF_C_XXXX and NETCDF_FORTRAN_XXXX variables. This currently prevents deploying the system via simple modifications to modulefiles/env_module* to system having a separate C/Fortran netcdf interface.

add write access to `NEMS` repository

the NEMS repository at https://github.com/noaa-ocs-modeling/NEMS does not have write permissions for the Storm Surge team

I think that this setting should be changed from Read to Write

this setting is at the following page:
https://github.com/orgs/noaa-ocs-modeling/teams/nos-storm-surge-modeling/repositories

@LiujuanRachelTang, could you do this please? I can correspond either here in this comment section or at [email protected], if you need more information

Thanks!

Padcirc exe as part of build.sh process

Getting padcirc compiled as a part of build.sh on

Why the padcirc is not getting generated on Hera?

@pvelissariou1 @zacharyburnettNOAA

Note from Takis:
work/makefile go to the line all: (line 500). over there you can define what to build. Currently it compiles/builds metis adcprep adcpost adcirc padcirc and libadc.a

set up SCHISM build + tests on Orion w/ sample meshes

build SCHISM with feature/schism and test on /work/noaa/nosofs/share/models/meshes/hsofs/120m/Subsetted_Florence2018_Test

"Disk quota exceeded" errors on Hera in `/scratch2/COASTAL/coastal/save`

I'm getting some "Disk quota exceeded" errors on Hera. Is the /scratch2/COASTAL/coastal/save directory its own disk?

  Zachary.Burnett@hfe07  /scratch2/COASTAL/coastal/save/shared
 > du -csh *

1.3M    _old
15G     miniconda3
116G    models
192M    packages
1.8G    repositories
50G     saeed
2.0T    working

 Zachary.Burnett@hfe08  /scratch2/COASTAL/coastal/save/shared/working/zach/nems_adcirc
 > du -csh ./*

4.0K    ./generate_florence_hsofs.sh
4.0K    ./initialize_hsofs_250m_v1.0.sh
4.0K    ./initialize_hsofs_250m_v1.0_besttrack.sh
4.0K    ./reference_uv.py
4.0K    ./reference_zeta.py
4.0K    ./run_20210830_florence_multivariate_besttrack_120m_40members_nws8
8.0K    ./perturb_tracks_hera.py
703M    ./run_20210812_florence_multivariate_besttrack_120m_40members_nws19
752M    ./run_20210818_florence_atmesh_120m_implicit
755M    ./run_20210818_florence_multivariate_besttrack_120m_150members_nws8
858M    ./run_20210825_florence_multivariate_besttrack_120m_40members_nws8
907M    ./run_20210811_florence_atmesh_120m_yujicopy_oldnems
1.3G    ./run_20210804_florence_besttrack_250msubset
1.3G    ./run_20210823_florence_multivariate_besttrack_120m_40members_nws8
1.5G    ./run_20210902_florence_atmesh_250msubset_UND
1.5G    ./run_20210903_florence_atmesh_250msubset_UND
1.7G    ./run_20210723_nws19
1.8G    ./run_20210831_florence_atmesh_250msubset_UND
2.5G    ./run_20210804_florence_atmesh_250msubset
3.3G    ./run_20210804_florence_atmesh_ww3data_250m
3.3G    ./run_20210804_florence_besttrack_250m
4.5G    ./run_20210805_florence_atmesh_250m
4.9G    ./run_20210809_florence_atmesh_250m
5.2G    ./run_20210805_florence_besttrack_250msubset
5.4G    ./run_20210721_multivariate_ensemble
5.9G    ./run_20210805_florence_atmesh_250msubset
6.0G    ./run_20210816_florence_multivariate_besttrack_250msubset_5members
6.4G    ./run_20210804_florence_besttrack_120m
6.4G    ./run_20210805_florence_atmesh_120m
6.5G    ./run_20210708_florence_perturbation_test
6.5G    ./run_20210712_florence_perturbation_test
6.5G    ./run_20210713_florence_perturbation_test
6.9G    ./run_20210702_perturbed_track_example
7.0G    ./run_20210902_florence_multivariate_besttrack_250msubset_40members_nws8_william
7.2G    ./run_20210811_florence_atmesh_120m
7.5G    ./run_20210809_florence_atmesh_120m
7.9G    ./run_20210812_florence_atmesh_120m_yujicopy_oldnems
8.4G    ./run_20210810_florence_atmesh_120m
11G     ./run_20210805_florence_besttrack_250m
13G     ./run_20210720_perturbed_track_example_nws8
15G     ./run_20210813_florence_multivariate_besttrack_120m_5members
21G     ./run_20210824_florence_multivariate_besttrack_250msubset_40members_nws8
22G     ./run_20210720_large_ensemble
22G     ./run_20210823_florence_multivariate_besttrack_250msubset_40members_nws8
22G     ./run_20210830_florence_multivariate_besttrack_250msubset_40members_nws8
23G     ./run_20210810_florence_atmesh_250m
23G     ./run_20210811_florence_multivariate_besttrack_120m_5members
23G     ./run_20210902_florence_multivariate_besttrack_250msubset_40members_nws8
24G     ./run_20210706_perturbed_track_example
24G     ./run_20210706_perturbed_track_example_ICS22
28G     ./run_20210805_florence_besttrack_120m_nws20
44G     ./run_20210818_florence_multivariate_besttrack_250msubset_40members_nws8
46G     ./run_20210719_perturbed_track_example
59G     ./run_20210830_florence_multivariate_besttrack_250m_40members_nws8
60G     ./run_20210811_florence_atmesh_120m_yujicopy_newnems
76G     ./run_20210812_florence_atmesh_120m_yujicopy_newnems
90G     ./run_20210812_florence_multivariate_besttrack_250msubset_40members
110G    ./run_20210831_florence_multivariate_besttrack_250msubset_40members
132G    ./run_20210818_florence_multivariate_besttrack_120m_40members_nws8
667G    ./run_20210707_perturbed_track_example
1.7T    total

I will work on reducing the duplication of files among perturbations (mainly fort.14) by checking for equality in coupledmodeldriver

Follow up Andre for the best form of WW3 for the coupled application

symbol lookup error when running NEMS.x compiled on TACC

when using the new patched NEMS.x compiled on TACC

sh run_nems_local.sh

removed ‘PET0.ESMF_LogFile’
removed ‘PET1.ESMF_LogFile’
removed ‘PET2.ESMF_LogFile’
removed ‘PET3.ESMF_LogFile’
removed ‘PET4.ESMF_LogFile’
removed ‘PET5.ESMF_LogFile’
removed ‘PET6.ESMF_LogFile’
removed ‘PET7.ESMF_LogFile’

The following have been reloaded with a version change:
  1) impi-intel/esmf-8.0.1 => impi-intel/esmf-7.1.0r

TACC:  Starting up job 6962668
TACC:  Starting parallel tasks...
/scratch/07531/zrb/test/adcircpy/coldstart/NEMS.x: symbol lookup error: /scratch/07531/zrb/test/adcircpy/coldstart/NEMS.x: undefined symbol: esmf_configmod_mp_esmf_configcreateempty_
/scratch/07531/zrb/test/adcircpy/coldstart/NEMS.x: symbol lookup error: /scratch/07531/zrb/test/adcircpy/coldstart/NEMS.x: undefined symbol: esmf_configmod_mp_esmf_configcreateempty_
/scratch/07531/zrb/test/adcircpy/coldstart/NEMS.x: symbol lookup error: /scratch/07531/zrb/test/adcircpy/coldstart/NEMS.x: undefined symbol: esmf_configmod_mp_esmf_configcreateempty_
/scratch/07531/zrb/test/adcircpy/coldstart/NEMS.x: symbol lookup error: /scratch/07531/zrb/test/adcircpy/coldstart/NEMS.x: undefined symbol: esmf_configmod_mp_esmf_configcreateempty_
/scratch/07531/zrb/test/adcircpy/coldstart/NEMS.x: symbol lookup error: /scratch/07531/zrb/test/adcircpy/coldstart/NEMS.x: undefined symbol: esmf_configmod_mp_esmf_configcreateempty_
/scratch/07531/zrb/test/adcircpy/coldstart/NEMS.x: symbol lookup error: /scratch/07531/zrb/test/adcircpy/coldstart/NEMS.x: undefined symbol: esmf_configmod_mp_esmf_configcreateempty_
/scratch/07531/zrb/test/adcircpy/coldstart/NEMS.x: symbol lookup error: /scratch/07531/zrb/test/adcircpy/coldstart/NEMS.x: undefined symbol: esmf_configmod_mp_esmf_configcreateempty_
/scratch/07531/zrb/test/adcircpy/coldstart/NEMS.x: symbol lookup error: /scratch/07531/zrb/test/adcircpy/coldstart/NEMS.x: undefined symbol: esmf_configmod_mp_esmf_configcreateempty_
TACC:  MPI job exited with code: 127
TACC:  Shutdown complete. Exiting.

ADCIRC build fails on Orion, Strand, and Mistral

command

cd /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS
sh build.sh --component "ADCIRC ATMESH WW3DATA" --compiler intel --clean -2 --plat orion

modulefile

I modified the modulefile in envmodules_intel.orion to be as follows:

#!/bin/bash-*-Shell-script-modules*-

# This script is responsible for loading modules that are
# compatible with the NUOPC Layer version used in NEMS.

####################
### (1) Load all needed environment modules.
module purge
module load intel/2020 impi
module load szip hdf5/1.10.5-parallel
module load netcdf/4.7.2-parallel netcdf/4.7.4

module load esmf/8.0.0


####################
### (2) Set some environments varaiables related to the loaded
###     modules and required to compile the NEMS application properly.

export HDF5HOME=${HDF5_ROOT}
export NETCDFHOME=${NETCDF_ROOT}

export NETCDF_CONFIG=${NETCDFHOME:+${NETCDFHOME}/bin/nc-config}
export NETCDF_INCDIR=${NETCDF_INCLUDE_DIRS}
export NETCDF_LIBDIR=${NETCDF_LIBRARY_DIRS}

export ESMFMKFILE=${ESMFMKFILE}

output

The following have been reloaded with a version change:
  1) impi/2020.2 => impi/2020


The following have been reloaded with a version change:
  1) hdf5/1.10.5-parallel => hdf5/1.10.6


The following have been reloaded with a version change:
  1) hdf5/1.10.6 => hdf5/1.10.5-parallel     2) netcdf/4.7.4 => netcdf/4.7.2-parallel


The following variables are defined:
    CLEAN          = -2
    COMPILER       = intel
    NEMS_COMPILER  = intel
    MODULES FILE   = envmodules_intel.orion
    COMPONENTS     = ADCIRC ATMESH WW3DATA
    OS             = linux
    PLATFORM       = orion
    VERBOSE        =

    HDF5HOME       = /apps/intel-2020/hdf5-1.10.5-parallel
    NETCDFHOME     = /apps/intel-2020/netcdf-4.7.2-parallel
    NETCDF_INCDIR  = /apps/intel-2020/netcdf-4.7.2-parallel/include
    NETCDF_LIBDIR  = /apps/intel-2020/netcdf-4.7.2-parallel/lib

    ESMFMKFILE     = /apps/intel-2020/esmf-8.0.0/lib/esmf.mk


Currently Loaded Modules:
  1) intel/2020   2) szip/2.1.1   3) hdf5/1.10.5-parallel   4) impi/2020   5) pnetcdf/1.12.0   6) netcdf/4.7.2-parallel   7) esmf/8.0.0



Are these values correct? [y/n]: y

compileNems :: Cleaning: make -f GNUmakefile distclean COMPONENTS="ADCIRC ATMESH WW3DATA"
NOTE: Skipping appbuilder.mk creation; no appbuilder file in use.
echo 'ADCIRC ATMESH WW3DATA' > "/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/components.mk"
cd /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work ; exec make -k clean
make[1]: Entering directory `/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work'
makefile:19: (INFO) Guessing the type of platform ADCIRC will run on...
makefile:31: (INFO) Name is x86_64-unknown-linux-gnu, Machine is x86_64, Vendor is unknown, and OS is linux-gnu.
makefile:32: (INFO) The root directory for the build is /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC
makefile:33: (INFO) The ADCIRC version is v55.00-31-g7428737
cmplrflags.mk:377: (INFO) Corresponding machine found in cmplrflags.mk.
makefile:39: (INFO) The compiler variable in cmplrflags.mk is set to intel.
makefile:41: (INFO) The following compilers have been selected...
makefile:42: (INFO) The Fortran compiler for adcprep is set to ifort.
makefile:43: (INFO) The serial Fortran compiler is set to ifort.
makefile:44: (INFO) The parallel Fortran compiler is set to mpif90.
makefile:45: (INFO) The C compiler is set to icc.
makefile:49: (WARNING) Intel compiler has been specified. The flag "--heap-arrays 16384" should be set
makefile:50: (WARNING) in both ADCIRC cmplrflags.mk FFLAGS1 and when compiling the netcdf-fortran library
makefile:51: (WARNING) using FCFLAGS to avoid potential issues with stack allocation of large implicit arrays.
rm -f *.o odir*/*.o  *.mod odir*/*.mod actualflags.txt
rm -f  ../thirdparty/swan/*.f ../thirdparty/swan/*.for ../thirdparty/swan/*.f90 .swanlastcompile
rm -f ../thirdparty/nuopc/*.o ../thirdparty/nuopc/*.mod
rm -f ../util/estofs_tide_fac/estofs_tide_fac
make[1]: Leaving directory `/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work'

cd /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work ; exec make -k clobber
make[1]: Entering directory `/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work'
makefile:19: (INFO) Guessing the type of platform ADCIRC will run on...
makefile:31: (INFO) Name is x86_64-unknown-linux-gnu, Machine is x86_64, Vendor is unknown, and OS is linux-gnu.
makefile:32: (INFO) The root directory for the build is /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC
makefile:33: (INFO) The ADCIRC version is v55.00-31-g7428737
cmplrflags.mk:377: (INFO) Corresponding machine found in cmplrflags.mk.
makefile:39: (INFO) The compiler variable in cmplrflags.mk is set to intel.
makefile:41: (INFO) The following compilers have been selected...
makefile:42: (INFO) The Fortran compiler for adcprep is set to ifort.
makefile:43: (INFO) The serial Fortran compiler is set to ifort.
makefile:44: (INFO) The parallel Fortran compiler is set to mpif90.
makefile:45: (INFO) The C compiler is set to icc.
makefile:49: (WARNING) Intel compiler has been specified. The flag "--heap-arrays 16384" should be set
makefile:50: (WARNING) in both ADCIRC cmplrflags.mk FFLAGS1 and when compiling the netcdf-fortran library
makefile:51: (WARNING) using FCFLAGS to avoid potential issues with stack allocation of large implicit arrays.
rm -f *.o odir*/*.o  *.mod odir*/*.mod actualflags.txt
rm -f  ../thirdparty/swan/*.f ../thirdparty/swan/*.for ../thirdparty/swan/*.f90 .swanlastcompile
rm -f ../thirdparty/nuopc/*.o ../thirdparty/nuopc/*.mod
rm -f ../util/estofs_tide_fac/estofs_tide_fac
rm -r -f odir* util/*
rm -f adcprep adcprep_be adcirc padcirc adcswan padcswan p15 owi22 build13 aswip \
      build12 buildstwave23 hot2asc inflate hstime sizes.o adcpost adccmp libadc.a
make[1]: Leaving directory `/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work'
rm -rf /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC_INSTALL

cd /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ATMESH ; exec make -f makefile.atmesh.nuopc nuopcclean
make[1]: Entering directory `/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ATMESH'
rm -f  atmesh.o atmesh_mod.o  atmesh.mod atmesh_mod.mod libatmesh_cap.a
make[1]: Leaving directory `/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ATMESH'
rm -rf /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ATMESH_INSTALL
cd /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/WW3DATA ; exec make -f makefile.ww3data.nuopc nuopcclean
make[1]: Entering directory `/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/WW3DATA'

rm -f  wav.o wav_mod.o wav.mod wav_mod.mod libww3data_cap.a

make[1]: Leaving directory `/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/WW3DATA'
rm -rf /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/WW3DATA_INSTALL
if ! test -f /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/configure.nems.NUOPC ; then       \
  cat /dev/null > /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/configure.nems.NUOPC       ; \
  delete_nuopc=yes                                      ; \
fi                                                      ; \
cd /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src ; make "COMPONENTS=ADCIRC ATMESH WW3DATA"    \
  INCLUDES_ARE_OPTIONAL=YES clean                       ; \
if [ "$delete_nuopc" = yes ] ; then                      \
  rm -f /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/configure.nems.NUOPC                 ; \
fi
Components in linker order: WW3DATA ATMESH ADCIRC
WW3DATA: include
make[1]: Entering directory `/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src'
GNUmakefile:70: : component WW3DATA makefile fragment is missing
ATMESH: include
GNUmakefile:70: : component ATMESH makefile fragment is missing
ADCIRC: include
GNUmakefile:70: : component ADCIRC makefile fragment is missing
CPPFLAGS += ESMF_VERSION_STRING_GIT="NoGit"
CPPFLAGS += ESMF_VERSION_MINOR="0"
CPPFLAGS += ESMF_VERSION_BETASNAPSHOT="'F'"
CPPFLAGS += ESMF_VERSION_PATCHLEVEL="0"
CPPFLAGS += ESMF_VERSION_STRING="8.0.0"
CPPFLAGS += ESMF_VERSION_REVISION="0"
CPPFLAGS += ESMF_VERSION_MAJOR="8"
CPPFLAGS += ESMF_VERSION_PUBLIC="'T'"
rm -f *.tmp.f90 *.lst *.o *.mod lm map
cd ENS_Cpl ; make clean
make[2]: Entering directory `/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/ENS_Cpl'
rm -f ENS_Cpl.a *.f90 *.o *.mod *.lst lm map depend
make[2]: Leaving directory `/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/ENS_Cpl'
make[1]: Leaving directory `/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src'
rm -f /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/exe/NEMS.x /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/configure.nems.NUOPC
rm -f /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/configure.nems /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/externals.nems /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/modules.nems /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/ESMFVersionDefine.h /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/modules.nems.sh /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/modules.nems.csh /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/test-results.mk
rm -f /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/components.mk
rm -f /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/test_results.mk

compileNems :: Compiling: make  -f GNUmakefile build COMPONENTS="ADCIRC ATMESH WW3DATA"
NOTE: Skipping appbuilder.mk creation; no appbuilder file in use.
echo 'ADCIRC ATMESH WW3DATA' > "/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/components.mk"
cp /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/conf/configure.nems.linux.intel /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/configure.nems
cat /dev/null > /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/externals.nems
cat /dev/null > /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/modules.nems
cp /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/ESMFVersionDefine_ESMF_NUOPC.h /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/ESMFVersionDefine.h
( echo '. /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/modules.nems' ) > "/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/modules.nems.sh"
( echo 'source /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/modules.nems' ) > "/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/modules.nems.csh"
/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/incmake/configure_rules.mk:3: /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/test-results.mk: No such file or directory
make -f /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/incmake/tests.mk    \
      MODULE_LOGIC="echo No module selected."           \
      TARGET="/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/test-results.mk" TEST
make[1]: Entering directory `/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS'
if [ -f "/modules.nems" ] ; then \
  echo No module selected. ; \
fi ; \
( \
echo "# Do not edit this file.  It is automatically generated from tests.mk." ; \
echo "CASELESS_FILESYSTEM=NO" ; \
if [ "Q$ESMFMKFILE" != Q ] ; then egrep 'VERSION|^ESMF_[A-Z]*DIR' < "$ESMFMKFILE" ; fi ; \
) > "/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS/src/conf/test-results.mk"
make[1]: Leaving directory `/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/NEMS'
echo No module selected. ; cd /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/thirdparty/nuopc; exec ./make_nuopc.sh intel        
No module selected.
makefile:19: (INFO) Guessing the type of platform ADCIRC will run on...
makefile:31: (INFO) Name is x86_64-unknown-linux-gnu, Machine is x86_64, Vendor is unknown, and OS is linux-gnu.
makefile:32: (INFO) The root directory for the build is /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC
makefile:33: (INFO) The ADCIRC version is v55.00-31-g7428737
cmplrflags.mk:377: (INFO) Corresponding machine found in cmplrflags.mk.
makefile:39: (INFO) The compiler variable in cmplrflags.mk is set to intel.
makefile:41: (INFO) The following compilers have been selected...
makefile:42: (INFO) The Fortran compiler for adcprep is set to ifort.
makefile:43: (INFO) The serial Fortran compiler is set to ifort.
makefile:44: (INFO) The parallel Fortran compiler is set to mpif90.
makefile:45: (INFO) The C compiler is set to icc.
makefile:49: (WARNING) Intel compiler has been specified. The flag "--heap-arrays 16384" should be set
makefile:50: (WARNING) in both ADCIRC cmplrflags.mk FFLAGS1 and when compiling the netcdf-fortran library
makefile:51: (WARNING) using FCFLAGS to avoid potential issues with stack allocation of large implicit arrays.
make LIBADC=libadc.a BUILDTYPE=libadc.a CC=icc CFLAGS=-I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX libadc.a
make LIBADC=libadc.a BUILDTYPE=libadc.a CC="icc" CFLAGS="-I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX" libadc.a
make[1]: Entering directory `/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work'
makefile:19: (INFO) Guessing the type of platform ADCIRC will run on...
makefile:31: (INFO) Name is x86_64-unknown-linux-gnu, Machine is x86_64, Vendor is unknown, and OS is linux-gnu.
makefile:32: (INFO) The root directory for the build is /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC
makefile:33: (INFO) The ADCIRC version is v55.00-31-g7428737
cmplrflags.mk:377: (INFO) Corresponding machine found in cmplrflags.mk.
makefile:39: (INFO) The compiler variable in cmplrflags.mk is set to intel.
makefile:41: (INFO) The following compilers have been selected...
makefile:42: (INFO) The Fortran compiler for adcprep is set to ifort.
makefile:43: (INFO) The serial Fortran compiler is set to ifort.
makefile:44: (INFO) The parallel Fortran compiler is set to mpif90.
makefile:45: (INFO) The C compiler is set to icc.
makefile:49: (WARNING) Intel compiler has been specified. The flag "--heap-arrays 16384" should be set
makefile:50: (WARNING) in both ADCIRC cmplrflags.mk FFLAGS1 and when compiling the netcdf-fortran library
makefile:51: (WARNING) using FCFLAGS to avoid potential issues with stack allocation of large implicit arrays.
mkdir -p /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odircp/
mpif90 -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -DCSCA -DCMPI -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odircp/ -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odircp/sizes.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/src/sizes.F
gfortran: error: byterecl: No such file or directory
gfortran: error: buffered_io: No such file or directory
gfortran: error: unrecognized command line option ‘-traceback’
gfortran: error: unrecognized command line option ‘-assume’
gfortran: error: unrecognized command line option ‘-132’
gfortran: error: unrecognized command line option ‘-assume’
make[1]: *** [/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odircp/sizes.o] Error 1
make[1]: Leaving directory `/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work'
make: *** [libadc.a] Error 2
makefile:19: (INFO) Guessing the type of platform ADCIRC will run on...
makefile:31: (INFO) Name is x86_64-unknown-linux-gnu, Machine is x86_64, Vendor is unknown, and OS is linux-gnu.
makefile:32: (INFO) The root directory for the build is /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC
makefile:33: (INFO) The ADCIRC version is v55.00-31-g7428737
cmplrflags.mk:377: (INFO) Corresponding machine found in cmplrflags.mk.
makefile:39: (INFO) The compiler variable in cmplrflags.mk is set to intel.
makefile:41: (INFO) The following compilers have been selected...
makefile:42: (INFO) The Fortran compiler for adcprep is set to ifort.
makefile:43: (INFO) The serial Fortran compiler is set to ifort.
makefile:44: (INFO) The parallel Fortran compiler is set to mpif90.
makefile:45: (INFO) The C compiler is set to icc.
makefile:49: (WARNING) Intel compiler has been specified. The flag "--heap-arrays 16384" should be set
makefile:50: (WARNING) in both ADCIRC cmplrflags.mk FFLAGS1 and when compiling the netcdf-fortran library
makefile:51: (WARNING) using FCFLAGS to avoid potential issues with stack allocation of large implicit arrays.
mkdir odir_metis
make -C /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/thirdparty/metis/Lib/ CC="icc" CFLAGS="-I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX" O_DIR="/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/" LIBMETIS="/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/libmetis.a" ARFLAGS="rv"
make[1]: Entering directory `/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/thirdparty/metis/Lib'
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/coarsen.o coarsen.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/fm.o fm.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/initpart.o initpart.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/match.o match.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/ccgraph.o ccgraph.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/memory.o memory.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/pmetis.o pmetis.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/pqueue.o pqueue.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/refine.o refine.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/util.o util.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/timing.o timing.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/debug.o debug.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/bucketsort.o bucketsort.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/graph.o graph.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/stat.o stat.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/kmetis.o kmetis.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/kwayrefine.o kwayrefine.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/kwayfm.o kwayfm.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/balance.o balance.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/ometis.o ometis.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/srefine.o srefine.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/sfm.o sfm.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/separator.o separator.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mincover.o mincover.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mmd.o mmd.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mesh.o mesh.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/meshpart.o meshpart.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/frename.o frename.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/fortran.o fortran.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/myqsort.o myqsort.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/compress.o compress.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/parmetis.o parmetis.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/estmem.o estmem.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mpmetis.o mpmetis.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mcoarsen.o mcoarsen.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mmatch.o mmatch.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/minitpart.o minitpart.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mbalance.o mbalance.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mrefine.o mrefine.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mutil.o mutil.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mfm.o mfm.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mkmetis.o mkmetis.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mkwayrefine.o mkwayrefine.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mkwayfmh.o mkwayfmh.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mrefine2.o mrefine2.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/minitpart2.o minitpart2.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mbalance2.o mbalance2.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mfm2.o mfm2.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/kvmetis.o kvmetis.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/kwayvolrefine.o kwayvolrefine.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/kwayvolfm.o kwayvolfm.c
icc -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/subdomains.o subdomains.c
ar rv /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/libmetis.a  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/coarsen.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/fm.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/initpart.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/match.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/ccgraph.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/memory.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/pmetis.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/pqueue.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/refine.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/util.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/timing.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/debug.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/bucketsort.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/graph.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/stat.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/kmetis.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/kwayrefine.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/kwayfm.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/balance.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/ometis.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/srefine.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/sfm.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/separator.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mincover.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mmd.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mesh.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/meshpart.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/frename.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/fortran.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/myqsort.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/compress.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/parmetis.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/estmem.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mpmetis.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mcoarsen.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mmatch.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/minitpart.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mbalance.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mrefine.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mutil.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mfm.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mkmetis.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mkwayrefine.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mkwayfmh.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mrefine2.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/minitpart2.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mbalance2.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mfm2.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/kvmetis.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/kwayvolrefine.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/kwayvolfm.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/subdomains.o
ar: creating /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/libmetis.a
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/coarsen.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/fm.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/initpart.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/match.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/ccgraph.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/memory.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/pmetis.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/pqueue.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/refine.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/util.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/timing.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/debug.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/bucketsort.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/graph.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/stat.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/kmetis.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/kwayrefine.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/kwayfm.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/balance.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/ometis.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/srefine.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/sfm.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/separator.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mincover.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mmd.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mesh.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/meshpart.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/frename.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/fortran.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/myqsort.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/compress.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/parmetis.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/estmem.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mpmetis.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mcoarsen.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mmatch.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/minitpart.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mbalance.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mrefine.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mutil.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mfm.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mkmetis.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mkwayrefine.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mkwayfmh.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mrefine2.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/minitpart2.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mbalance2.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/mfm2.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/kvmetis.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/kwayvolrefine.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/kwayvolfm.o
a - /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/subdomains.o
ar -ts /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir_metis/libmetis.a
make[1]: Leaving directory `/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/thirdparty/metis/Lib'
make BUILDTYPE=adcprep  adcprep
make[1]: Entering directory `/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work'
makefile:19: (INFO) Guessing the type of platform ADCIRC will run on...
makefile:31: (INFO) Name is x86_64-unknown-linux-gnu, Machine is x86_64, Vendor is unknown, and OS is linux-gnu.
makefile:32: (INFO) The root directory for the build is /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC
makefile:33: (INFO) The ADCIRC version is v55.00-31-g7428737
cmplrflags.mk:377: (INFO) Corresponding machine found in cmplrflags.mk.
makefile:39: (INFO) The compiler variable in cmplrflags.mk is set to intel.
makefile:41: (INFO) The following compilers have been selected...
makefile:42: (INFO) The Fortran compiler for adcprep is set to ifort.
makefile:43: (INFO) The serial Fortran compiler is set to ifort.
makefile:44: (INFO) The parallel Fortran compiler is set to mpif90.
makefile:45: (INFO) The C compiler is set to icc.
makefile:49: (WARNING) Intel compiler has been specified. The flag "--heap-arrays 16384" should be set
makefile:50: (WARNING) in both ADCIRC cmplrflags.mk FFLAGS1 and when compiling the netcdf-fortran library
makefile:51: (WARNING) using FCFLAGS to avoid potential issues with stack allocation of large implicit arrays.
mkdir -p /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/version.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/version.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/sizes.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/src/sizes.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/kdtree2.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/thirdparty/KDTREE2/kdtree2.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/global.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/src/global.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/boundaries.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/src/boundaries.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/hashtable.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/src/hashtable.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/mesh.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/src/mesh.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/vortex.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/wind/vortex.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/nodalattr.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/src/nodalattr.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
make[1]: Circular /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/wind.o <- /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/wind.o dependency dropped.
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/owiwind.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/src/owiwind.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/rs2.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/src/rs2.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/owi_ice.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/src/owi_ice.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/owiwind_netcdf.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/src/owiwind_netcdf.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/wind.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/src/wind.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/presizes.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep/presizes.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/global_3dvs.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/src/global_3dvs.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/pre_global.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep/pre_global.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/metis.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep/metis.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/quadrature.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/src/quadrature.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/sponge_layer.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/src/sponge_layer.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/couple2baroclinic3D.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/src/couple2baroclinic3D.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/harm.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/src/harm.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/itpackv.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/src/itpackv.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/subdomain.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/src/subdomain.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/momentum.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/src/momentum.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/gwce.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/src/gwce.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/netcdfio.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/src/netcdfio.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
make[1]: Circular /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/subprep.o <- /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/subprep.o dependency dropped.
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/subprep.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep/subprep.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/adcprep.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep/adcprep.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/decomp.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep/decomp.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/prep_weir.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep/prep_weir.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/read_global.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep/read_global.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/prep.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep/prep.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/interp.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep/interp.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -c -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/machdep.o  /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep/machdep.F
if [ "`echo *.mod`" != '*.mod' ]; then mv *.mod /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/; fi
icc -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -xSSE4.2 -m64 -mcmodel=medium -DLINUX   -c /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep/mkdir.c -o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/mkdir.o
ifort -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -O2 -g -traceback -FI -assume byterecl -132 -xSSE4.2 -assume buffered_io -DADCNETCDF -I/apps/intel-2020/netcdf-4.7.2-parallel/include -DHAVE_NETCDF4 -DNETCDF_CAN_DEFLATE -DREAL8 -DLINUX -I /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/  -o adcprep /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/presizes.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/couple2baroclinic3D.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/pre_global.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/subprep.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/adcprep.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/quadrature.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/global.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/prep_weir.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/sizes.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/interp.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/version.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/owiwind.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/sponge_layer.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/momentum.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/wind.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/rs2.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/global_3dvs.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/mkdir.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/hashtable.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/mesh.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/machdep.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/owiwind_netcdf.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/vortex.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/prep.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/metis.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/kdtree2.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/nodalattr.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/subdomain.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/itpackv.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/owi_ice.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/boundaries.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/read_global.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/gwce.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/harm.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/netcdfio.o /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odir1/decomp.o -Lodir_metis -lmetis -L/apps/intel-2020/netcdf-4.7.2-parallel/lib -lnetcdf -lnetcdff
make[1]: Leaving directory `/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work'

mpiifort -c -mcmodel=medium -O -fPIC -assume realloc_lhs -m64  -threads -I/apps/intel-2020/intel-2020/compilers_and_libraries_2020.0.166/linux/mpi/intel64/include -I/apps/intel-2020/esmf-8.0.0/mod -I/apps/intel-2020/esmf-8.0.0/include -I/apps/intel-2020/netcdf-4.7.2-parallel/include -I/apps/intel-2020/pnetcdf-1.12.0/include  -DESMF_NO_INTEGER_1_BYTE -DESMF_NO_INTEGER_2_BYTE -DESMF_LAPACK=1 -DESMF_MOAB=1 -DESMF_NO_ACC_SOFTWARE_STACK=1 -DESMF_NETCDF=1 -DESMF_PNETCDF=1 -DESMF_YAMLCPP=1 -DESMF_YAML=1 -DESMF_PIO=1 -DESMF_MPIIO -DESMF_NO_OPENMP -DESMF_NO_OPENACC -DESMF_BOPT_O -DESMF_TESTCOMPTUNNEL -DSx86_64_small=1 -DESMF_OS_Linux=1 -DESMF_COMM=intelmpi -DESMF_DIR=/tmp/esmf -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odircp -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -I/apps/intel-2020/netcdf-4.7.2-parallel/include    -I/apps/intel-2020/hdf5-1.10.5-parallel/include    -L. -L/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC  -L/apps/intel-2020/netcdf-4.7.2-parallel/lib -L/apps/intel-2020/hdf5-1.10.5-parallel/lib -DWITHPETLISTS_on  -g  -traceback  -DESMF_VERSION_MAJOR=8 couple2swan_modif.F
couple2swan_modif.F(17): error #7002: Error in opening the compiled module file.  Check INCLUDE paths.   [SIZES]
      USE SIZES,  ONLY: SZ
----------^
couple2swan_modif.F(18): error #7002: Error in opening the compiled module file.  Check INCLUDE paths.   [WRITE_OUTPUT]
      USE WRITE_OUTPUT, ONLY : terminate
----------^
couple2swan_modif.F(19): error #7002: Error in opening the compiled module file.  Check INCLUDE paths.   [GLOBAL]
      USE GLOBAL, ONLY : DEBUG, ECHO, INFO, WARNING, ERROR,
----------^
couple2swan_modif.F(27): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ) ,ALLOCATABLE :: ADCIRC_SXX(:,:)
-----------^
couple2swan_modif.F(28): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ) ,ALLOCATABLE :: ADCIRC_SXY(:,:)
-----------^
couple2swan_modif.F(29): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ) ,ALLOCATABLE :: ADCIRC_SYY(:,:)
-----------^
couple2swan_modif.F(37): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ) :: InterpoWeight
-----------^
couple2swan_modif.F(50): error #7002: Error in opening the compiled module file.  Check INCLUDE paths.   [GLOBAL]
      USE GLOBAL, ONLY: NODECODE, NOFF, RSNX2, RSNY2
----------^
couple2swan_modif.F(51): error #7002: Error in opening the compiled module file.  Check INCLUDE paths.   [SIZES]
      USE SIZES, ONLY: SZ
----------^
couple2swan_modif.F(52): error #7002: Error in opening the compiled module file.  Check INCLUDE paths.   [MESH]
      USE MESH, ONLY : NE, NM, NP, X, Y, AREAS, NODELE, NEITABELE
----------^
couple2swan_modif.F(53): error #7002: Error in opening the compiled module file.  Check INCLUDE paths.   [BOUNDARIES]
      USE BOUNDARIES, ONLY : NBDV, NBOU, NBVV, NOPE, NVDLL, NVELL
----------^
couple2swan_modif.F(68): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ),ALLOCATABLE :: DSXXDX(:)
-----------^
couple2swan_modif.F(69): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ),ALLOCATABLE :: DSXYDY(:)
-----------^
couple2swan_modif.F(70): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ),ALLOCATABLE :: DSXYDX(:)
-----------^
couple2swan_modif.F(71): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ),ALLOCATABLE :: DSYYDY(:)
-----------^
couple2swan_modif.F(73): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ)             :: NCELE
-----------^
couple2swan_modif.F(75): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ),ALLOCATABLE :: TEMP_SXX(:)
-----------^
couple2swan_modif.F(76): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ),ALLOCATABLE :: TEMP_SXY(:)
-----------^
couple2swan_modif.F(77): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ),ALLOCATABLE :: TEMP_SYY(:)
-----------^
couple2swan_modif.F(79): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ) :: TOTALAREA
-----------^
couple2swan_modif.F(19): error #6580: Name in only-list does not exist or is not accessible.   [ERROR]
      USE GLOBAL, ONLY : DEBUG, ECHO, INFO, WARNING, ERROR,
-----------------------------------------------------^
couple2swan_modif.F(19): error #6580: Name in only-list does not exist or is not accessible.   [DEBUG]
      USE GLOBAL, ONLY : DEBUG, ECHO, INFO, WARNING, ERROR,
-------------------------^
couple2swan_modif.F(17): error #6580: Name in only-list does not exist or is not accessible.   [SZ]
      USE SIZES,  ONLY: SZ
------------------------^
couple2swan_modif.F(18): error #6580: Name in only-list does not exist or is not accessible.   [TERMINATE]
      USE WRITE_OUTPUT, ONLY : terminate
-------------------------------^
couple2swan_modif.F(19): error #6580: Name in only-list does not exist or is not accessible.   [ECHO]
      USE GLOBAL, ONLY : DEBUG, ECHO, INFO, WARNING, ERROR,
--------------------------------^
couple2swan_modif.F(19): error #6580: Name in only-list does not exist or is not accessible.   [INFO]
      USE GLOBAL, ONLY : DEBUG, ECHO, INFO, WARNING, ERROR,
--------------------------------------^
couple2swan_modif.F(19): error #6580: Name in only-list does not exist or is not accessible.   [WARNING]
      USE GLOBAL, ONLY : DEBUG, ECHO, INFO, WARNING, ERROR,
--------------------------------------------^
couple2swan_modif.F(20): error #6580: Name in only-list does not exist or is not accessible.   [SETMESSAGESOURCE]
     &          setMessageSource, unsetMessageSource, allMessage,
----------------^
couple2swan_modif.F(20): error #6580: Name in only-list does not exist or is not accessible.   [UNSETMESSAGESOURCE]
     &          setMessageSource, unsetMessageSource, allMessage,
----------------------------------^
couple2swan_modif.F(20): error #6580: Name in only-list does not exist or is not accessible.   [ALLMESSAGE]
     &          setMessageSource, unsetMessageSource, allMessage,
------------------------------------------------------^
/tmp/iforts3s7dE.i(276): catastrophic error: Too many errors, exiting
compilation aborted for couple2swan_modif.F (code 1)
make: *** [couple2swan_modif.o] Error 1
ifort -O3 -i4   -c -o estofs_tide_fac.o estofs_tide_fac.f
ifort -mkl    -o estofs_tide_fac estofs_tide_fac.o
rm -f estofs_tide_fac.o
echo No module selected. ; cd /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/thirdparty/nuopc ; exec make COMP_SRCDIR="/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC" COMP_BINDIR="/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC_INSTALL" MACHINE_ID="linux" -f makefile.adc_cap.nuopc nuopcinstall \
          DESTDIR=/ "INSTDIR=/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC_INSTALL"
No module selected.
make[1]: Entering directory `/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/thirdparty/nuopc'
makefile.adc_cap.nuopc:18: Environment variable ADCDIR was not set.
Setting to /work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC

mpiifort -c -mcmodel=medium -O -fPIC -assume realloc_lhs -m64  -threads -I/apps/intel-2020/intel-2020/compilers_and_libraries_2020.0.166/linux/mpi/intel64/include -I/apps/intel-2020/esmf-8.0.0/mod -I/apps/intel-2020/esmf-8.0.0/include -I/apps/intel-2020/netcdf-4.7.2-parallel/include -I/apps/intel-2020/pnetcdf-1.12.0/include  -DESMF_NO_INTEGER_1_BYTE -DESMF_NO_INTEGER_2_BYTE -DESMF_LAPACK=1 -DESMF_MOAB=1 -DESMF_NO_ACC_SOFTWARE_STACK=1 -DESMF_NETCDF=1 -DESMF_PNETCDF=1 -DESMF_YAMLCPP=1 -DESMF_YAML=1 -DESMF_PIO=1 -DESMF_MPIIO -DESMF_NO_OPENMP -DESMF_NO_OPENACC -DESMF_BOPT_O -DESMF_TESTCOMPTUNNEL -DSx86_64_small=1 -DESMF_OS_Linux=1 -DESMF_COMM=intelmpi -DESMF_DIR=/tmp/esmf -I. -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/odircp -I/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/prep -I/apps/intel-2020/netcdf-4.7.2-parallel/include    -I/apps/intel-2020/hdf5-1.10.5-parallel/include    -L. -L/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC  -L/apps/intel-2020/netcdf-4.7.2-parallel/lib -L/apps/intel-2020/hdf5-1.10.5-parallel/lib -DWITHPETLISTS_on  -g  -traceback  -DESMF_VERSION_MAJOR=8 couple2swan_modif.F
couple2swan_modif.F(17): error #7002: Error in opening the compiled module file.  Check INCLUDE paths.   [SIZES]
      USE SIZES,  ONLY: SZ
----------^
couple2swan_modif.F(18): error #7002: Error in opening the compiled module file.  Check INCLUDE paths.   [WRITE_OUTPUT]
      USE WRITE_OUTPUT, ONLY : terminate
----------^
couple2swan_modif.F(19): error #7002: Error in opening the compiled module file.  Check INCLUDE paths.   [GLOBAL]
      USE GLOBAL, ONLY : DEBUG, ECHO, INFO, WARNING, ERROR,
----------^
couple2swan_modif.F(27): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ) ,ALLOCATABLE :: ADCIRC_SXX(:,:)
-----------^
couple2swan_modif.F(28): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ) ,ALLOCATABLE :: ADCIRC_SXY(:,:)
-----------^
couple2swan_modif.F(29): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ) ,ALLOCATABLE :: ADCIRC_SYY(:,:)
-----------^
couple2swan_modif.F(37): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ) :: InterpoWeight
-----------^
couple2swan_modif.F(50): error #7002: Error in opening the compiled module file.  Check INCLUDE paths.   [GLOBAL]
      USE GLOBAL, ONLY: NODECODE, NOFF, RSNX2, RSNY2
----------^
couple2swan_modif.F(51): error #7002: Error in opening the compiled module file.  Check INCLUDE paths.   [SIZES]
      USE SIZES, ONLY: SZ
----------^
couple2swan_modif.F(52): error #7002: Error in opening the compiled module file.  Check INCLUDE paths.   [MESH]
      USE MESH, ONLY : NE, NM, NP, X, Y, AREAS, NODELE, NEITABELE
----------^
couple2swan_modif.F(53): error #7002: Error in opening the compiled module file.  Check INCLUDE paths.   [BOUNDARIES]
      USE BOUNDARIES, ONLY : NBDV, NBOU, NBVV, NOPE, NVDLL, NVELL
----------^
couple2swan_modif.F(68): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ),ALLOCATABLE :: DSXXDX(:)
-----------^
couple2swan_modif.F(69): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ),ALLOCATABLE :: DSXYDY(:)
-----------^
couple2swan_modif.F(70): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ),ALLOCATABLE :: DSXYDX(:)
-----------^
couple2swan_modif.F(71): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ),ALLOCATABLE :: DSYYDY(:)
-----------^
couple2swan_modif.F(73): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ)             :: NCELE
-----------^
couple2swan_modif.F(75): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ),ALLOCATABLE :: TEMP_SXX(:)
-----------^
couple2swan_modif.F(76): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ),ALLOCATABLE :: TEMP_SXY(:)
-----------^
couple2swan_modif.F(77): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ),ALLOCATABLE :: TEMP_SYY(:)
-----------^
couple2swan_modif.F(79): error #6683: A kind type parameter must be a compile-time constant.   [SZ]
      REAL(SZ) :: TOTALAREA
-----------^
couple2swan_modif.F(19): error #6580: Name in only-list does not exist or is not accessible.   [ERROR]
      USE GLOBAL, ONLY : DEBUG, ECHO, INFO, WARNING, ERROR,
-----------------------------------------------------^
couple2swan_modif.F(19): error #6580: Name in only-list does not exist or is not accessible.   [DEBUG]
      USE GLOBAL, ONLY : DEBUG, ECHO, INFO, WARNING, ERROR,
-------------------------^
couple2swan_modif.F(17): error #6580: Name in only-list does not exist or is not accessible.   [SZ]
      USE SIZES,  ONLY: SZ
------------------------^
couple2swan_modif.F(18): error #6580: Name in only-list does not exist or is not accessible.   [TERMINATE]
      USE WRITE_OUTPUT, ONLY : terminate
-------------------------------^
couple2swan_modif.F(19): error #6580: Name in only-list does not exist or is not accessible.   [ECHO]
      USE GLOBAL, ONLY : DEBUG, ECHO, INFO, WARNING, ERROR,
--------------------------------^
couple2swan_modif.F(19): error #6580: Name in only-list does not exist or is not accessible.   [INFO]
      USE GLOBAL, ONLY : DEBUG, ECHO, INFO, WARNING, ERROR,
--------------------------------------^
couple2swan_modif.F(19): error #6580: Name in only-list does not exist or is not accessible.   [WARNING]
      USE GLOBAL, ONLY : DEBUG, ECHO, INFO, WARNING, ERROR,
--------------------------------------------^
couple2swan_modif.F(20): error #6580: Name in only-list does not exist or is not accessible.   [SETMESSAGESOURCE]
     &          setMessageSource, unsetMessageSource, allMessage,
----------------^
couple2swan_modif.F(20): error #6580: Name in only-list does not exist or is not accessible.   [UNSETMESSAGESOURCE]
     &          setMessageSource, unsetMessageSource, allMessage,
----------------------------------^
couple2swan_modif.F(20): error #6580: Name in only-list does not exist or is not accessible.   [ALLMESSAGE]
     &          setMessageSource, unsetMessageSource, allMessage,
------------------------------------------------------^
/tmp/ifortYBczew.i(276): catastrophic error: Too many errors, exiting
compilation aborted for couple2swan_modif.F (code 1)
make[1]: *** [couple2swan_modif.o] Error 1
make[1]: Leaving directory `/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC/thirdparty/nuopc'
make: *** [/work/noaa/nosofs/zburnett/repositories/ADC-WW3-NWM-NEMS/ADCIRC_INSTALL/adcirc.mk] Error 2

`MPI` errors on Hera

in the feature/pahm branch:
/scratch2/COASTAL/coastal/save/shared/working/takis/shinnecock-pahm-tests-hera/sandy-atmesh-adcirc/spinup/ADCIRC_COLDSTART_SPINUP.err.log

 TIME STEP =  302400  57.14% COMPLETE     ITERATIONS =   10     TIME =  0.60480000E+06
  ELMAX =  4.2272E-001 AT NODE       17  SPEEDMAX =  8.2982E-001 AT NODE        1  ON MYPROC =    0
INFO: setRecordCounterAndStoreTime: Overwriting pre-existing data in netcdf file ./fort.63.nc for time=  604800.00000000. Subsequent data in netcdf file remain unchanged.
 MPI terminated with Status =            0

/scratch2/COASTAL/coastal/save/shared/working/takis/shinnecock-pahm-tests-hera/sandy-atmesh-adcirc/spinup/ADCIRC_COLDSTART_SPINUP.err.log

Attempting to use an MPI routine after finalizing MPI
Attempting to use an MPI routine after finalizing MPI
Attempting to use an MPI routine after finalizing MPI
Attempting to use an MPI routine after finalizing MPI
Attempting to use an MPI routine after finalizing MPI
Attempting to use an MPI routine after finalizing MPI
Attempting to use an MPI routine after finalizing MPI
Attempting to use an MPI routine after finalizing MPI
Attempting to use an MPI routine after finalizing MPI
Attempting to use an MPI routine after finalizing MPI
Attempting to use an MPI routine after finalizing MPI
srun: error: h17c45: tasks 0-10: Exited with exit code 1
srun: launch/slurm: _step_signal: Terminating StepId=20246935.0

Current/latest Application clone

Hi Zach,

Please confirm with this:
git clone https://github.com/noaa-ocs-modeling/ADC-WW3-NWM-NEMS.git -b feature/adcirc_v55 --recurse-submodules

you can get the latest application code with all your recent changes.

Thanks,
-Saeed

@zacharyburnettNOAA @pvelissariou1 @saeed-moghimi-noaa

HPC stack compliance

Allow CMake options for SCHISM compilation

SCHISM makes use of CMake options, among them

USE_FABM=ON
FABM_BASE=/path/to/fabm
USE_SED=ON
-DPREC_EVAP=ON

and many more. These are usually user-set as the requirements differ between users. How can this be incorporated into component_SCHISM.mk?

`libesmf` error

when running NEMS.x built from master on Hera,

/scratch2/COASTAL/coastal/save/shared/working/zach/nems_adcirc/run_20210623_hsofs_120m_subsetflo_besttrack_florence

the following error occurs on spinup:

spinup/ADCIRC_SPINUP.err.log

forrtl: severe (174): SIGSEGV, segmentation fault occurred
Image              PC                Routine            Line        Source
NEMS.x             0000000000841EFD  Unknown               Unknown  Unknown
libpthread-2.17.s  00002B3E035BC630  Unknown               Unknown  Unknown
NEMS.x             0000000000760565  write_output_mp_w        1568  write_output.F
NEMS.x             0000000000632D55  adcirc_mod_mp_adc         434  adcirc.F
NEMS.x             00000000005450F2  adc_cap_mp_modela        1346  adc_cap.F90
libesmf.so         00002B3E051672AC  _ZN5ESMCI13Method         392  ESMCI_MethodTable.C
libesmf.so         00002B3E051688A4  _ZN5ESMCI11Method         654  ESMCI_MethodTable.C
libesmf.so         00002B3E05166C21  c_esmc_methodtabl         308  ESMCI_MethodTable.C
libesmf.so         00002B3E0556BD8C  esmf_attachmethod        1284  ESMF_AttachMethods.F90
libesmf.so         00002B3E06C8C5DC  Unknown               Unknown  Unknown
libesmf.so         00002B3E04DB1763  _ZN5ESMCI6FTable1        2009  ESMCI_FTable.C
libesmf.so         00002B3E04DAD124  ESMCI_FTableCallE         747  ESMCI_FTable.C
libesmf.so         00002B3E05298338  _ZN5ESMCI3VMK5ent        2022  ESMCI_VMKernel.C
libesmf.so         00002B3E0527EEE2  _ZN5ESMCI2VM5ente        1208  ESMCI_VM.C
libesmf.so         00002B3E04DAD80D  c_esmc_ftablecall         899  ESMCI_FTable.C
libesmf.so         00002B3E0589F78B  esmf_compmod_mp_e        1209  ESMF_Comp.F90
libesmf.so         00002B3E06185E45  esmf_gridcompmod_        1889  ESMF_GridComp.F90
libesmf.so         00002B3E06BC04E4  nuopc_driver_mp_r        3187  NUOPC_Driver.F90
libesmf.so         00002B3E06BC76F2  nuopc_driver_mp_e        3457  NUOPC_Driver.F90
libesmf.so         00002B3E051672AC  _ZN5ESMCI13Method         392  ESMCI_MethodTable.C
libesmf.so         00002B3E051688A4  _ZN5ESMCI11Method         654  ESMCI_MethodTable.C
libesmf.so         00002B3E05166C21  c_esmc_methodtabl         308  ESMCI_MethodTable.C
libesmf.so         00002B3E0556BD8C  esmf_attachmethod        1284  ESMF_AttachMethods.F90
libesmf.so         00002B3E06BBE2E7  nuopc_driver_mp_r        3108  NUOPC_Driver.F90
libesmf.so         00002B3E04DB1763  _ZN5ESMCI6FTable1        2009  ESMCI_FTable.C
libesmf.so         00002B3E04DAD124  ESMCI_FTableCallE         747  ESMCI_FTable.C
libesmf.so         00002B3E05298338  _ZN5ESMCI3VMK5ent        2022  ESMCI_VMKernel.C
libesmf.so         00002B3E0527EEE2  _ZN5ESMCI2VM5ente        1208  ESMCI_VM.C
libesmf.so         00002B3E04DAD80D  c_esmc_ftablecall         899  ESMCI_FTable.C
libesmf.so         00002B3E0589F78B  esmf_compmod_mp_e        1209  ESMF_Comp.F90
libesmf.so         00002B3E06185E45  esmf_gridcompmod_        1889  ESMF_GridComp.F90
NEMS.x             00000000004FB0B3  Unknown               Unknown  Unknown
libesmf.so         00002B3E04DB1763  _ZN5ESMCI6FTable1        2009  ESMCI_FTable.C
libesmf.so         00002B3E04DAD124  ESMCI_FTableCallE         747  ESMCI_FTable.C
libesmf.so         00002B3E05298338  _ZN5ESMCI3VMK5ent        2022  ESMCI_VMKernel.C
libesmf.so         00002B3E0527EEE2  _ZN5ESMCI2VM5ente        1208  ESMCI_VM.C
libesmf.so         00002B3E04DAD80D  c_esmc_ftablecall         899  ESMCI_FTable.C
libesmf.so         00002B3E0589F78B  esmf_compmod_mp_e        1209  ESMF_Comp.F90
libesmf.so         00002B3E06185E45  esmf_gridcompmod_        1889  ESMF_GridComp.F90
NEMS.x             0000000000416007  Unknown               Unknown  Unknown
NEMS.x             0000000000413A1E  Unknown               Unknown  Unknown
libc-2.17.so       00002B3E0BD09555  __libc_start_main     Unknown  Unknown
NEMS.x             0000000000413929  Unknown               Unknown  Unknown
srun: error: h15c03: task 0: Exited with exit code 174
srun: launch/slurm: _step_signal: Terminating StepId=20072978.0
slurmstepd: error: *** STEP 20072978.0 ON h15c03 CANCELLED AT 2021-06-24T13:47:33 ***
...
...
...
srun: error: h15c32: tasks 240-279: Exited with exit code 1
srun: error: h15c20: tasks 160-199: Exited with exit code 1
srun: error: h15c44: tasks 400-439: Exited with exit code 1
srun: error: h15c03: tasks 1-39: Exited with exit code 1
srun: error: h21c18: tasks 560-599: Exited with exit code 1
srun: error: h15c48: tasks 480-519: Exited with exit code 1
srun: error: h15c15: tasks 80-119: Exited with exit code 1
srun: error: h15c06: tasks 40-79: Exited with exit code 1
srun: error: h15c30: tasks 200-239: Exited with exit code 1
srun: error: h15c45: tasks 440-479: Exited with exit code 1
srun: error: h15c34: tasks 280-319: Exited with exit code 1
srun: error: h21c15: tasks 520-559: Exited with exit code 1
srun: error: h15c41: tasks 320-359: Exited with exit code 1
srun: error: h15c42: tasks 360-399: Exited with exit code 1
srun: error: h15c19: tasks 120-159: Exited with exit code 1