Building Laghos on Crusher about laghos

[vladotomov]

Hi @wyphan, sorry for the late reply. Do you still need help with this?

[wyphan]

Yes, please, it will be used for Crusher at ORNL.

[v-dobrev]

For a parallel HIP build of MFEM on Crusher, you can try using "MFEM_BUILD=phip HIP_ARCH=gfx90a".

[vladotomov]

@wyphan, did Veselin's suggestion help? Can we close this issue?

[wyphan]

@vladotomov sorry for the late reply. When I tried to build, looks like the URL for METIS in the Makefile is dead?

[vladotomov]

@wyphan the link to METIS has been updated.

[wyphan]

Thanks for the fix. METIS 4.0.3 builds fine with PrgEnv-amd and amd/5.2.0, but not with 5.3.0 or newer. For reference, the current default ROCm version on Crusher is 5.3.0. The error messages have to do with the GKfree macro:

make[3]: Entering directory '/autofs/nccs-svm1_home1/wyphan/work/hpctoolkit-tutorial-examples/examples/gpu/laghos/laghos/metis-4.0.3/Lib'
make[3]: warning: jobserver unavailable: using -j1.  Add '+' to parent make rule.
cc  -O2 -I. -c coarsen.c
cc  -O2 -I. -c fm.c
cc  -O2 -I. -c initpart.c
initpart.c:199:3: error: call to undeclared function '__GKfree'; ISO C99 and later do not support implicit function declarations [-Wimplicit-function-declaration]
  GKfree(&bestwhere, &queue, &touched, LTERM);
  ^
./rename.h:380:19: note: expanded from macro 'GKfree'
#define GKfree                          __GKfree
                                        ^
initpart.c:337:3: error: call to undeclared function '__GKfree'; ISO C99 and later do not support implicit function declarations [-Wimplicit-function-declaration]
  GKfree(&bestwhere, &queue, &touched, LTERM);
  ^
./rename.h:380:19: note: expanded from macro 'GKfree'
#define GKfree                          __GKfree
                                        ^
initpart.c:417:3: error: call to undeclared function '__GKfree'; ISO C99 and later do not support implicit function declarations [-Wimplicit-function-declaration]
  GKfree(&bestwhere, &perm, LTERM);
  ^
./rename.h:380:19: note: expanded from macro 'GKfree'
#define GKfree                          __GKfree
                                        ^
3 errors generated.
make[3]: *** [Makefile:21: initpart.o] Error 1
make[3]: Leaving directory '/autofs/nccs-svm1_home1/wyphan/work/hpctoolkit-tutorial-examples/examples/gpu/laghos/laghos/metis-4.0.3/Lib'
make[2]: *** [Makefile:4: default] Error 2
make[2]: Leaving directory '/autofs/nccs-svm1_home1/wyphan/work/hpctoolkit-tutorial-examples/examples/gpu/laghos/laghos/metis-4.0.3'
make[1]: *** [makefile:267: metis] Error 2
make[1]: Leaving directory '/autofs/nccs-svm1_home1/wyphan/work/hpctoolkit-tutorial-examples/examples/gpu/laghos/laghos/Laghos'
make[1]: Entering directory '/autofs/nccs-svm1_home1/wyphan/work/hpctoolkit-tutorial-examples/examples/gpu/laghos/laghos/Laghos'
makefile:132: *** The MFEM library is not built.  Stop.
make[1]: Leaving directory '/autofs/nccs-svm1_home1/wyphan/work/hpctoolkit-tutorial-examples/examples/gpu/laghos/laghos/Laghos'

[v-dobrev]

You can add the flag -std=c89 to fix this.

[wyphan]

Perfect! Now Laghos builds cleanly on Crusher. Thanks a lot!