eth-cscs / spack-stack

fast spack builds on slow filesystem

Building for MCH

This stack is specific to MCH

status

Current Version: v4

building

mkdir /dev/shm/mch-build
cd /dev/shm/mch-build

git clone [email protected]:eth-cscs/spack-stack.git
cd spack-stack

# TODO: update configuration before running configure.sh
./configure.sh
env --ignore-environment PATH=/usr/bin:/bin:`pwd`/spack/bin make modules -j64
env --ignore-environment PATH=/usr/bin:/bin:`pwd`/spack/bin make store.squashfs

# make a copy of the new image, e.g.
mv store.squashfs $SCRATCH/balfrin-<tag>.squashfs

spack-stack's Issues

Fix `spack compiler add <prefix>`

Currently spack compiler add <prefix> doesn't detect NVHPC when you give it spack find --format '{prefix}' nvhpc.

Open Spack issues

• This project uses spack -e my_env env depfile to generate Makefiles, which generates commands of the form spack -e my_env install --no-add /hash. The issues is that this causes all specs to be installed "explicitly" instead of just the top-level ones in the environment, which is a bit annoying when generating module files just for the explicitly installed specs.
• Sometimes there's timeouts during spack install waiting for a write lock to the database.
• OpenMPI libraries are missing rpaths to locate libpmi when slurm is external in /usr/lib64.

Fixes in

• spack/spack#31646
• spack/spack#31645
• spack/spack#31643
• spack/spack#31715

Add `compilers.yaml` and `upstreams.yaml` inside `$(STORE)`

Autogenerate compilers & upstreams config and put it in the $(STORE)

staging eccodes fails

Fix in spack/spack#31618:

git fetch https://github.com/spack/spack.git pull/31618/head && git merge FETCH_HEAD