xtreme-d / docker-slurm-cluster

Simple Slurm cluster in docker.

docker-slurm-cluster

This is a demonstration of how the Slurm could be deployed in the docker infrastructure using docker compose.

It consist of the following services:

• MariaDB (for accounting data)
• head node (munge, slurmd, slurmctld, slurmdbd)
• compute node x4 (munge, slurmd)

The slurm version is v21.08.8-2

How to deploy

Clone the repository

git clone [email protected]:xtreme-d/docker-slurm-cluster.git docker-slurm-cluster
cd docker-slurm-cluster

Next, build the node image.

docker-compose build

Start the cluster

docker-compose up -d

To access the head node:

docker exec -it axc-headnode bash

NOTE: the first running of Slurm might take up to 1 minute because a new MariaDB database initiation procedure is slow a bit.

docker-slurm-cluster's Issues

[SOLVED] Can't create query on database for Slurm in MariaDB Container

Hi, trying to select on tables in slurm_acct_db i can create query from the tables and get the correct output.

But some tables have this format axc-docker-cluster_something_something and on this tables i recive error

see the following output when i try to do select * from axc-docker-cluster_assoc_table:

ERROR 1064 (42000): You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near '-docker-cluster_assoc_table' at line 1

I think that the problem is this caracter (-) on MySQL.

[SOLVED] SBatch dont generate output file

I do sbatch on a basic script

#!/bin/bash
#SBATCH --job-name=JOB_ID_NAME
#SBATCH --ntasks=4
#SBATCH --output=/test.out

echo a

Work appears as COMPLETED but can't find the output file anywhere

[SOLVED] QUESTION: How works prefix-log.sh?

Hi all,

I just want to know and undestand what does this wrapper (prefix-log.sh)

[SOLVED] Init database process run infinitely

Hi, i see on supervisorctl status that init database process run infinitely, but if i just do docker-compose up -d without modify anything its works, i really dont undestand that and need some help

[SOLVED] QUESTION: If i wanna to make persistent the log files and not stdout?

I have to make changes on supervisor and conf files or just conf files are okay?

[SOLVED] Slurmctld slurmd and slurmdbd STATUS FATAL

Hi, I try the new version for the cluster and status for slurm processes are FATAL on alll nodes, sure some parameters on Slurm conf change from 20.02.7. Instead init process run infinetly

╭─m0rfeo@matrix ~/test/docker-slurm-cluster ‹master›
╰─➤ docker exec axc-headnode supervisorctl status
munged RUNNING pid 37, uptime 0:29:04
slurmctld FATAL Exited too quickly (process log may have details)
slurmd FATAL Exited too quickly (process log may have details)
slurmdbd FATAL Exited too quickly (process log may have details)
slurmdbd_init__oneshot RUNNING pid 893, uptime 0:00:05

[SOLVED] What happens on init_slurm_db

Hello, in docker-entrypoint.sh to init slurm db the script exec this line:

IS_DATABASE_EXIST="`mysql -h $MARIADB_HOST -u root -p"$MARIADB_ROOT_PASSWORD" -qfsBe "select count(*) as c from information_schema.schemata where schema_name='$MARIADB_DATABASE'" -H | sed -E 's/c|<[^>]+>//g>

What are happening on this part?

select count(*) as c from information_schema.schemata where schema_name='$MARIADB_DATABASE'" -H | sed -E 's/c|<[^>]+>//g>

[SOLVED] SLURM 20.02.7 NOT AVAILABLE!

Slurm 20.02.7 not available on https://download.schedmd.com/slurm/ for a security issue. Anyone have the source, wget dont work

Slurmctld, slurmd and slurmdbd service is FATAL.

I installed the docker-slurm-cluster on centOS 7.9 with ARM architecture server. Everything is fine until the docker-compose up -d command is executed. After I exec the "docker exec -it axc-headnode bash" command, there are five warnings:
bash: warning: setlocale: LC_CTYPE: cannot change locale (en_US.UTF-8): No such file or directory bash: warning: setlocale: LC_COLLATE: cannot change locale (en_US.UTF-8): No such file or directory bash: warning: setlocale: LC_MESSAGES: cannot change locale (en_US.UTF-8): No such file or directory bash: warning: setlocale: LC_NUMERIC: cannot change locale (en_US.UTF-8): No such file or directory bash: warning: setlocale: LC_TIME: cannot change locale (en_US.UTF-8): No such file or directory
and I discover the slurmctld service is not running with "supervisorctl status" command:
munged RUNNING pid 37, uptime 13:37:47 slurmctld FATAL Exited too quickly (process log may have details) slurmd FATAL Exited too quickly (process log may have details) slurmdbd FATAL Exited too quickly (process log may have details) slurmdbd_init__oneshot RUNNING pid 22461, uptime 0:00:04

What's the problem? Thanks in advance.