jwaiton / noether_notebooks

A simple setup for how to run jupyter notebooks on the noether cluster. Requires some alterations for those outside the NEXT collaboration

Put .sh file in your scripts/bin directory

Put .sub file in your scripts/etc directory

• Alter the .sh file to point to your relevant notebook directory, and enable a conda environment that can run jupyter lab (in our case we use config_ic.sh to do so).
• Alter the resources as needed within the .sub
• Create the appropriate output files described in the .sub file if you wish to see any output.
• Port (PORT) by default is set to 4202, change this in the .sh file as needed

Do all these steps within the same terminal:

1. Forward an ssh connection from your local node to the head node: ssh -gL PORT:localhost:PORT [email protected]
2. Submit your jupyter notebook job as a normal batch job after you are happy with its settings. cd scripts condor_submit etc/jupyter.sub
3. Once the job has started, find the job ID (JOB_ID) name with condor_q
4. Create a forwarding connection from the job node to the head node: condor_ssh_to_job -ssh "ssh -gL PORT:localhost:PORT" JOB_ID
5. You can now connect to a jupyterlab session locally by typing in your browser: localhost:PORT

Make sure to kill your notebooks after use! Do so with condor_rm JOB_ID