hongkunyoo / jupyterflow

Run workflow on JupyterHub

커피고래

• 술 좋아하면 술고래, 커피 좋아하면 커피고래!
• 안녕하세요, ML, 컨테이너 기술에 관심이 많으며 현재 쿠버네티스를 이용하여 기계학습 플랫폼을 구축하는 MLOps 엔지니어로 일하고 있습니다.

I'm interested in

• Kubernetes
• Cloud Computing
• Machine Learning

More about me

• Blog: coffeewhale.com
• AboutMe: coffeewhale.com/about

jupyterflow's Issues

Question: Storage Class need

First of all thanks for the project as it looks really useful!

Am I right in understanding that jupyter pod would need a shared storage? with RWX mode?

Default Storageclass is needed as a prerequisite

First of all, Thanks a lot for maintaining such a nice repo!!

I've been followed the guide with "Set up on JupyterHub", I found there needs one more prerequisite : "Setup Default Storageclass before helm install jupyterhub"

Otherwise, the deployment "hub" in jupyterflow namespace will at PENDING status forever, as well as the corresponding pvc "hub-db-dir"

I think it is not the jupyterflow's mistake, but the jupyterhub's mistake, There is an issue on here which says the prerequisite about default storageclass is needed on docs.

But, As a matter of jupyterflow uses the jupyterhub, I think the prerequisite of default storageclass should be commented in the "Setup guide" for jupyterflow.

please come present at Argo community meeting

Help running ML Example

Hi, Thank you so much for maintaining this awesome repository. I am having some problems trying to run ML example on a local Kubernetes cluster. My setup is:

• OS: Windows 10 with WSL2

I managed to setup JupyterHub locally and install JupyterFlow. Basic example is working fine, I have installed tensorflow and keras using the requirements.txt in JupyterHub and managed to run the individual .py files from the notebook with %run input.py but when I submit the workflow to Argo I get

Traceback (most recent call last): File "/home/jovyan/jupyterflow/examples/ml-pipeline/input.py", line 1, in <module> from keras.datasets import mnist ModuleNotFoundError: No module named 'keras'

I am working on forking your excellent work to look into if I can extend it to be able to provide the volumes I want to mount in argo for each step during runtime.

Thanks in advance for your help :)