Sparkmonitor failure for kernel restart - java.net.SocketException: Broken pipe (Write failed) about sparkmonitor

[rahul26goyal]

@creepysta : Even with the additional sleep(), are you still seeing the exception or its solved completely?

[creepysta]

@creepysta : Even with the additional sleep(), are you still seeing the exception or its solved completely?

The sleep() seems to have solved the cases where the sparkmonitor intermittently won't show up even -

• with a new notebook start, and
• with manually restarting the kernel from a running notebook.

But it doesn't solve the scenario when the JEG restarts the kernel.

notebook - Classic Jupyter notebook
kernel - (here referring) spark driver pod (kernel)
JEG - Jupyter Enterprise Gateway