I had a lot of issues dispatching parallel scan jobs from a Jupyter/IJulia notebook (although single parameter set runs in a notebook worked fine). This occasionally seemed to work, but generally didn't, and usually crashed out after spawning workers.
As a quick work-around, I wrote a basic job dispatch notebook instead, which basically writes a job script to file then launches the parallel execution via a shell script. In case it's of interest/use to anyone else, it's now at https://github.com/phockett/Luna.jl-jupyterDispatch.
I had a lot of issues dispatching parallel scan jobs from a Jupyter/IJulia notebook (although single parameter set runs in a notebook worked fine). This occasionally seemed to work, but generally didn't, and usually crashed out after spawning workers.
As a quick work-around, I wrote a basic job dispatch notebook instead, which basically writes a job script to file then launches the parallel execution via a shell script. In case it's of interest/use to anyone else, it's now at https://github.com/phockett/Luna.jl-jupyterDispatch.