Coder Social home page Coder Social logo

Comments (3)

IanButterworth avatar IanButterworth commented on June 10, 2024

Actually, this was #93


I can't understand why we're seeing

Warning: rmprocs: process 1 not removed

because it's coming from

atexit(terminate_all_workers)

Distributed.jl/src/cluster.jl

Lines 1246 to 1251 in 8c03305

function terminate_all_workers()
myid() != 1 && return
if nprocs() > 1
try
rmprocs(workers(); waitfor=5.0)

function workers()
allp = procs()
if length(allp) == 1
allp
else
filter(x -> x != 1, allp)
end
end

Distributed.jl/src/cluster.jl

Lines 1043 to 1049 in 8c03305

function _rmprocs(pids, waitfor)
lock(worker_lock)
try
rmprocset = Union{LocalProcess, Worker}[]
for p in pids
if p == 1
@warn "rmprocs: process 1 not removed"

And I don't understand how it's possible for nprocs() > 1 and workers() to contain 1

from distributed.jl.

IanButterworth avatar IanButterworth commented on June 10, 2024

I dont think this is happening because of

atexit(terminate_all_workers)

because we don't see this log
@warn "Forcibly interrupting busy workers" exception=_ex

from distributed.jl.

IanButterworth avatar IanButterworth commented on June 10, 2024

I believe this is coming from this test which swallows the log

@test_logs (:warn, r"sending SIGTERM") begin
remote_do(w) do
# Cause the 'exit()' message that `rmprocs()` sends to do nothing
Core.eval(Base, :(exit() = nothing))
end
wait(rmprocs([w]))
end

from distributed.jl.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.