gronnbeck / workerpool

Simple workerpool library in go

workerpool

workerpool is a simple worker pool library written for go.

Examples

Wait for all work to complete

func main() {
  pool := workerpool.New(1000)
  pool.Start()
  work := 10
  res := make(chan error)

  doWork := func() error {
    return nil
  }

  go func() {
    for i:=0; i < work; i++ {
      ctx := context.Background()
      pool.Queue(ctx, func() {
        res <- doWork() // some function that does work
      })
    }
  }()


  for i := i < work; i ++ {
    select {
    case err := <-res:
      if err != nil {
        // handle error here or
        panic(err)
      }
    }
  }
}

workerpool's Issues

Stop() doesn't stop all workers

The Stop() function only stops one of the workers. Make sure to stop all of them by sending in pool.exit <- true for all running workers. Remember to add timeout for Stop(). And timeouts with checks can be added in Start() to make sure we don't have dangling go routines.

It's possible to start workerpool multiple times

As of 3e1d77c you can start workerpool as many time as you like. This will cause the number of workers to grow. Add something to avoid that.