logicalparadox / co-semaphore Goto Github PK

I'm using co-semphore to do a very large number of tasks, and have adapted it from the example in the README. Is it possible to use co-semaphore without having to prepare the entire array first? I'm doing for (var i of tasks()) where tasks() is a generator that generates potentially a huge number of results. But following the example usage of co-semphore I iterate through tasks() and add it to an array res, which then gets yielded.

But is it possible use it in such a way that I don't need to prepare the whole array first, which would be inefficient in cases where the generator generates a huge number of results. A web crawler for example, where things are added to the queue during operation and aren't known up front.

  var res = [];
  for (var i of tasks()) {
     res.push(operation(i, lock));
  }
  console.log(res.length);
  console.log('res', yield res);