Skip to content

Pipe nodejs streams into an async.queue for parallelisation, get backpressure when the queue is full.

License

Notifications You must be signed in to change notification settings

r-k-b/backpressure-queue

Repository files navigation

backpressure-queue

Node.js CI

Returns a Writable ObjectMode Stream that allows a certain number of simultaneous promises, and triggers stream backpressure when the concurrency limit is hit.

Errors are swallowed.

The return value of doWork() is ignored, and cannot be retrieved.

Usage:

async function foo(someItem) {
  console.log('work done on ' + someItem)
  return
}

const w = writableQueue({doWork: foo, limitConcurrent: 2})

someSourceStream.pipe(w)

About

Pipe nodejs streams into an async.queue for parallelisation, get backpressure when the queue is full.

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Contributors 4

  •  
  •  
  •  
  •