Skip to content

Batch items written to a channel and have multiple workers process those from a channel

Notifications You must be signed in to change notification settings

chrisgoffinet/batch-worker

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 

Repository files navigation

Batch Worker

This simple go program will create [N] workers, add integers to a channel, batch those integers until reaching batchSize then process() the work.

I wrote this for cases where you might want to batch units of work when using an iterator without making the code complex. The real world example I used it for was when processing data and wanted to batch up my Solr documents into the /update endpoint.

About

Batch items written to a channel and have multiple workers process those from a channel

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages