Skip to content

A library for reading and writing streams of delimited binary data (blobs)

License

Notifications You must be signed in to change notification settings

sdotz/delimitedbuffer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

delimitedbuffer

A library to read and write streams of delimited blobs, as described in: https://developers.google.com/protocol-buffers/docs/techniques#streaming Can be used for protocol buffer binaries, or any other data. Blobs are preceeded by their 4-byte size (max 4294967295 bytes)

Embeds bytes.Buffer and implements the common interfaces to support chained readers/writers to handle one full datum at a time.

Ideas/Future plans

  • Option to write a header before every datum
    • Checksum for the datum
    • Content encoding (gzip etc)
    • Byte-size of the datum to follow contained in header

About

A library for reading and writing streams of delimited binary data (blobs)

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages