utf-8 bom causes first column value to be corrupted

[matt-blanchette]

UTF8 files starting with BOM cause parsed csv data to be broken for the first value.

If the first row contains column names,
then the first column becomes unusable to lookup by name.

Either a code change to strip a possible BOM as the first character or a documentation update would be helpful.

[ajmas]

I am observing this in version 2.3.0. In my case the first column should be 'Type', but it is coming out as '<U+FEFF>Type'.

We should probably add some code to handle all the common scenarios, as described here:

https://en.wikipedia.org/wiki/Byte_order_mark

[matt-blanchette]

I've used the strip-bom-stream module for now to handle this.

fs.createReadStream(fileName)
    .pipe( stripBomStream() )
    .pipe( csv(options) )

[pietercolpaert]

Should this fix be added to the repo or should we always use stripBomStream?

[dustinsmith1024]

2.3.1 is published with the fix.