The export of Chinese data become messy code

[CharlesLdy]

Kibana version: 4.5.4

I export the chinese data by the raw or formatted link. but the chinese become messy code.

[Bargs]

Could you provide an example data set or steps to reproduce?

[CharlesLdy]

@Bargs Thanks for your attention.

1. at first I got the data set with kibana.
   
2. second I export the data to csv by raw link or formatted link
   
3. then open the csv file, the result is like the picture below
   

[Bargs]

@LeeDr you looked into an issue like this before right? Didn't it end up being an issue with the encoding format excel tried by default or something like that?

[LeeDr]

Here's my note from https://discuss.elastic.co/t/resolved-korean-text-is-broken-when-open-the-exported-csv-with-excel/53436/4

Instead of just clicking the csv to open with Excel,
open Excel and use Data > Get External Data > From File and check that the
File origin is 65001: Unicode (UTF-8)

[CharlesLdy]

@LeeDr @Bargs
It works by this way. But I don't know how it works, and I think the others maybe encounter this kind of problem. Is there a better way to export the Unicode data?

No matter what ,thanks a lot for your help

[Bargs]

I don't have excel myself but from some quick googling it doesn't seem like excel handles any Unicode format well. http://stackoverflow.com/questions/6588068/which-encoding-opens-csv-files-correctly-with-excel-on-both-mac-and-windows

If you can find a format that works well though, we'd be happy to look into implementing it. Otherwise, perhaps we could st least add some help text with Lee's instructions on importing.

[LeeDr]

Here's an article with a lot of comments describing that if you put a UTF8 Byte-Order Mark (BOM) of \uFEFF at the very beginning of the CSV some versions of Excel will open it properly. There's a lot of back and forth in the comments about it working or not working on various versions of Excel, or it needing to be tab-separated instead of comma.

https://stackoverflow.com/questions/6002256/is-it-possible-to-force-excel-recognize-utf-8-csv-files-automatically

I did some testing and think we should be adding the BOM when we write CSV export files from Kibana. I created this new issue so I'll close this one;
#8637

[Bargs]

Awesome detail, thanks @LeeDr