Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve support for non-UTF encodings #26

Open
funkrusher opened this issue Dec 9, 2019 · 2 comments
Open

Improve support for non-UTF encodings #26

funkrusher opened this issue Dec 9, 2019 · 2 comments
Labels
enhancement New feature or request

Comments

@funkrusher
Copy link

I tried to import a TXT-File that has "ANSI"-Encoding and the import does not import the file correctly.

I have an example-file here, that can be tested. The file is here in two versions:

  1. before-import.txt
  2. after-import.txt

The importer changes the "ANSI"-Encoding to "UTF8" but does not convert the special chars along the way. For example: Windows Notepad can convert this ansi-file without problems to utf8 without lossing the chars.

before-import.txt
after-import.txt

@fabiospampinato fabiospampinato changed the title Import can not cope with files different than UTF8 Improve support for non-UTF encodings Dec 11, 2019
@fabiospampinato fabiospampinato transferred this issue from notable/notable Dec 11, 2019
@fabiospampinato fabiospampinato added the enhancement New feature or request label Dec 11, 2019
@fabiospampinato
Copy link
Member

I think eventually we should use an encoding detector (maybe this) and then an encoding converter ( maybe this, but it's a native dependency and using it in the browser may be a problem).

@fabiospampinato
Copy link
Member

For future reference:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Development

No branches or pull requests

2 participants