[BUG] [Formatter]This breaks when formatting a django template with Japanese characters in UTF-8.

[Taikono-Himazin]

Running the following command produces corrupted output.

echo "{% if field.field.required %}\n<span span class=\"badge badge-danger\">{{ required | default:'必須' }}</span>\n{% endif %}" | djlint - --reformatmat

output

{% if field.field.required %}\n<span span class=\ badge badge-danger\>{{ required | default:'??' }}</span>\n{% endif %}

Do you only deal with ascii characters in djlint?
I noticed that when using djlint-vscode with vscode, I get corrupted output.
When I tried the above command, djlint gave corrupted output.

Below is my environment.

• OS -Windows 10 Japanese
• Python 3.9.10
• djLint version -1.0.2

[monosans]

According to my observations, the issue is only on Windows.

[Taikono-Himazin]

If you turn on "Beta: Use Unicode UTF-8 with worldwide language support" in the system locale setting of windows, you can do it without any problem.
It seems to be a problem with windows settings. Thank you.

[christopherpickering]

Thanks @Taikono-Himazin and @monosans!

[christopherpickering]

Reopening to fix this:

[christopherpickering]

🎉 This issue has been resolved in version 1.1.0 🎉

The release is available on GitHub release

Your semantic-release bot 📦🚀

[Taikono-Himazin]

After applying this update, it worked fine even if I restored the Windows settings!
thank you!

[christopherpickering]

Nice! Thank you!