Skip to content

Commit

Permalink
fixes japanese unicode error with test running
Browse files Browse the repository at this point in the history
  • Loading branch information
davelandry committed Mar 9, 2017
1 parent f332553 commit 0f0ff94
Showing 1 changed file with 1 addition and 6 deletions.
7 changes: 1 addition & 6 deletions src/textSplit.js
Original file line number Diff line number Diff line change
Expand Up @@ -36,12 +36,7 @@ const suffixChars = ["'", ">", ")", "}", "]", ".", "!", "?",
].concat(splitChars);

const burmeseRange = "\u1000-\u102A\u103F-\u1049\u1050-\u1055";
const japaneseRange = `\u3040-\u309f
\u30a0-\u30ff
\uff00-\uff0b
\uff0d-\uff5d
\uff5f-\uff9f
\u3400-\u4dbf`;
const japaneseRange = "\u3040-\u309f\u30a0-\u30ff\uff00-\uff0b\uff0d-\uff5d\uff5f-\uff9f\u3400-\u4dbf";
const chineseRange = "\u3400-\u9FBF";
const laoRange = "\u0E81-\u0EAE\u0EB0-\u0EC4\u0EC8-\u0ECB\u0ECD-\u0EDD";

Expand Down

0 comments on commit 0f0ff94

Please sign in to comment.