Code

Fix SB errors & Optimize path search#187

Code

Merged

bab2min merged 12 commits intomainbab2min/Kiwi:mainfrom dev/fix_sb_errorsbab2min/Kiwi:dev/fix_sb_errorsCopy head branch name to clipboardOct 3, 2024

+1,026-335

Commits

Commits on Sep 21, 2024

• Improve beam search for accurate SB tag matching

  bab2min

  committed
  0720f40

• fix debug codes

  bab2min

  committed
  e9c5750

• Implement NgramExtractor

  bab2min

  committed
  c0d940f

Commits on Sep 22, 2024

• Optimize SB tag beam search

  bab2min

  committed
  07ca549

• Optimize splitByTrie

  bab2min

  committed
  61bf5de

Commits on Sep 23, 2024

• Fix wrong end position of lengthened typo

  bab2min

  committed
  d931790

• Fixed lengthening typo cost scales

  bab2min

  committed
  cf453d9

• Fix parallelization bug at mp::runParallel

  bab2min

  committed
  584a443

Commits on Sep 28, 2024

• Optimize PathEvaluator::evalSingleMorpheme

  bab2min

  committed
  1236483

Commits on Sep 29, 2024

• add more alias to morpheme definitions

  bab2min

  committed
  83b205d

• Update test cases

  bab2min

  committed
  1d1d6bc

• Add ltypo arg to evaluator

  bab2min

  committed
  d8740fc