Skip to content

Commit

Permalink
rfctr(chunking): extract general-purpose objects to base (#2281)
Browse files Browse the repository at this point in the history
Many of the classes defined in `unstructured.chunking.title` are
applicable to any chunking strategy and will shortly be used for the
"by-character" chunking strategy as well.

Move these and their tests to `unstructured.chunking.base`.

Along the way, rename `TextPreChunkBuilder` to `PreChunkBuilder` because
it will be generalized in a subsequent PR to also take `Table` elements
such that inter-pre-chunk overlap can be implemented.

Otherwise, no logic changes, just moves.
  • Loading branch information
scanny authored Dec 16, 2023
1 parent a7c3f5f commit 36e81c3
Show file tree
Hide file tree
Showing 6 changed files with 1,298 additions and 1,268 deletions.
2 changes: 1 addition & 1 deletion CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
## 0.11.5-dev1
## 0.11.5-dev2

### Enhancements

Expand Down
Loading

0 comments on commit 36e81c3

Please sign in to comment.