Code

Il 239 chunk overlap task#453

Code

Merged

FelixFehse merged 5 commits intomainAleph-Alpha/intelligence-layer-sdk:mainfrom IL-239-ChunkOverlapTaskAleph-Alpha/intelligence-layer-sdk:IL-239-ChunkOverlapTaskCopy head branch name to clipboardFeb 6, 2024

+157-11

Commits

Commits on Feb 5, 2024

• IL-239 added ChunkOverlapTask

  FelixFehseTNG

  committed
  c233ecc

• IL-239 added test_chunk.py

  FelixFehseTNG

  committed
  e9f8cb6

• IL-239 add overlap_length_tokens to SteerableLongContextSummarize

  FelixFehseTNG

  committed
  fdffb7a

Commits on Feb 6, 2024

• IL-239 new chunking for overlap with half-overlap size

  FelixFehseTNG

  committed
  128e8cd

• added break for recursive summary when number of partial summary doesn't change

  

  JohannesWesch

  authored and

  FelixFehseTNG

  committed
  e15956a