Skip to content

Commit

Permalink
[ENH] Compactor flush (chroma-core#1879)
Browse files Browse the repository at this point in the history
### FlushCollectionCompaction
chroma-core#1869
https://linear.app/trychroma/issue/CHR-298/segment-compaction-flush

- grpc in collection service FlushCollectionCompaction
- table_catalog: FlushCollectionCompaction
- in one transaction:
  - segment: RegisterFilePaths
  - collection: UpdateLogPositionAndVersion
- tenant: UpdateTenantLastCompactionTime // optional, should add a
config to disable


### Tests
- test_utils to create tenant, database, collection, segments
- change existing tests to use test suite: begin suite set up tenant, db
(unless testing tenant and db in the test itself), end suite clean up,
begin test set up sample objects (eg, collection and segments)
- each tests should create objects that with different IDs and Names
  • Loading branch information
weiligu authored Mar 15, 2024
1 parent 47fdc61 commit 41ad7ba
Show file tree
Hide file tree
Showing 52 changed files with 3,049 additions and 1,894 deletions.
84 changes: 45 additions & 39 deletions chromadb/proto/chroma_pb2.py

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

27 changes: 23 additions & 4 deletions chromadb/proto/chroma_pb2.pyi

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading

0 comments on commit 41ad7ba

Please sign in to comment.