Code

Partitioning compaction for Cortex#5465

Code

Closed

alexqyle wants to merge 28 commits intocortexproject:mastercortexproject/cortex:masterfrom alexqyle:partitioning-compactor-v3alexqyle/cortex:partitioning-compactor-v3Copy head branch name to clipboard

+4,468-869

Commits

Commits on Jul 18, 2023

• Partitioning compactor with upstreamed Thanos and Prometheus changes

  Show description for ea5dc28
  alexqyle

  committed
  ea5dc28

  Copy full SHA for ea5dc28

• Updated CHANGELOG

  Show description for b2eebc1
  alexqyle

  committed
  b2eebc1

  Copy full SHA for b2eebc1

Commits on Jul 25, 2023

• Fixed issue that block cannot be compacted if block was compacted with partition and partition info is missing

  Show description for 0fa228b
  alexqyle

  committed
  0fa228b

  Copy full SHA for 0fa228b

• fix lint

  Show description for f8f130c
  alexqyle

  committed
  f8f130c

  Copy full SHA for f8f130c

Commits on Jul 26, 2023

• make unit test clear

  Show description for 6fda3f1
  alexqyle

  committed
  6fda3f1

  Copy full SHA for 6fda3f1

Commits on Jul 28, 2023

• make visit mark file suffix backward compatible

  Show description for 4a05910
  alexqyle

  committed
  4a05910

  Copy full SHA for 4a05910

Commits on Jul 31, 2023

• fix invalid cortex extension being set in meta

  Show description for 2cb3d62
  alexqyle

  committed
  2cb3d62

  Copy full SHA for 2cb3d62

• fix lint

  Show description for 0036a8e
  alexqyle

  committed
  0036a8e

  Copy full SHA for 0036a8e

Commits on Aug 1, 2023

• Merge branch 'cortexproject:master' into partitioning-compactor-v3

  alexqyle

  authored
  044165d

  Copy full SHA for 044165d

Commits on Aug 16, 2023

• Merge branch 'master' into partitioning-compactor-v3

  Show description for 2a06555
  alexqyle

  authored
  2a06555

  Copy full SHA for 2a06555

• Make paritioning compactor configuration to be set per tenant

  Show description for d902b8b
  alexqyle

  committed
  d902b8b

  Copy full SHA for d902b8b

Commits on Aug 25, 2023

• fixed remaining plan metric and added block generation test util

  Show description for 5b892a3
  alexqyle

  committed
  5b892a3

  Copy full SHA for 5b892a3

• Merge commit 'b91a24d917f5a268b3982b0ddc6bf5686a9719a8' into partitioning-compactor-v3

  Show description for 236fd6b
  alexqyle

  committed
  236fd6b

  Copy full SHA for 236fd6b

Commits on Sep 8, 2023

• Merge commit '1a097a924b203c66646df5d02f3f09078ec77531' into partitioning-compactor-v3

  Show description for dc3d3af
  alexqyle

  committed
  dc3d3af

  Copy full SHA for dc3d3af

• improved performance going through all possible compaction groups

  Show description for 4f7d9c0
  alexqyle

  committed
  4f7d9c0

  Copy full SHA for 4f7d9c0

• nit fix

  Show description for c7060a4
  alexqyle

  committed
  c7060a4

  Copy full SHA for c7060a4

• nit fix

  Show description for 146417b
  alexqyle

  committed
  146417b

  Copy full SHA for 146417b

Commits on Sep 13, 2023

• merge from master

  Show description for 20ff2ca
  alexqyle

  committed
  20ff2ca

  Copy full SHA for 20ff2ca

Commits on Sep 14, 2023

• add extra logic in compaction complete checker to avoid source blocks being deleted when there is missing sample in result blocks.

  Show description for 392cffc
  alexqyle

  committed
  392cffc

  Copy full SHA for 392cffc

Commits on Sep 18, 2023

• move sample diff validation to post compaction callback

  Show description for 4daba3e
  alexqyle

  committed
  4daba3e

  Copy full SHA for 4daba3e

• fix lint

  Show description for ff3c705
  alexqyle

  committed
  ff3c705

  Copy full SHA for ff3c705

• Merge commit '4e162a011a5e23f90c0c934c3d0dee6398d349fd' into partitioning-compactor-v3

  Show description for 7f0bc54
  alexqyle

  committed
  7f0bc54

  Copy full SHA for 7f0bc54

Commits on Sep 19, 2023

• accurately getting result block

  Show description for 45749f2
  alexqyle

  committed
  45749f2

  Copy full SHA for 45749f2

Commits on Sep 28, 2023

• Randomly iterating through partitions in grouper. More timing logs in cleaner. Add jitter to beginning of compaction iteration.

  Show description for da38fbe
  alexqyle

  committed
  da38fbe

  Copy full SHA for da38fbe

Commits on Oct 3, 2023

• Introduce partition visit marker to avoid possible deadlock caused by block visit marker

  Show description for e0e2ec4
  alexqyle

  committed
  e0e2ec4

  Copy full SHA for e0e2ec4

Commits on Oct 11, 2023

• clean up local dir in pre compaction callback

  Show description for 4ef90ac
  alexqyle

  committed
  4ef90ac

  Copy full SHA for 4ef90ac

• Merge branch 'master' into partitioning-compactor-v3

  Show description for 2bf3571
  alexqyle

  authored
  2bf3571

  Copy full SHA for 2bf3571

• fix compile error after prometheus update

  Show description for 798a23a
  alexqyle

  committed
  798a23a

  Copy full SHA for 798a23a