Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ILM migrate data between tiers #61377

Merged
merged 42 commits into from
Sep 17, 2020
Merged

ILM migrate data between tiers #61377

merged 42 commits into from
Sep 17, 2020

Commits on Aug 20, 2020

  1. Enable the _tier attribute as a node filter

    @andreidan
    andreidan committed Aug 20, 2020
    Configuration menu
    Copy the full SHA
    f4a37a9 View commit details
    Browse the repository at this point in the history

  2. ILM: inject a migrate step to migrate data between data tiers

    @andreidan
    andreidan committed Aug 20, 2020
    Configuration menu
    Copy the full SHA
    024a0de View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2020

  1. Merge branch 'master' into ilm-migrate-data-between-tiers

    @andreidan
    andreidan committed Sep 1, 2020
    Configuration menu
    Copy the full SHA
    ca9800f View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2020

  1. Add a DataTierMigrationRoutedStep and cleanup

    @andreidan
    andreidan committed Sep 3, 2020
    Configuration menu
    Copy the full SHA
    07dc8de View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2020

  1. Fix tests

    @andreidan
    andreidan committed Sep 4, 2020
    Configuration menu
    Copy the full SHA
    42900b2 View commit details
    Browse the repository at this point in the history

  2. Fix test

    @andreidan
    andreidan committed Sep 4, 2020
    Configuration menu
    Copy the full SHA
    5d6729b View commit details
    Browse the repository at this point in the history

  3. Remove invalid tier name setting validation from ILM step 

    We already validate the data tier setting values as part of the
index settings validation.
    @andreidan
    andreidan committed Sep 4, 2020
    Configuration menu
    Copy the full SHA
    28ccee9 View commit details
    Browse the repository at this point in the history

  4. Add test for DataTierMigrationRoutedStep

    @andreidan
    andreidan committed Sep 4, 2020
    Configuration menu
    Copy the full SHA
    45d2eb3 View commit details
    Browse the repository at this point in the history

  5. Disable data tier migration in the full policy we use for timeseries ITS 

    We'll have dedicated data tier integration tests that'll have data migration
enabled.
    @andreidan
    andreidan committed Sep 4, 2020
    Configuration menu
    Copy the full SHA
    6c05591 View commit details
    Browse the repository at this point in the history

  6. Remove unused import

    @andreidan
    andreidan committed Sep 4, 2020
    Configuration menu
    Copy the full SHA
    783061d View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2020

  1. Revert "Disable data tier migration in the full policy we use for tim… 

    …eseries ITS"

This reverts commit 6c05591.
    @andreidan
    andreidan committed Sep 6, 2020
    Configuration menu
    Copy the full SHA
    ab3ac33 View commit details
    Browse the repository at this point in the history

  2. Add MigrateActionTest

    @andreidan
    andreidan committed Sep 6, 2020
    Configuration menu
    Copy the full SHA
    6b74d7c View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into ilm-migrate-data-between-tiers

    @elasticmachine
    elasticmachine authored Sep 6, 2020
    Configuration menu
    Copy the full SHA
    61ed9eb View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2020

  1. Don't randomly pick a disabled migrate action as it has no steps

    @andreidan
    andreidan committed Sep 7, 2020
    Configuration menu
    Copy the full SHA
    6f83f91 View commit details
    Browse the repository at this point in the history

  2. Add ILM tier migratino IT

    @andreidan
    andreidan committed Sep 7, 2020
    Configuration menu
    Copy the full SHA
    4bef9b2 View commit details
    Browse the repository at this point in the history

  3. Use 0 replicas in docs test as check-migration waits for replicas t… 

    …o start
    @andreidan
    andreidan committed Sep 7, 2020
    Configuration menu
    Copy the full SHA
    5024595 View commit details
    Browse the repository at this point in the history

  4. Fix ILMHistoryTests

    @andreidan
    andreidan committed Sep 7, 2020
    Configuration menu
    Copy the full SHA
    41dc480 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' into ilm-migrate-data-between-tiers

    @elasticmachine
    elasticmachine authored Sep 7, 2020
    Configuration menu
    Copy the full SHA
    d9b6390 View commit details
    Browse the repository at this point in the history

  6. Disable migrate action in test that waits for shard allocations

    @andreidan
    andreidan committed Sep 7, 2020
    Configuration menu
    Copy the full SHA
    8e9a4f3 View commit details
    Browse the repository at this point in the history

  7. Add ILM client MigrateAction

    @andreidan
    andreidan committed Sep 7, 2020
    Configuration menu
    Copy the full SHA
    996c747 View commit details
    Browse the repository at this point in the history

  8. Remove unused import

    @andreidan
    andreidan committed Sep 7, 2020
    Configuration menu
    Copy the full SHA
    83c31b6 View commit details
    Browse the repository at this point in the history

  9. Fix HLRC tests

    @andreidan
    andreidan committed Sep 7, 2020
    Configuration menu
    Copy the full SHA
    c1746d4 View commit details
    Browse the repository at this point in the history

  10. Add tests for conflicting auto allocate to hot nodes and MigrateActio… 

    …n configurations
    @andreidan
    andreidan committed Sep 7, 2020
    Configuration menu
    Copy the full SHA
    fe1fb8f View commit details
    Browse the repository at this point in the history

  11. Use valid tier name in test

    @andreidan
    andreidan committed Sep 7, 2020
    Configuration menu
    Copy the full SHA
    e435a2f View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2020

  1. Implement hashcode

    @andreidan
    andreidan committed Sep 8, 2020
    Configuration menu
    Copy the full SHA
    656afe5 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into ilm-migrate-data-between-tiers

    @andreidan
    andreidan committed Sep 8, 2020
    Configuration menu
    Copy the full SHA
    a24b0fc View commit details
    Browse the repository at this point in the history

  3. Make method static

    @andreidan
    andreidan committed Sep 8, 2020
    Configuration menu
    Copy the full SHA
    8d806e2 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2020

  1. Check for "data" role in check-migration step

    @andreidan
    andreidan committed Sep 10, 2020
    Configuration menu
    Copy the full SHA
    2133715 View commit details
    Browse the repository at this point in the history

  2. Document AllocationInfo and rename actual_replicas to `number_of_re… 

    …plicas`
    @andreidan
    andreidan committed Sep 10, 2020
    Configuration menu
    Copy the full SHA
    991fdc0 View commit details
    Browse the repository at this point in the history

  3. Disallow the migrate action in the hot phase

    @andreidan
    andreidan committed Sep 10, 2020
    Configuration menu
    Copy the full SHA
    be65929 View commit details
    Browse the repository at this point in the history

  4. Remove rogue ;

    @andreidan
    andreidan committed Sep 10, 2020
    Configuration menu
    Copy the full SHA
    39b518e View commit details
    Browse the repository at this point in the history

  5. Fix HLRC tests

    @andreidan
    andreidan committed Sep 10, 2020
    Configuration menu
    Copy the full SHA
    f3a64d3 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' into ilm-migrate-data-between-tiers

    @elasticmachine
    elasticmachine authored Sep 10, 2020
    Configuration menu
    Copy the full SHA
    d119797 View commit details
    Browse the repository at this point in the history

  7. Fix ILMHistoryTests

    @andreidan
    andreidan committed Sep 10, 2020
    Configuration menu
    Copy the full SHA
    8f855c5 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2020

  1. Merge branch 'master' into ilm-migrate-data-between-tiers

    @elasticmachine
    elasticmachine authored Sep 14, 2020
    Configuration menu
    Copy the full SHA
    0636d0e View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2020

  1. Merge branch 'master' into ilm-migrate-data-between-tiers

    @elasticmachine
    elasticmachine authored Sep 16, 2020
    Configuration menu
    Copy the full SHA
    500a275 View commit details
    Browse the repository at this point in the history

  2. Remove frozen phase from HLRC

    @andreidan
    andreidan committed Sep 16, 2020
    Configuration menu
    Copy the full SHA
    9b90555 View commit details
    Browse the repository at this point in the history

  3. Execute the allocate action before migrate

    @andreidan
    andreidan committed Sep 16, 2020
    Configuration menu
    Copy the full SHA
    eddd223 View commit details
    Browse the repository at this point in the history

  4. Adjust test to wait until ILM completes in the cold phase

    @andreidan
    andreidan committed Sep 16, 2020
    Configuration menu
    Copy the full SHA
    d733d72 View commit details
    Browse the repository at this point in the history

  5. Log and exception messages

    @andreidan
    andreidan committed Sep 16, 2020
    Configuration menu
    Copy the full SHA
    4da7379 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' into ilm-migrate-data-between-tiers

    @andreidan
    andreidan committed Sep 16, 2020
    Configuration menu
    Copy the full SHA
    be17159 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2020

  1. Drop equals and hashcode (in favour of the ones in Step)

    @andreidan
    andreidan committed Sep 17, 2020
    Configuration menu
    Copy the full SHA
    b837718 View commit details
    Browse the repository at this point in the history