Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix remote segments sync retry regression introduced in PR #7119 #8632

Merged
merged 4 commits into from
Jul 12, 2023

Conversation

ashking94
Copy link
Member

@ashking94 ashking94 commented Jul 11, 2023

Description

Fix segments upload retry regression introduced in PR #7119

Related Issues

Resolves #8631

Check List

  • New functionality includes testing.
    • All tests pass
  • New functionality has been documented.
    • New functionality has javadoc added
  • Commits are signed per the DCO using --signoff
  • Commit changes are listed out in CHANGELOG.md file (See: Changelog)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@ashking94
Copy link
Member Author

@sachinpkale @gbbafna @raghuvanshraj @vikasvb90 can you review the fix?

@sachinpkale
Copy link
Member

Changes LGTM.

@ashking94
Copy link
Member Author

Running the tests in RemoteStoreRefreshListenerTests class for 100 iterations. 40 iterations have passed and it is ongoing.

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

  • RESULT: UNSTABLE ❕
  • TEST FAILURES:
      1 org.opensearch.remotestore.multipart.RemoteStoreMultipartIT.testStaleCommitDeletionWithInvokeFlush
      1 org.opensearch.remotestore.RemoteStoreIT.testStaleCommitDeletionWithInvokeFlush

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

  • RESULT: UNSTABLE ❕
  • TEST FAILURES:
      3 org.opensearch.indices.replication.SegmentReplicationRelocationIT.testPrimaryRelocationWithSegRepFailure
      1 org.opensearch.remotestore.multipart.RemoteStoreMultipartIT.testStaleCommitDeletionWithInvokeFlush
      1 org.opensearch.remotestore.RemoteStoreIT.testStaleCommitDeletionWithInvokeFlush
      1 org.opensearch.action.admin.cluster.node.tasks.ResourceAwareTasksTests.testBasicTaskResourceTracking

@codecov
Copy link

codecov bot commented Jul 11, 2023

Codecov Report

Merging #8632 (5a3b166) into main (0b42c2c) will decrease coverage by 0.04%.
The diff coverage is 100.00%.

@@             Coverage Diff              @@
##               main    #8632      +/-   ##
============================================
- Coverage     70.96%   70.92%   -0.04%     
+ Complexity    57045    57018      -27     
============================================
  Files          4759     4759              
  Lines        269671   269668       -3     
  Branches      39452    39452              
============================================
- Hits         191374   191266     -108     
- Misses        62154    62271     +117     
+ Partials      16143    16131      -12     
Impacted Files Coverage Δ
...search/index/shard/RemoteStoreRefreshListener.java 82.21% <100.00%> (+6.49%) ⬆️
...earch/index/store/RemoteSegmentStoreDirectory.java 86.34% <100.00%> (+2.15%) ⬆️

... and 495 files with indirect coverage changes

@ashking94 ashking94 changed the title Fix segments upload retry regression introduced in PR #7119 Fix remote segments sync retry regression introduced in PR #7119 Jul 11, 2023
@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

Signed-off-by: Ashish Singh <[email protected]>
@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

  • RESULT: UNSTABLE ❕
  • TEST FAILURES:
      1 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testPrimaryStopped_ReplicaPromoted
      1 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testDropPrimaryDuringReplication
      1 org.opensearch.indices.replication.SegmentReplicationRelocationIT.testPrimaryRelocationWithSegRepFailure
      1 org.opensearch.indices.replication.SegmentReplicationRelocationIT.testPrimaryRelocation

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

  • RESULT: UNSTABLE ❕
  • TEST FAILURES:
      1 org.opensearch.cluster.routing.allocation.decider.DiskThresholdDeciderIT.testIndexCreateBlockIsRemovedWhenAnyNodesNotExceedHighWatermarkWithAutoReleaseEnabled

@sachinpkale sachinpkale merged commit 7dddb31 into opensearch-project:main Jul 12, 2023
ashking94 added a commit to ashking94/OpenSearch that referenced this pull request Jul 12, 2023
ashking94 added a commit to ashking94/OpenSearch that referenced this pull request Jul 12, 2023
…-project#7119 (opensearch-project#8632)

---------

Signed-off-by: Ashish Singh <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Signed-off-by: Ashish Singh <[email protected]>
ashking94 added a commit to ashking94/OpenSearch that referenced this pull request Jul 12, 2023
…-project#7119 (opensearch-project#8632)

---------

Signed-off-by: Ashish Singh <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Signed-off-by: Ashish Singh <[email protected]>
ashking94 added a commit to ashking94/OpenSearch that referenced this pull request Jul 12, 2023
…-project#7119 (opensearch-project#8632)

---------

Signed-off-by: Ashish Singh <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Signed-off-by: Ashish Singh <[email protected]>
vikasvb90 pushed a commit to raghuvanshraj/OpenSearch that referenced this pull request Jul 12, 2023
raghuvanshraj pushed a commit to raghuvanshraj/OpenSearch that referenced this pull request Jul 12, 2023
sachinpkale pushed a commit that referenced this pull request Jul 12, 2023
* [Remote Store] Add multipart upload integration for translog and segment files (#7119)

Signed-off-by: Raghuvansh Raj <[email protected]>
Signed-off-by: Ashish Singh <[email protected]>

* Fix remote segments sync retry regression introduced in PR #7119 (#8632)

---------

Signed-off-by: Ashish Singh <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Signed-off-by: Ashish Singh <[email protected]>

* Empty-Commit

Signed-off-by: Ashish Singh <[email protected]>

---------

Signed-off-by: Raghuvansh Raj <[email protected]>
Signed-off-by: Ashish Singh <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Co-authored-by: Raghuvansh Raj <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
dzane17 pushed a commit to dzane17/OpenSearch that referenced this pull request Jul 12, 2023
buddharajusahil pushed a commit to buddharajusahil/OpenSearch that referenced this pull request Jul 18, 2023
…-project#7119 (opensearch-project#8632)

---------

Signed-off-by: Ashish Singh <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Signed-off-by: sahil buddharaju <[email protected]>
baba-devv pushed a commit to baba-devv/OpenSearch that referenced this pull request Jul 29, 2023
shiv0408 pushed a commit to Gaurav614/OpenSearch that referenced this pull request Apr 25, 2024
…-project#7119 (opensearch-project#8632)

---------

Signed-off-by: Ashish Singh <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Signed-off-by: Shivansh Arora <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Continuous failures in RemoteStoreRefreshListenerTests due to #7119
4 participants