Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ensure indexing_data CCR requests are compressed #79413

Merged
merged 2 commits into from
Oct 19, 2021

Conversation

Tim-Brooks
Copy link
Contributor

@Tim-Brooks Tim-Brooks commented Oct 19, 2021

Currently, CCR requests are not compressed if they are indexing data.
This is because the BulkShardOperationsRequest does not
implement the indexing data interface.

Additionally, the fact that the request can be wrapped in proxy request
also requires special logic. This commit implements the same logic that
we do for shard indexing actions to ensure that the data is compressed
if the underlying request is indexing data.

Currently, proxy requests are not compressed if they are indexing data.
This commit implements the same logic that we do for shard indexing
actions to ensure that the data is compressed if the underlying data is
indexing data.
@Tim-Brooks Tim-Brooks added >bug :Distributed Coordination/Network Http and internode communication implementations v8.0.0 v7.16.0 v7.15.2 labels Oct 19, 2021
@elasticmachine elasticmachine added the Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. label Oct 19, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-distributed (Team:Distributed)

@Tim-Brooks Tim-Brooks changed the title Ensure indexing_data proxy requests are compressed Ensure indexing_data CCR requests are compressed Oct 19, 2021
Copy link
Contributor

@fcofdez fcofdez left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 👍

@Tim-Brooks Tim-Brooks merged commit fb73265 into elastic:master Oct 19, 2021
Tim-Brooks added a commit that referenced this pull request Oct 19, 2021
Currently, CCR requests are not compressed if they are indexing data.
This is because the BulkShardOperationsRequest does not
implement the indexing data interface.

Additionally, the fact that the request can be wrapped in proxy request
also requires special logic. This commit implements the same logic that
we do for shard indexing actions to ensure that the data is compressed
if the underlying request is indexing data.
Tim-Brooks added a commit that referenced this pull request Oct 19, 2021
Currently, CCR requests are not compressed if they are indexing data.
This is because the BulkShardOperationsRequest does not
implement the indexing data interface.

Additionally, the fact that the request can be wrapped in proxy request
also requires special logic. This commit implements the same logic that
we do for shard indexing actions to ensure that the data is compressed
if the underlying request is indexing data.
weizijun added a commit to weizijun/elasticsearch that referenced this pull request Oct 20, 2021
* upstream/master: (24 commits)
  Implement framework for migrating system indices (elastic#78951)
  Improve transient settings deprecation message (elastic#79504)
  Remove getValue and getValues from Field (elastic#79516)
  Store Template's mappings as bytes for disk serialization (elastic#78746)
  [ML] Add queue_capacity setting to start deployment API (elastic#79433)
  [ML] muting rest compat test issue elastic#79518 (elastic#79519)
  Avoid redundant available indices check (elastic#76540)
  Re-enable BWC tests
  TEST Ensure password 14 chars length on Kerberos FIPS tests (elastic#79496)
  [DOCS] Temporarily remove APM links (elastic#79411)
  Fix CCSDuelIT for skipped shards (elastic#79490)
  Add other time accounting in HotThreads (elastic#79392)
  Add deprecation info API entries for deprecated monitoring settings (elastic#78799)
  Add note in breaking changes for nameid_format (elastic#77785)
  Use 'migration' instead of 'upgrade' in GET system feature migration status responses (elastic#79302)
  Upgrade lucene version 8b68bf60c98 (elastic#79461)
  Use Strings#EMPTY_ARRAY (elastic#79452)
  Quicker shared cache file preallocation (elastic#79447)
  [ML] Removing some code that's obsolete for 8.0 (elastic#79444)
  Ensure indexing_data CCR requests are compressed (elastic#79413)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>bug :Distributed Coordination/Network Http and internode communication implementations Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. v7.15.2 v7.16.0 v8.0.0-beta1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants