Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add skipping indices for all integrations that have sample queries #1747

Merged
merged 7 commits into from
Apr 29, 2024

Conversation

Swiddis
Copy link
Collaborator

@Swiddis Swiddis commented Apr 26, 2024

Description

Adds skipping indices to help with optimizing queries. The particular sample queries that were already written aren't especially affected by this optimization (since they're mostly aggregates over all data), but the indices should help with filtering for filter-heavy queries when there's a larger amount of data.

Issues Resolved

N/A

Check List

  • New functionality includes testing.
    • All tests pass, including unit test, integration test and doctest
  • New functionality has been documented.
    • New functionality has javadoc added
    • New functionality has user manual doc added
  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@Swiddis Swiddis added enhancement New feature or request integrations Used to denote items related to the Integrations project labels Apr 26, 2024
@Swiddis Swiddis merged commit 685aeaf into opensearch-project:main Apr 29, 2024
21 of 27 checks passed
@Swiddis Swiddis deleted the integ-skipping-index-queries branch April 29, 2024 18:50
opensearch-trigger-bot bot pushed a commit that referenced this pull request Apr 29, 2024
…1747)

* Update avg threshold for cloudfront query

Signed-off-by: Simeon Widdis <[email protected]>

* Add first draft skipping index for cloudfront integration

Signed-off-by: Simeon Widdis <[email protected]>

* Add skipping index for nginx

Signed-off-by: Simeon Widdis <[email protected]>

* Add skipping index for s3

Signed-off-by: Simeon Widdis <[email protected]>

* Add skipping index for elb

Signed-off-by: Simeon Widdis <[email protected]>

* Update skipping indices to use bloom filters for client IDs

Signed-off-by: Simeon Widdis <[email protected]>

* Add skipping index for apache

Signed-off-by: Simeon Widdis <[email protected]>

---------

Signed-off-by: Simeon Widdis <[email protected]>
(cherry picked from commit 685aeaf)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
opensearch-trigger-bot bot pushed a commit that referenced this pull request Apr 30, 2024
…1747)

* Update avg threshold for cloudfront query

Signed-off-by: Simeon Widdis <[email protected]>

* Add first draft skipping index for cloudfront integration

Signed-off-by: Simeon Widdis <[email protected]>

* Add skipping index for nginx

Signed-off-by: Simeon Widdis <[email protected]>

* Add skipping index for s3

Signed-off-by: Simeon Widdis <[email protected]>

* Add skipping index for elb

Signed-off-by: Simeon Widdis <[email protected]>

* Update skipping indices to use bloom filters for client IDs

Signed-off-by: Simeon Widdis <[email protected]>

* Add skipping index for apache

Signed-off-by: Simeon Widdis <[email protected]>

---------

Signed-off-by: Simeon Widdis <[email protected]>
(cherry picked from commit 685aeaf)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
mengweieric pushed a commit that referenced this pull request May 1, 2024
…1747) (#1749)

* Update avg threshold for cloudfront query



* Add first draft skipping index for cloudfront integration



* Add skipping index for nginx



* Add skipping index for s3



* Add skipping index for elb



* Update skipping indices to use bloom filters for client IDs



* Add skipping index for apache



---------


(cherry picked from commit 685aeaf)

Signed-off-by: Simeon Widdis <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
amsiglan pushed a commit to amsiglan/dashboards-observability that referenced this pull request Jun 7, 2024
…pensearch-project#1747)

* Update avg threshold for cloudfront query

Signed-off-by: Simeon Widdis <[email protected]>

* Add first draft skipping index for cloudfront integration

Signed-off-by: Simeon Widdis <[email protected]>

* Add skipping index for nginx

Signed-off-by: Simeon Widdis <[email protected]>

* Add skipping index for s3

Signed-off-by: Simeon Widdis <[email protected]>

* Add skipping index for elb

Signed-off-by: Simeon Widdis <[email protected]>

* Update skipping indices to use bloom filters for client IDs

Signed-off-by: Simeon Widdis <[email protected]>

* Add skipping index for apache

Signed-off-by: Simeon Widdis <[email protected]>

---------

Signed-off-by: Simeon Widdis <[email protected]>
(cherry picked from commit 685aeaf)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport 2.x backport 2.14 enhancement New feature or request integrations Used to denote items related to the Integrations project
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants