Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Backport 2.x][Feature] Support SQL direct query in Observability (#988) #1072

Merged
merged 2 commits into from
Oct 4, 2023

Conversation

joshuali925
Copy link
Member

Description

backport #988 to 2.x

Issues Resolved

[List any issues this PR will resolve]

Check List

  • New functionality includes testing.
    • All tests pass, including unit test, integration test and doctest
  • New functionality has been documented.
    • New functionality has javadoc added
    • New functionality has user manual doc added
  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

…ct#988)

* remove unused files

Signed-off-by: Eric Wei <[email protected]>

* missing snapshots

Signed-off-by: Eric Wei <[email protected]>

* remove unused files

Signed-off-by: Eric Wei <[email protected]>

* missing snapshots

Signed-off-by: Eric Wei <[email protected]>

* create generic use polling hook

Signed-off-by: Eric <[email protected]>

* add unit tests

Signed-off-by: Eric <[email protected]>

* remove logging

Signed-off-by: Eric <[email protected]>

* datasource registeration for observability

Signed-off-by: Eric <[email protected]>

* Manage datasources (opensearch-project#967)

* fix name change bug and modify test to test behavior

Signed-off-by: Derek Ho <[email protected]>

* get rid of lint

Signed-off-by: Derek Ho <[email protected]>

* test for flyout

Signed-off-by: Derek Ho <[email protected]>

* flyout to medium size

Signed-off-by: Derek Ho <[email protected]>

* make accelerate extensible

Signed-off-by: Derek Ho <[email protected]>

* get datasources and hook up to pplservice

Signed-off-by: Derek Ho <[email protected]>

* get flint working

Signed-off-by: Derek Ho <[email protected]>

* add datasource page with steps and buttons on bottom bar

Signed-off-by: Derek Ho <[email protected]>

* datasources as a new plugin and mostly working

Signed-off-by: Derek Ho <[email protected]>

* hook up manage to show datasources call

Signed-off-by: Derek Ho <[email protected]>

* update two tables with descriptions

Signed-off-by: Derek Ho <[email protected]>

* make some updates to the page

Signed-off-by: Derek Ho <[email protected]>

* cleanup unused files for data connections

Signed-off-by: Derek Ho <[email protected]>

* cleanup and add overview panel columns

Signed-off-by: Derek Ho <[email protected]>

* render tabs

Signed-off-by: Derek Ho <[email protected]>

* add unit tests

Signed-off-by: Derek Ho <[email protected]>

* update data test subj and snapshot

Signed-off-by: Derek Ho <[email protected]>

* Add datasources to management overview

Signed-off-by: Derek Ho <[email protected]>

* remove spark logo and update snapshot

Signed-off-by: Derek Ho <[email protected]>

* refactor routes out

Signed-off-by: Derek Ho <[email protected]>

* separate out the roles

Signed-off-by: Derek Ho <[email protected]>

* bump version back to 3.0

Signed-off-by: Derek Ho <[email protected]>

---------

Signed-off-by: Derek Ho <[email protected]>

* Add acceleration management UI  (opensearch-project#989)

* add acceleration management UI skeleton

Signed-off-by: Shenoy Pratik <[email protected]>

* Create new documentation link for acc

Signed-off-by: Shenoy Pratik <[email protected]>

* fix typos and minor bugs

Signed-off-by: Shenoy Pratik <[email protected]>

* update snapshot

Signed-off-by: Shenoy Pratik <[email protected]>

* update window location to hash

Signed-off-by: Shenoy Pratik <[email protected]>

* remove unused headers

Signed-off-by: Shenoy Pratik <[email protected]>

---------

Signed-off-by: Shenoy Pratik <[email protected]>

* dummy data redirection for datasource selector and language selector

Signed-off-by: Eric <[email protected]>

* flint datasource registration

Signed-off-by: Eric <[email protected]>

* tempararily passing down setup deps for datasource

Signed-off-by: Eric <[email protected]>

* add node server endpoints for direct query and job status

Signed-off-by: Eric <[email protected]>

* add server side endpoints for direct query

Signed-off-by: Eric <[email protected]>

* add s3 datasource class

Signed-off-by: Eric <[email protected]>

* s3 datasource registeration

Signed-off-by: Eric <[email protected]>

* changes to use new endpoints

Signed-off-by: Eric <[email protected]>

* remove unused files

Signed-off-by: Eric Wei <[email protected]>

* missing snapshots

Signed-off-by: Eric Wei <[email protected]>

* initial direct query support in explorer

Signed-off-by: Eric <[email protected]>

* add datasource pluggable

Signed-off-by: Eric <[email protected]>

* remove unused files

Signed-off-by: Eric Wei <[email protected]>

* missing snapshots

Signed-off-by: Eric Wei <[email protected]>

* remove unused dependency as well as passing down pluggable

Signed-off-by: Eric <[email protected]>

* changes for adopting new endpoints

Signed-off-by: Eric <[email protected]>

* add initial commits for context swithing

Signed-off-by: Eric <[email protected]>

* add query running page

Signed-off-by: Eric <[email protected]>

* relayout as an effort of match look and feel

Signed-off-by: Eric <[email protected]>

* add changes for index pattern to work with context switch

Signed-off-by: Eric <[email protected]>

* remove search section from explorer home

Signed-off-by: Eric <[email protected]>

* visualization page for direct query

Signed-off-by: Eric <[email protected]>

* add direct query visualization page

Signed-off-by: Eric <[email protected]>

* merge main

Signed-off-by: Eric <[email protected]>

* add discover redirection

Signed-off-by: Eric <[email protected]>

* merge main and resolve conflicts

Signed-off-by: Eric <[email protected]>

* s3 datasource and layout changes

Signed-off-by: Eric <[email protected]>

* use newly changed handler name

Signed-off-by: Eric <[email protected]>

* fixes for sidebar and datasource

Signed-off-by: Eric <[email protected]>

* add fix for redirection issue

Signed-off-by: Eric <[email protected]>

* console/comments cleanup

Signed-off-by: Eric <[email protected]>

* remove outdated polling tests

Signed-off-by: Eric <[email protected]>

* delete few outdated tests to resolve testing issues and skipped search tests for now

Signed-off-by: Eric <[email protected]>

* adopt empty prompt

Signed-off-by: Eric <[email protected]>

* remove unused oui/eui component

Signed-off-by: Eric <[email protected]>

* adopt new endpoint cchanges

Signed-off-by: Eric <[email protected]>

* fix data grid issue

Signed-off-by: Eric <[email protected]>

* disable autosuggest for sql

Signed-off-by: Eric <[email protected]>

* remove manual link for SQL

Signed-off-by: Eric <[email protected]>

* query cancelling

Signed-off-by: Eric <[email protected]>

---------

Signed-off-by: Eric Wei <[email protected]>
Signed-off-by: Eric <[email protected]>
Signed-off-by: Derek Ho <[email protected]>
Signed-off-by: Shenoy Pratik <[email protected]>
Co-authored-by: Derek Ho <[email protected]>
Co-authored-by: Shenoy Pratik <[email protected]>
(cherry picked from commit e21dcf2)
@joshuali925
Copy link
Member Author

attempt to resolve all conflicts for backport, still need to test if it runs

Signed-off-by: Joshua Li <[email protected]>
@joshuali925 joshuali925 changed the title [Feature] Support SQL direct query in Observability (#988) [Backport 2.x][Feature] Support SQL direct query in Observability (#988) Oct 4, 2023
@mengweieric mengweieric merged commit cefd57f into opensearch-project:2.x Oct 4, 2023
3 of 6 checks passed
Swiddis added a commit to Swiddis/dashboards-observability that referenced this pull request Oct 5, 2023
amsiglan pushed a commit to amsiglan/dashboards-observability that referenced this pull request Jun 7, 2024
…ensearch-project#988) (opensearch-project#1072)

* [Feature] Support SQL direct query in Observability (opensearch-project#988)

* remove unused files

Signed-off-by: Eric Wei <[email protected]>

* missing snapshots

Signed-off-by: Eric Wei <[email protected]>

* remove unused files

Signed-off-by: Eric Wei <[email protected]>

* missing snapshots

Signed-off-by: Eric Wei <[email protected]>

* create generic use polling hook

Signed-off-by: Eric <[email protected]>

* add unit tests

Signed-off-by: Eric <[email protected]>

* remove logging

Signed-off-by: Eric <[email protected]>

* datasource registeration for observability

Signed-off-by: Eric <[email protected]>

* Manage datasources (opensearch-project#967)

* fix name change bug and modify test to test behavior

Signed-off-by: Derek Ho <[email protected]>

* get rid of lint

Signed-off-by: Derek Ho <[email protected]>

* test for flyout

Signed-off-by: Derek Ho <[email protected]>

* flyout to medium size

Signed-off-by: Derek Ho <[email protected]>

* make accelerate extensible

Signed-off-by: Derek Ho <[email protected]>

* get datasources and hook up to pplservice

Signed-off-by: Derek Ho <[email protected]>

* get flint working

Signed-off-by: Derek Ho <[email protected]>

* add datasource page with steps and buttons on bottom bar

Signed-off-by: Derek Ho <[email protected]>

* datasources as a new plugin and mostly working

Signed-off-by: Derek Ho <[email protected]>

* hook up manage to show datasources call

Signed-off-by: Derek Ho <[email protected]>

* update two tables with descriptions

Signed-off-by: Derek Ho <[email protected]>

* make some updates to the page

Signed-off-by: Derek Ho <[email protected]>

* cleanup unused files for data connections

Signed-off-by: Derek Ho <[email protected]>

* cleanup and add overview panel columns

Signed-off-by: Derek Ho <[email protected]>

* render tabs

Signed-off-by: Derek Ho <[email protected]>

* add unit tests

Signed-off-by: Derek Ho <[email protected]>

* update data test subj and snapshot

Signed-off-by: Derek Ho <[email protected]>

* Add datasources to management overview

Signed-off-by: Derek Ho <[email protected]>

* remove spark logo and update snapshot

Signed-off-by: Derek Ho <[email protected]>

* refactor routes out

Signed-off-by: Derek Ho <[email protected]>

* separate out the roles

Signed-off-by: Derek Ho <[email protected]>

* bump version back to 3.0

Signed-off-by: Derek Ho <[email protected]>

---------

Signed-off-by: Derek Ho <[email protected]>

* Add acceleration management UI  (opensearch-project#989)

* add acceleration management UI skeleton

Signed-off-by: Shenoy Pratik <[email protected]>

* Create new documentation link for acc

Signed-off-by: Shenoy Pratik <[email protected]>

* fix typos and minor bugs

Signed-off-by: Shenoy Pratik <[email protected]>

* update snapshot

Signed-off-by: Shenoy Pratik <[email protected]>

* update window location to hash

Signed-off-by: Shenoy Pratik <[email protected]>

* remove unused headers

Signed-off-by: Shenoy Pratik <[email protected]>

---------

Signed-off-by: Shenoy Pratik <[email protected]>

* dummy data redirection for datasource selector and language selector

Signed-off-by: Eric <[email protected]>

* flint datasource registration

Signed-off-by: Eric <[email protected]>

* tempararily passing down setup deps for datasource

Signed-off-by: Eric <[email protected]>

* add node server endpoints for direct query and job status

Signed-off-by: Eric <[email protected]>

* add server side endpoints for direct query

Signed-off-by: Eric <[email protected]>

* add s3 datasource class

Signed-off-by: Eric <[email protected]>

* s3 datasource registeration

Signed-off-by: Eric <[email protected]>

* changes to use new endpoints

Signed-off-by: Eric <[email protected]>

* remove unused files

Signed-off-by: Eric Wei <[email protected]>

* missing snapshots

Signed-off-by: Eric Wei <[email protected]>

* initial direct query support in explorer

Signed-off-by: Eric <[email protected]>

* add datasource pluggable

Signed-off-by: Eric <[email protected]>

* remove unused files

Signed-off-by: Eric Wei <[email protected]>

* missing snapshots

Signed-off-by: Eric Wei <[email protected]>

* remove unused dependency as well as passing down pluggable

Signed-off-by: Eric <[email protected]>

* changes for adopting new endpoints

Signed-off-by: Eric <[email protected]>

* add initial commits for context swithing

Signed-off-by: Eric <[email protected]>

* add query running page

Signed-off-by: Eric <[email protected]>

* relayout as an effort of match look and feel

Signed-off-by: Eric <[email protected]>

* add changes for index pattern to work with context switch

Signed-off-by: Eric <[email protected]>

* remove search section from explorer home

Signed-off-by: Eric <[email protected]>

* visualization page for direct query

Signed-off-by: Eric <[email protected]>

* add direct query visualization page

Signed-off-by: Eric <[email protected]>

* merge main

Signed-off-by: Eric <[email protected]>

* add discover redirection

Signed-off-by: Eric <[email protected]>

* merge main and resolve conflicts

Signed-off-by: Eric <[email protected]>

* s3 datasource and layout changes

Signed-off-by: Eric <[email protected]>

* use newly changed handler name

Signed-off-by: Eric <[email protected]>

* fixes for sidebar and datasource

Signed-off-by: Eric <[email protected]>

* add fix for redirection issue

Signed-off-by: Eric <[email protected]>

* console/comments cleanup

Signed-off-by: Eric <[email protected]>

* remove outdated polling tests

Signed-off-by: Eric <[email protected]>

* delete few outdated tests to resolve testing issues and skipped search tests for now

Signed-off-by: Eric <[email protected]>

* adopt empty prompt

Signed-off-by: Eric <[email protected]>

* remove unused oui/eui component

Signed-off-by: Eric <[email protected]>

* adopt new endpoint cchanges

Signed-off-by: Eric <[email protected]>

* fix data grid issue

Signed-off-by: Eric <[email protected]>

* disable autosuggest for sql

Signed-off-by: Eric <[email protected]>

* remove manual link for SQL

Signed-off-by: Eric <[email protected]>

* query cancelling

Signed-off-by: Eric <[email protected]>

---------

Signed-off-by: Eric Wei <[email protected]>
Signed-off-by: Eric <[email protected]>
Signed-off-by: Derek Ho <[email protected]>
Signed-off-by: Shenoy Pratik <[email protected]>
Co-authored-by: Derek Ho <[email protected]>
Co-authored-by: Shenoy Pratik <[email protected]>
(cherry picked from commit e21dcf2)

* remove datasource routers

Signed-off-by: Joshua Li <[email protected]>

---------

Signed-off-by: Joshua Li <[email protected]>
Co-authored-by: Eric Wei <[email protected]>
(cherry picked from commit cefd57f)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants