Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

integrate with crypto module to decrypt password #2170

Conversation

zhongnansu
Copy link
Member

@zhongnansu zhongnansu commented Aug 18, 2022

Signed-off-by: Zhongnan Su [email protected]

Description

integrate with crypto module to decrypt password

Issues Resolved

#1983

Check List

  • New functionality includes testing.
    • All tests pass
      • yarn test:jest
      • yarn test:jest_integration
      • yarn test:ftr
  • New functionality has been documented.
  • Commits are signed per the DCO using --signoff

@zhongnansu zhongnansu requested a review from a team as a code owner August 18, 2022 23:44
@zhongnansu zhongnansu changed the title integrate with crypto module to decrpt password integrate with crypto module to decrypt password Aug 18, 2022
Copy link
Contributor

@noCharger noCharger left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. I will probabaly refactor CryptographyClient to be a service

@zhongnansu zhongnansu added the multiple datasource multiple datasource project label Aug 18, 2022
@zhongnansu zhongnansu self-assigned this Aug 18, 2022
import {
CredentialSavedObjectAttributes,
UsernamePasswordTypedContent,
} from '../../common/credentials/types';
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

../../common works as well

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

image

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i will refactor on this to expose directly

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let's create an issue to track this

Comment on lines +68 to +72
const decodedPassword = await cryptographyClient.decodeAndDecrypt(password);
const credential = {
username,
password: decodedPassword,
};
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How about

const credential = {
      username,
      password: await cryptographyClient.decodeAndDecrypt(password),
 };

export interface DataSourceServiceSetup {
getDataSourceClient: (
dataSourceId: string,
// this saved objects client is used to fetch data source on behalf of users, caller should pass scoped saved objects client
savedObjects: SavedObjectsClientContract
savedObjects: SavedObjectsClientContract,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

    // this saved objects client is used to fetch data source on behalf of users, caller should pass scoped saved objects client

Can I ask more context on this?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it should be scoped client, which means a client tight to a user in the request. Different user may have access to different saved object, including datasource or credentials.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it should be scoped client, which means a client tight to a user in the request. Different user may have access to different saved object, including datasource or credentials.

Follow up question - Is this already possible with the current scoped clienet? What is the isolation based on?

@zhongnansu
Copy link
Member Author

CI failed due to #2169
Merging in to unblock future PR

@zhongnansu zhongnansu merged commit b1d0e6c into opensearch-project:feature/multi-datasource Aug 19, 2022
kristenTian pushed a commit to kristenTian/OpenSearch-Dashboards that referenced this pull request Sep 12, 2022
kristenTian pushed a commit to kristenTian/OpenSearch-Dashboards that referenced this pull request Sep 14, 2022
kristenTian pushed a commit to kristenTian/OpenSearch-Dashboards that referenced this pull request Sep 14, 2022
kristenTian pushed a commit to kristenTian/OpenSearch-Dashboards that referenced this pull request Sep 15, 2022
kristenTian added a commit that referenced this pull request Sep 19, 2022
* Instantiate credential management plugin code structure (#1996)

Signed-off-by: Kristen Tian <[email protected]>

* Data source inside stack management setup (#2017) (#2030)

Signed-off-by: Kristen Tian <[email protected]>

* enable CI for feature branch (#2010)

Signed-off-by: Zhongnan Su <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Add empty data source plugin (#2052)

Adds empty data source plugin.

Signed-off-by: Kristen Tian <[email protected]>

* [MD] Add initial credential management CRUD pages (#2040)

* Add credential management CRUD pages

1. List all credentials
2. Create your saved credential
3. Edit your credential
4. Delete credentials

Signed-off-by: Louis Chu <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Register Data source to savedObject & Update license header (#2037)

Signed-off-by: Kristen Tian <[email protected]>

* Move credential saved object to data source plugin (#2062)

Signed-off-by: Louis Chu <[email protected]>

Move credential saved object to data source plugin
Resolve follow up comments on UI

Signed-off-by: Kristen Tian <[email protected]>

* breadcrumbfix for datasource management (#2066)

* breadcrumbfix for datasource management

Signed-off-by: mpabba3003 <[email protected]>

* breadcrumbfix for datasource management - refactoring code

Signed-off-by: mpabba3003 <[email protected]>

* using services to update breadcrumb on data sources management page

Signed-off-by: mpabba3003 <[email protected]>

* Changing the license header on breadcrumbs.ts datasource management

Signed-off-by: Kristen Tian <[email protected]>

* Fix breadcrumb on listing page and update saved object mapping (#2069)

Signed-off-by: Louis Chu <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Add data source step into IndexPattern with Mock switch (#2064) (#2086)

Signed-off-by: Kristen Tian <[email protected]>

* Add delete button for credential detailed page (#2067)

Signed-off-by: Yibo Wang <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Link datasource to indexpattern (#2118)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* Add encrypt/decrypt module on data source plugin (#2120)

Signed-off-by: Louis Chu <[email protected]>

1. Add encrypt/decrypt module with UT
2. Add client factory wrapper for encrypt credential
3. Add encryption config support
4. Bugfix on Jest interpret Buffer

Signed-off-by: Kristen Tian <[email protected]>

* Integrate index pattern with new data client (#2146)

Signed-off-by: Kristen Tian <[email protected]>

* Add noAuth to dataSource attributes (#2154)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* [MD] Datasource Management - creation & listing - UI only (#2128)

* data source management - creation & Listing UI only

* data source management - creation & Listing UI only

* Create/edit data source feature

* toggling default value

* refactoring code as per review comments

* toggling server flag to false

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Apply dataSource plugin as dependent for cm and dsm plugins (#2150)

Signed-off-by: Louis Chu <[email protected]>

Apply dataSource plugin as dependent for cm and dsm plugins (#2150)

Signed-off-by: Kristen Tian <[email protected]>

* Leverage datasource enablement in index pattern management

Signed-off-by: Kristen Tian <[email protected]>

* [MD] Add client management module and register `getClient()` to route handler context (#2121)

* Add client management module and register `getClient()` interface to route handler context
Signed-off-by: Zhongnan Su <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Make step info in index pattern creation dynamic (#2164)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* Refactor for credential listing page & add loading effect (#2142)

Signed-off-by: Yibo Wang <[email protected]>

Signed-off-by: Yibo Wang <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Integration sequal - replace data client placeholders (#2167)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* Integrate with crypto module to decrpt password (#2170)

Signed-off-by: Zhongnan Su <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* [MD] noAuth integration, credential & endpoint validation (#2165)

* noAuth integration, credential & endpoint validation

Signed-off-by: mpabba3003 <[email protected]>

* Refactoring validation message

Signed-off-by: mpabba3003 <[email protected]>

* Adding back accidentally deleted file home/tutorials/haproxy_metrics/index.ts

Signed-off-by: mpabba3003 <[email protected]>

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* [MD] Refactor search strategy to conditionally user datasource client (#2171)

Signed-off-by: Kristen Tian <[email protected]>

* adding relation between credential selection and no auth checkbox (#2175)

Signed-off-by: mpabba3003 <[email protected]>

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Update getIndicesViaSearch with datasource (#2176)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* Add null header to child client spawn (#2188)

Signed-off-by: Su <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* [MD][IP]Update button position & Add UT & Add skip option (#2195)

* Add UT - index pattern related

Signed-off-by: Kristen Tian <[email protected]>

* Update button position

Signed-off-by: Kristen Tian <[email protected]>

* Add skip option to allow use default os data source

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* [MD]Refactor layout and validate input fields for listing and create pages (#2202)

Signed-off-by: Louis Chu <[email protected]>

Signed-off-by: Louis Chu <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Enable datasource link in saveObjectManagement (#2209)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* Update configure data source per UX input (#2235)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* Enable data source audit log to file (#2215)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* [MD] Refactor of credential editing page layout & refactor backend field validation method (#2222)

* Refactor of credential editing page layout & refactor backend field validation method

* Resolved the comments & fix the multiple call for one operation

Signed-off-by: Yibo Wang <[email protected]>

Signed-off-by: Yibo Wang <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Tweak fetch data back to original (#2238)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* [MD] Revamped UX for data source management (#2239)

* revamped UX for data source management

Signed-off-by: mpabba3003 <[email protected]>

* refactored datasource screens as per PR comments

Signed-off-by: mpabba3003 <[email protected]>

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* [MD] Credentials security redesign (#2253)

1. Data model changes for data source saved object
2. Server side changes for data source saved object
  a. Implement data_source_saved_objects_client_wrapper to integrate with CryptographyClient for password
  encryption / decryption.
  b. Change data_source_service to fetch credentials directly from data source (still decrypt via CryptographyClient)
  c. Fix unit tests accordingly

Signed-off-by: Louis Chu <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Add step data source UI test (#2264)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* [MD]Improve datasource server side error handling (#2236)

Signed-off-by: Su <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* [MD] Datasource management new API change integrations (#2282)

* changing datasource management design to integrate with new API changes

Signed-off-by: mpabba3003 <[email protected]>

* Update edit_data_source_form.tsx

moving masked password to constants

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Update stream test to bypass CI env generate domain attribute

Signed-off-by: Kristen Tian <[email protected]>

* Delete credential management

Signed-off-by: Kristen Tian <[email protected]>

* Address comments

Signed-off-by: Kristen Tian <[email protected]>

* [MD] Datasource Management - Create data source - Unit tests (#2341)

* Unit test cases for data source management - create

Signed-off-by: mpabba3003 <[email protected]>

* adding tests to utils.ts & changing it to test

Signed-off-by: mpabba3003 <[email protected]>

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Fix update data source & block update endpint (#2364)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* MD datasource management-datasource table-UTs (#2350)

Signed-off-by: Yibo Wang <[email protected]>

Signed-off-by: Yibo Wang <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* reafctor based on PR 2334 comments to merge to main (#2375)

Signed-off-by: mpabba3003 <[email protected]>

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* removing invalid urls as CI fails on link checker for inavlid urls in git (#2376)

Signed-off-by: mpabba3003 <[email protected]>

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Address comments

Signed-off-by: Kristen Tian <[email protected]>

* Fix DS snapshot test

Signed-off-by: Kristen Tian <[email protected]>

* Add https://test.com/ to lychee exclude

Signed-off-by: Kristen Tian <[email protected]>

* Address comments

Signed-off-by: Kristen Tian <[email protected]>

* Remove unnessacry check

Signed-off-by: Kristen Tian <[email protected]>

* Remove not needed check

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>
Signed-off-by: Zhongnan Su <[email protected]>
Signed-off-by: Louis Chu <[email protected]>
Signed-off-by: Yibo Wang <[email protected]>
Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Su <[email protected]>
Co-authored-by: Louis Chu <[email protected]>
Co-authored-by: Zhongnan Su <[email protected]>
Co-authored-by: Yan Zeng <[email protected]>
Co-authored-by: Manideep Pabba <[email protected]>
Co-authored-by: Yibo Wang <[email protected]>
kavilla pushed a commit to kavilla/OpenSearch-Dashboards-1 that referenced this pull request Sep 21, 2022
* Instantiate credential management plugin code structure (opensearch-project#1996)

Signed-off-by: Kristen Tian <[email protected]>

* Data source inside stack management setup (opensearch-project#2017) (opensearch-project#2030)

Signed-off-by: Kristen Tian <[email protected]>

* enable CI for feature branch (opensearch-project#2010)

Signed-off-by: Zhongnan Su <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Add empty data source plugin (opensearch-project#2052)

Adds empty data source plugin.

Signed-off-by: Kristen Tian <[email protected]>

* [MD] Add initial credential management CRUD pages (opensearch-project#2040)

* Add credential management CRUD pages

1. List all credentials
2. Create your saved credential
3. Edit your credential
4. Delete credentials

Signed-off-by: Louis Chu <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Register Data source to savedObject & Update license header (opensearch-project#2037)

Signed-off-by: Kristen Tian <[email protected]>

* Move credential saved object to data source plugin (opensearch-project#2062)

Signed-off-by: Louis Chu <[email protected]>

Move credential saved object to data source plugin
Resolve follow up comments on UI

Signed-off-by: Kristen Tian <[email protected]>

* breadcrumbfix for datasource management (opensearch-project#2066)

* breadcrumbfix for datasource management

Signed-off-by: mpabba3003 <[email protected]>

* breadcrumbfix for datasource management - refactoring code

Signed-off-by: mpabba3003 <[email protected]>

* using services to update breadcrumb on data sources management page

Signed-off-by: mpabba3003 <[email protected]>

* Changing the license header on breadcrumbs.ts datasource management

Signed-off-by: Kristen Tian <[email protected]>

* Fix breadcrumb on listing page and update saved object mapping (opensearch-project#2069)

Signed-off-by: Louis Chu <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Add data source step into IndexPattern with Mock switch (opensearch-project#2064) (opensearch-project#2086)

Signed-off-by: Kristen Tian <[email protected]>

* Add delete button for credential detailed page (opensearch-project#2067)

Signed-off-by: Yibo Wang <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Link datasource to indexpattern (opensearch-project#2118)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* Add encrypt/decrypt module on data source plugin (opensearch-project#2120)

Signed-off-by: Louis Chu <[email protected]>

1. Add encrypt/decrypt module with UT
2. Add client factory wrapper for encrypt credential
3. Add encryption config support
4. Bugfix on Jest interpret Buffer

Signed-off-by: Kristen Tian <[email protected]>

* Integrate index pattern with new data client (opensearch-project#2146)

Signed-off-by: Kristen Tian <[email protected]>

* Add noAuth to dataSource attributes (opensearch-project#2154)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* [MD] Datasource Management - creation & listing - UI only (opensearch-project#2128)

* data source management - creation & Listing UI only

* data source management - creation & Listing UI only

* Create/edit data source feature

* toggling default value

* refactoring code as per review comments

* toggling server flag to false

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Apply dataSource plugin as dependent for cm and dsm plugins (opensearch-project#2150)

Signed-off-by: Louis Chu <[email protected]>

Apply dataSource plugin as dependent for cm and dsm plugins (opensearch-project#2150)

Signed-off-by: Kristen Tian <[email protected]>

* Leverage datasource enablement in index pattern management

Signed-off-by: Kristen Tian <[email protected]>

* [MD] Add client management module and register `getClient()` to route handler context (opensearch-project#2121)

* Add client management module and register `getClient()` interface to route handler context
Signed-off-by: Zhongnan Su <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Make step info in index pattern creation dynamic (opensearch-project#2164)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* Refactor for credential listing page & add loading effect (opensearch-project#2142)

Signed-off-by: Yibo Wang <[email protected]>

Signed-off-by: Yibo Wang <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Integration sequal - replace data client placeholders (opensearch-project#2167)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* Integrate with crypto module to decrpt password (opensearch-project#2170)

Signed-off-by: Zhongnan Su <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* [MD] noAuth integration, credential & endpoint validation (opensearch-project#2165)

* noAuth integration, credential & endpoint validation

Signed-off-by: mpabba3003 <[email protected]>

* Refactoring validation message

Signed-off-by: mpabba3003 <[email protected]>

* Adding back accidentally deleted file home/tutorials/haproxy_metrics/index.ts

Signed-off-by: mpabba3003 <[email protected]>

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* [MD] Refactor search strategy to conditionally user datasource client (opensearch-project#2171)

Signed-off-by: Kristen Tian <[email protected]>

* adding relation between credential selection and no auth checkbox (opensearch-project#2175)

Signed-off-by: mpabba3003 <[email protected]>

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Update getIndicesViaSearch with datasource (opensearch-project#2176)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* Add null header to child client spawn (opensearch-project#2188)

Signed-off-by: Su <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* [MD][IP]Update button position & Add UT & Add skip option (opensearch-project#2195)

* Add UT - index pattern related

Signed-off-by: Kristen Tian <[email protected]>

* Update button position

Signed-off-by: Kristen Tian <[email protected]>

* Add skip option to allow use default os data source

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* [MD]Refactor layout and validate input fields for listing and create pages (opensearch-project#2202)

Signed-off-by: Louis Chu <[email protected]>

Signed-off-by: Louis Chu <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Enable datasource link in saveObjectManagement (opensearch-project#2209)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* Update configure data source per UX input (opensearch-project#2235)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* Enable data source audit log to file (opensearch-project#2215)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* [MD] Refactor of credential editing page layout & refactor backend field validation method (opensearch-project#2222)

* Refactor of credential editing page layout & refactor backend field validation method

* Resolved the comments & fix the multiple call for one operation

Signed-off-by: Yibo Wang <[email protected]>

Signed-off-by: Yibo Wang <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Tweak fetch data back to original (opensearch-project#2238)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* [MD] Revamped UX for data source management (opensearch-project#2239)

* revamped UX for data source management

Signed-off-by: mpabba3003 <[email protected]>

* refactored datasource screens as per PR comments

Signed-off-by: mpabba3003 <[email protected]>

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* [MD] Credentials security redesign (opensearch-project#2253)

1. Data model changes for data source saved object
2. Server side changes for data source saved object
  a. Implement data_source_saved_objects_client_wrapper to integrate with CryptographyClient for password
  encryption / decryption.
  b. Change data_source_service to fetch credentials directly from data source (still decrypt via CryptographyClient)
  c. Fix unit tests accordingly

Signed-off-by: Louis Chu <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Add step data source UI test (opensearch-project#2264)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* [MD]Improve datasource server side error handling (opensearch-project#2236)

Signed-off-by: Su <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* [MD] Datasource management new API change integrations (opensearch-project#2282)

* changing datasource management design to integrate with new API changes

Signed-off-by: mpabba3003 <[email protected]>

* Update edit_data_source_form.tsx

moving masked password to constants

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Update stream test to bypass CI env generate domain attribute

Signed-off-by: Kristen Tian <[email protected]>

* Delete credential management

Signed-off-by: Kristen Tian <[email protected]>

* Address comments

Signed-off-by: Kristen Tian <[email protected]>

* [MD] Datasource Management - Create data source - Unit tests (opensearch-project#2341)

* Unit test cases for data source management - create

Signed-off-by: mpabba3003 <[email protected]>

* adding tests to utils.ts & changing it to test

Signed-off-by: mpabba3003 <[email protected]>

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Fix update data source & block update endpint (opensearch-project#2364)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* MD datasource management-datasource table-UTs (opensearch-project#2350)

Signed-off-by: Yibo Wang <[email protected]>

Signed-off-by: Yibo Wang <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* reafctor based on PR 2334 comments to merge to main (opensearch-project#2375)

Signed-off-by: mpabba3003 <[email protected]>

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* removing invalid urls as CI fails on link checker for inavlid urls in git (opensearch-project#2376)

Signed-off-by: mpabba3003 <[email protected]>

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Address comments

Signed-off-by: Kristen Tian <[email protected]>

* Fix DS snapshot test

Signed-off-by: Kristen Tian <[email protected]>

* Add https://test.com/ to lychee exclude

Signed-off-by: Kristen Tian <[email protected]>

* Address comments

Signed-off-by: Kristen Tian <[email protected]>

* Remove unnessacry check

Signed-off-by: Kristen Tian <[email protected]>

* Remove not needed check

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>
Signed-off-by: Zhongnan Su <[email protected]>
Signed-off-by: Louis Chu <[email protected]>
Signed-off-by: Yibo Wang <[email protected]>
Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Su <[email protected]>
Co-authored-by: Louis Chu <[email protected]>
Co-authored-by: Zhongnan Su <[email protected]>
Co-authored-by: Yan Zeng <[email protected]>
Co-authored-by: Manideep Pabba <[email protected]>
Co-authored-by: Yibo Wang <[email protected]>
sipopo pushed a commit to sipopo/OpenSearch-Dashboards that referenced this pull request Dec 16, 2022
* Instantiate credential management plugin code structure (opensearch-project#1996)

Signed-off-by: Kristen Tian <[email protected]>

* Data source inside stack management setup (opensearch-project#2017) (opensearch-project#2030)

Signed-off-by: Kristen Tian <[email protected]>

* enable CI for feature branch (opensearch-project#2010)

Signed-off-by: Zhongnan Su <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Add empty data source plugin (opensearch-project#2052)

Adds empty data source plugin.

Signed-off-by: Kristen Tian <[email protected]>

* [MD] Add initial credential management CRUD pages (opensearch-project#2040)

* Add credential management CRUD pages

1. List all credentials
2. Create your saved credential
3. Edit your credential
4. Delete credentials

Signed-off-by: Louis Chu <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Register Data source to savedObject & Update license header (opensearch-project#2037)

Signed-off-by: Kristen Tian <[email protected]>

* Move credential saved object to data source plugin (opensearch-project#2062)

Signed-off-by: Louis Chu <[email protected]>

Move credential saved object to data source plugin
Resolve follow up comments on UI

Signed-off-by: Kristen Tian <[email protected]>

* breadcrumbfix for datasource management (opensearch-project#2066)

* breadcrumbfix for datasource management

Signed-off-by: mpabba3003 <[email protected]>

* breadcrumbfix for datasource management - refactoring code

Signed-off-by: mpabba3003 <[email protected]>

* using services to update breadcrumb on data sources management page

Signed-off-by: mpabba3003 <[email protected]>

* Changing the license header on breadcrumbs.ts datasource management

Signed-off-by: Kristen Tian <[email protected]>

* Fix breadcrumb on listing page and update saved object mapping (opensearch-project#2069)

Signed-off-by: Louis Chu <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Add data source step into IndexPattern with Mock switch (opensearch-project#2064) (opensearch-project#2086)

Signed-off-by: Kristen Tian <[email protected]>

* Add delete button for credential detailed page (opensearch-project#2067)

Signed-off-by: Yibo Wang <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Link datasource to indexpattern (opensearch-project#2118)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* Add encrypt/decrypt module on data source plugin (opensearch-project#2120)

Signed-off-by: Louis Chu <[email protected]>

1. Add encrypt/decrypt module with UT
2. Add client factory wrapper for encrypt credential
3. Add encryption config support
4. Bugfix on Jest interpret Buffer

Signed-off-by: Kristen Tian <[email protected]>

* Integrate index pattern with new data client (opensearch-project#2146)

Signed-off-by: Kristen Tian <[email protected]>

* Add noAuth to dataSource attributes (opensearch-project#2154)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* [MD] Datasource Management - creation & listing - UI only (opensearch-project#2128)

* data source management - creation & Listing UI only

* data source management - creation & Listing UI only

* Create/edit data source feature

* toggling default value

* refactoring code as per review comments

* toggling server flag to false

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Apply dataSource plugin as dependent for cm and dsm plugins (opensearch-project#2150)

Signed-off-by: Louis Chu <[email protected]>

Apply dataSource plugin as dependent for cm and dsm plugins (opensearch-project#2150)

Signed-off-by: Kristen Tian <[email protected]>

* Leverage datasource enablement in index pattern management

Signed-off-by: Kristen Tian <[email protected]>

* [MD] Add client management module and register `getClient()` to route handler context (opensearch-project#2121)

* Add client management module and register `getClient()` interface to route handler context
Signed-off-by: Zhongnan Su <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Make step info in index pattern creation dynamic (opensearch-project#2164)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* Refactor for credential listing page & add loading effect (opensearch-project#2142)

Signed-off-by: Yibo Wang <[email protected]>

Signed-off-by: Yibo Wang <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Integration sequal - replace data client placeholders (opensearch-project#2167)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* Integrate with crypto module to decrpt password (opensearch-project#2170)

Signed-off-by: Zhongnan Su <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* [MD] noAuth integration, credential & endpoint validation (opensearch-project#2165)

* noAuth integration, credential & endpoint validation

Signed-off-by: mpabba3003 <[email protected]>

* Refactoring validation message

Signed-off-by: mpabba3003 <[email protected]>

* Adding back accidentally deleted file home/tutorials/haproxy_metrics/index.ts

Signed-off-by: mpabba3003 <[email protected]>

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* [MD] Refactor search strategy to conditionally user datasource client (opensearch-project#2171)

Signed-off-by: Kristen Tian <[email protected]>

* adding relation between credential selection and no auth checkbox (opensearch-project#2175)

Signed-off-by: mpabba3003 <[email protected]>

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Update getIndicesViaSearch with datasource (opensearch-project#2176)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* Add null header to child client spawn (opensearch-project#2188)

Signed-off-by: Su <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* [MD][IP]Update button position & Add UT & Add skip option (opensearch-project#2195)

* Add UT - index pattern related

Signed-off-by: Kristen Tian <[email protected]>

* Update button position

Signed-off-by: Kristen Tian <[email protected]>

* Add skip option to allow use default os data source

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* [MD]Refactor layout and validate input fields for listing and create pages (opensearch-project#2202)

Signed-off-by: Louis Chu <[email protected]>

Signed-off-by: Louis Chu <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Enable datasource link in saveObjectManagement (opensearch-project#2209)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* Update configure data source per UX input (opensearch-project#2235)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* Enable data source audit log to file (opensearch-project#2215)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* [MD] Refactor of credential editing page layout & refactor backend field validation method (opensearch-project#2222)

* Refactor of credential editing page layout & refactor backend field validation method

* Resolved the comments & fix the multiple call for one operation

Signed-off-by: Yibo Wang <[email protected]>

Signed-off-by: Yibo Wang <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Tweak fetch data back to original (opensearch-project#2238)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* [MD] Revamped UX for data source management (opensearch-project#2239)

* revamped UX for data source management

Signed-off-by: mpabba3003 <[email protected]>

* refactored datasource screens as per PR comments

Signed-off-by: mpabba3003 <[email protected]>

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* [MD] Credentials security redesign (opensearch-project#2253)

1. Data model changes for data source saved object
2. Server side changes for data source saved object
  a. Implement data_source_saved_objects_client_wrapper to integrate with CryptographyClient for password
  encryption / decryption.
  b. Change data_source_service to fetch credentials directly from data source (still decrypt via CryptographyClient)
  c. Fix unit tests accordingly

Signed-off-by: Louis Chu <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Add step data source UI test (opensearch-project#2264)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* [MD]Improve datasource server side error handling (opensearch-project#2236)

Signed-off-by: Su <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* [MD] Datasource management new API change integrations (opensearch-project#2282)

* changing datasource management design to integrate with new API changes

Signed-off-by: mpabba3003 <[email protected]>

* Update edit_data_source_form.tsx

moving masked password to constants

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Update stream test to bypass CI env generate domain attribute

Signed-off-by: Kristen Tian <[email protected]>

* Delete credential management

Signed-off-by: Kristen Tian <[email protected]>

* Address comments

Signed-off-by: Kristen Tian <[email protected]>

* [MD] Datasource Management - Create data source - Unit tests (opensearch-project#2341)

* Unit test cases for data source management - create

Signed-off-by: mpabba3003 <[email protected]>

* adding tests to utils.ts & changing it to test

Signed-off-by: mpabba3003 <[email protected]>

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Fix update data source & block update endpint (opensearch-project#2364)

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>

* MD datasource management-datasource table-UTs (opensearch-project#2350)

Signed-off-by: Yibo Wang <[email protected]>

Signed-off-by: Yibo Wang <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* reafctor based on PR 2334 comments to merge to main (opensearch-project#2375)

Signed-off-by: mpabba3003 <[email protected]>

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* removing invalid urls as CI fails on link checker for inavlid urls in git (opensearch-project#2376)

Signed-off-by: mpabba3003 <[email protected]>

Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Kristen Tian <[email protected]>

* Address comments

Signed-off-by: Kristen Tian <[email protected]>

* Fix DS snapshot test

Signed-off-by: Kristen Tian <[email protected]>

* Add https://test.com/ to lychee exclude

Signed-off-by: Kristen Tian <[email protected]>

* Address comments

Signed-off-by: Kristen Tian <[email protected]>

* Remove unnessacry check

Signed-off-by: Kristen Tian <[email protected]>

* Remove not needed check

Signed-off-by: Kristen Tian <[email protected]>

Signed-off-by: Kristen Tian <[email protected]>
Signed-off-by: Zhongnan Su <[email protected]>
Signed-off-by: Louis Chu <[email protected]>
Signed-off-by: Yibo Wang <[email protected]>
Signed-off-by: mpabba3003 <[email protected]>
Signed-off-by: Su <[email protected]>
Co-authored-by: Louis Chu <[email protected]>
Co-authored-by: Zhongnan Su <[email protected]>
Co-authored-by: Yan Zeng <[email protected]>
Co-authored-by: Manideep Pabba <[email protected]>
Co-authored-by: Yibo Wang <[email protected]>
Signed-off-by: Sergey V. Osipov <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
multiple datasource multiple datasource project
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants