Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Mirror Gateway document #2207

Merged

Conversation

hlts2
Copy link
Collaborator

@hlts2 hlts2 commented Oct 12, 2023

Description:

This PR contains the following changes

  • Add overview documentation of the continuous process
  • Add troubleshooting document for mirror gateway status
  • Delete Advertise RPC document

Related Issue:

Versions:

  • Go Version: 1.21.1
  • Docker Version: 20.10.8
  • Kubernetes Version: v1.28.2
  • NGT Version: 2.1.3

Checklist:

Special notes for your reviewer:

@vdaas-ci
Copy link
Collaborator

[CHATOPS:HELP] ChatOps commands.

  • 🙆‍♀️ /approve - approve
  • 🍱 /format - format codes and add licenses
  • /gen-test - generate test codes
  • 🏷️ /label - add labels
  • 🔚 2️⃣ 🔚 /label actions/e2e-deploy - run E2E deploy & integration test

docs/overview/component/mirror-gateway.md Outdated Show resolved Hide resolved
docs/overview/component/mirror-gateway.md Outdated Show resolved Hide resolved
docs/overview/component/mirror-gateway.md Outdated Show resolved Hide resolved
docs/overview/component/mirror-gateway.md Outdated Show resolved Hide resolved
docs/overview/component/mirror-gateway.md Outdated Show resolved Hide resolved
docs/overview/component/mirror-gateway.md Outdated Show resolved Hide resolved
docs/overview/component/mirror-gateway.md Outdated Show resolved Hide resolved
docs/overview/component/mirror-gateway.md Outdated Show resolved Hide resolved
docs/user-guides/mirroring-configuration.md Show resolved Hide resolved
Signed-off-by: hlts2 <[email protected]>
@cloudflare-workers-and-pages
Copy link

cloudflare-workers-and-pages bot commented Oct 12, 2023

Deploying with  Cloudflare Pages  Cloudflare Pages

Latest commit: ba053d7
Status: ✅  Deploy successful!
Preview URL: https://ff76843f.vald.pages.dev
Branch Preview URL: https://feature-mirror-update-docs.vald.pages.dev

View logs

docs/overview/component/mirror-gateway.md Outdated Show resolved Hide resolved
docs/overview/component/mirror-gateway.md Outdated Show resolved Hide resolved
docs/overview/component/mirror-gateway.md Outdated Show resolved Hide resolved
docs/overview/component/mirror-gateway.md Outdated Show resolved Hide resolved
docs/overview/component/mirror-gateway.md Outdated Show resolved Hide resolved
docs/overview/component/mirror-gateway.md Outdated Show resolved Hide resolved
docs/overview/component/mirror-gateway.md Outdated Show resolved Hide resolved
docs/overview/component/mirror-gateway.md Outdated Show resolved Hide resolved
docs/overview/component/mirror-gateway.md Outdated Show resolved Hide resolved
docs/overview/component/mirror-gateway.md Outdated Show resolved Hide resolved
hlts2 and others added 4 commits October 16, 2023 11:14
This commit fixes the style issues introduced in 2c492f7 according to the output
from Gofumpt and Prettier.

Details: #2207
docs/troubleshooting/mirror-gateway.md Outdated Show resolved Hide resolved
docs/troubleshooting/mirror-gateway.md Outdated Show resolved Hide resolved
Signed-off-by: hlts2 <[email protected]>
@hlts2 hlts2 self-assigned this Oct 16, 2023
@hlts2 hlts2 requested a review from a team October 16, 2023 07:42
@hlts2 hlts2 requested review from kmrmt, ykadowak, kpango and vankichi and removed request for a team October 16, 2023 07:42
@hlts2 hlts2 requested a review from datelier October 16, 2023 08:00
@vankichi vankichi merged commit 9661fc3 into feature/mirror-gateway-definition Nov 8, 2023
9 checks passed
@vankichi vankichi deleted the feature/mirror/update-docs branch November 8, 2023 07:08
hlts2 added a commit that referenced this pull request Jan 19, 2024
* add mirror definition and update proto dependencies

Signed-off-by: hlts2 <[email protected]>

* Add mirror gateway component (#1949)

* add mirror component

Signed-off-by: hlts2 <[email protected]>

* fix mirror dockerfile path

Signed-off-by: hlts2 <[email protected]>

* fix deepsource warning

Signed-off-by: hlts2 <[email protected]>

* fix insert rpc handler

Signed-off-by: hlts2 <[email protected]>

* deleted unused file

Signed-off-by: hlts2 <[email protected]>

* fix api resource name

Signed-off-by: hlts2 <[email protected]>

* add mirror service and fix handler logic

Signed-off-by: hlts2 <[email protected]>

* fix values and helm template for new configuration

Signed-off-by: hlts2 <[email protected]>

* Format code with gofumpt and prettier

* fix template rendering bug of mirror configmap

Signed-off-by: hlts2 <[email protected]>

* fix nil pointer error

Signed-off-by: hlts2 <[email protected]>

* bugfix to advertize different address

Signed-off-by: hlts2 <[email protected]>

* returns error when there is no other mirror gateways

Signed-off-by: hlts2 <[email protected]>

* add info log

Signed-off-by: hlts2 <[email protected]>

* extract only mirror addresses

Signed-off-by: hlts2 <[email protected]>

* fix log variable

Signed-off-by: hlts2 <[email protected]>

* add logging

Signed-off-by: hlts2 <[email protected]>

* bugfix mirror connection logic

Signed-off-by: hlts2 <[email protected]>

* add remove api proxy implementation

Signed-off-by: hlts2 <[email protected]>

* add error handling for register API

Signed-off-by: hlts2 <[email protected]>

* fix debug message

Signed-off-by: hlts2 <[email protected]>

* refactor discover logic

Signed-off-by: hlts2 <[email protected]>

* refactor

Signed-off-by: hlts2 <[email protected]>

* add remove api

Signed-off-by: hlts2 <[email protected]>

* Format code with prettier and gofumpt

* add remove api and remove api rollback logic

Signed-off-by: hlts2 <[email protected]>

* refactor

Signed-off-by: hlts2 <[email protected]>

* add update rpc handler

Signed-off-by: hlts2 <[email protected]>

* refactor context variable for grpc method

Signed-off-by: hlts2 <[email protected]>

* fix trace span name

Signed-off-by: hlts2 <[email protected]>

* add getObjects method

Signed-off-by: hlts2 <[email protected]>

* refactor update and remove handler

Signed-off-by: hlts2 <[email protected]>

* Apply suggestions from code review

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* add multi handler implementation

Signed-off-by: hlts2 <[email protected]>

* fix mirror client trace span

Signed-off-by: hlts2 <[email protected]>

* rename discover service to mirror service

Signed-off-by: hlts2 <[email protected]>

* fix build error of bidirectional stream

Signed-off-by: hlts2 <[email protected]>

* add more error handling to search handler

Signed-off-by: hlts2 <[email protected]>

* add debug comment

Signed-off-by: hlts2 <[email protected]>

* add status code log

Signed-off-by: hlts2 <[email protected]>

* add status code log

Signed-off-by: hlts2 <[email protected]>

* add status code log

Signed-off-by: hlts2 <[email protected]>

* fix named return bug

Signed-off-by: hlts2 <[email protected]>

* add debug log

Signed-off-by: hlts2 <[email protected]>

* add debug command

Signed-off-by: hlts2 <[email protected]>

* add debug command

Signed-off-by: hlts2 <[email protected]>

* add debug command

Signed-off-by: hlts2 <[email protected]>

* add force status wrap

Signed-off-by: hlts2 <[email protected]>

* execute upsert method to local cluster's lb

Signed-off-by: hlts2 <[email protected]>

* add target debug log

Signed-off-by: hlts2 <[email protected]>

* fix delete unwrap of circuitbreaker

Signed-off-by: hlts2 <[email protected]>

* refactor error handling for new status parse function

Signed-off-by: hlts2 <[email protected]>

* Format code with prettier and gofumpt

* refactor error handling

Signed-off-by: hlts2 <[email protected]>

* style: Format code with prettier and gofumpt

* fix error handling for broadcast operation of getobject

Signed-off-by: hlts2 <[email protected]>

* fix error join bug of getobject

Signed-off-by: hlts2 <[email protected]>

* refactor

Signed-off-by: hlts2 <[email protected]>

* deleted unused code

Signed-off-by: hlts2 <[email protected]>

* fix status handling and add address to resource name

Signed-off-by: hlts2 <[email protected]>

* use vald client for update operation

Signed-off-by: hlts2 <[email protected]>

* add rollback test for mirror crud

Signed-off-by: hlts2 <[email protected]>

* style: Format code with prettier and gofumpt

* fix variable name

Signed-off-by: hlts2 <[email protected]>

* refactor mirror servie

Signed-off-by: hlts2 <[email protected]>

* deleted unused code

Signed-off-by: hlts2 <[email protected]>

* fix trace attribute and refactor variable name

Signed-off-by: hlts2 <[email protected]>

* add error handling when crud rpc fails

Signed-off-by: hlts2 <[email protected]>

* deleted unused value

Signed-off-by: hlts2 <[email protected]>

* make format

Signed-off-by: hlts2 <[email protected]>

* Revert "make format"

This reverts commit f605563.

* Apply suggestions from code review

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* apply suggestion

Signed-off-by: hlts2 <[email protected]>

* bugfix and refactor mirror client

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
Co-authored-by: Kiichiro YUKAWA <[email protected]>

* Rename ip to host of proto payload field for mirror gateway (#2031)

* fix field name and yaml indent

Signed-off-by: hlts2 <[email protected]>

* make proto/add format

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>

* make proto/add & make format

Signed-off-by: hlts2 <[email protected]>

* fix docker build for mirror

Signed-off-by: hlts2 <[email protected]>

* Revert "fix docker build for mirror"

This reverts commit 53ab94f.

* fix docker build error for mirror gateway

Signed-off-by: hlts2 <[email protected]>

* Add Custom Resource for mirror target (#2023)

* add mirror definition and update proto dependencies

Signed-off-by: hlts2 <[email protected]>

* Add mirror gateway component (#1949)

* add mirror component

Signed-off-by: hlts2 <[email protected]>

* fix mirror dockerfile path

Signed-off-by: hlts2 <[email protected]>

* fix deepsource warning

Signed-off-by: hlts2 <[email protected]>

* fix insert rpc handler

Signed-off-by: hlts2 <[email protected]>

* deleted unused file

Signed-off-by: hlts2 <[email protected]>

* fix api resource name

Signed-off-by: hlts2 <[email protected]>

* add mirror service and fix handler logic

Signed-off-by: hlts2 <[email protected]>

* fix values and helm template for new configuration

Signed-off-by: hlts2 <[email protected]>

* Format code with gofumpt and prettier

* fix template rendering bug of mirror configmap

Signed-off-by: hlts2 <[email protected]>

* fix nil pointer error

Signed-off-by: hlts2 <[email protected]>

* bugfix to advertize different address

Signed-off-by: hlts2 <[email protected]>

* returns error when there is no other mirror gateways

Signed-off-by: hlts2 <[email protected]>

* add info log

Signed-off-by: hlts2 <[email protected]>

* extract only mirror addresses

Signed-off-by: hlts2 <[email protected]>

* fix log variable

Signed-off-by: hlts2 <[email protected]>

* add logging

Signed-off-by: hlts2 <[email protected]>

* bugfix mirror connection logic

Signed-off-by: hlts2 <[email protected]>

* add remove api proxy implementation

Signed-off-by: hlts2 <[email protected]>

* add error handling for register API

Signed-off-by: hlts2 <[email protected]>

* fix debug message

Signed-off-by: hlts2 <[email protected]>

* refactor discover logic

Signed-off-by: hlts2 <[email protected]>

* refactor

Signed-off-by: hlts2 <[email protected]>

* add remove api

Signed-off-by: hlts2 <[email protected]>

* Format code with prettier and gofumpt

* add remove api and remove api rollback logic

Signed-off-by: hlts2 <[email protected]>

* refactor

Signed-off-by: hlts2 <[email protected]>

* add update rpc handler

Signed-off-by: hlts2 <[email protected]>

* refactor context variable for grpc method

Signed-off-by: hlts2 <[email protected]>

* fix trace span name

Signed-off-by: hlts2 <[email protected]>

* add getObjects method

Signed-off-by: hlts2 <[email protected]>

* refactor update and remove handler

Signed-off-by: hlts2 <[email protected]>

* Apply suggestions from code review

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* add multi handler implementation

Signed-off-by: hlts2 <[email protected]>

* fix mirror client trace span

Signed-off-by: hlts2 <[email protected]>

* rename discover service to mirror service

Signed-off-by: hlts2 <[email protected]>

* fix build error of bidirectional stream

Signed-off-by: hlts2 <[email protected]>

* add more error handling to search handler

Signed-off-by: hlts2 <[email protected]>

* add debug comment

Signed-off-by: hlts2 <[email protected]>

* add status code log

Signed-off-by: hlts2 <[email protected]>

* add status code log

Signed-off-by: hlts2 <[email protected]>

* add status code log

Signed-off-by: hlts2 <[email protected]>

* fix named return bug

Signed-off-by: hlts2 <[email protected]>

* add debug log

Signed-off-by: hlts2 <[email protected]>

* add debug command

Signed-off-by: hlts2 <[email protected]>

* add debug command

Signed-off-by: hlts2 <[email protected]>

* add debug command

Signed-off-by: hlts2 <[email protected]>

* add force status wrap

Signed-off-by: hlts2 <[email protected]>

* execute upsert method to local cluster's lb

Signed-off-by: hlts2 <[email protected]>

* add target debug log

Signed-off-by: hlts2 <[email protected]>

* fix delete unwrap of circuitbreaker

Signed-off-by: hlts2 <[email protected]>

* refactor error handling for new status parse function

Signed-off-by: hlts2 <[email protected]>

* Format code with prettier and gofumpt

* refactor error handling

Signed-off-by: hlts2 <[email protected]>

* style: Format code with prettier and gofumpt

* fix error handling for broadcast operation of getobject

Signed-off-by: hlts2 <[email protected]>

* fix error join bug of getobject

Signed-off-by: hlts2 <[email protected]>

* refactor

Signed-off-by: hlts2 <[email protected]>

* deleted unused code

Signed-off-by: hlts2 <[email protected]>

* fix status handling and add address to resource name

Signed-off-by: hlts2 <[email protected]>

* use vald client for update operation

Signed-off-by: hlts2 <[email protected]>

* add rollback test for mirror crud

Signed-off-by: hlts2 <[email protected]>

* style: Format code with prettier and gofumpt

* fix variable name

Signed-off-by: hlts2 <[email protected]>

* refactor mirror servie

Signed-off-by: hlts2 <[email protected]>

* deleted unused code

Signed-off-by: hlts2 <[email protected]>

* fix trace attribute and refactor variable name

Signed-off-by: hlts2 <[email protected]>

* add error handling when crud rpc fails

Signed-off-by: hlts2 <[email protected]>

* deleted unused value

Signed-off-by: hlts2 <[email protected]>

* make format

Signed-off-by: hlts2 <[email protected]>

* Revert "make format"

This reverts commit f605563.

* Apply suggestions from code review

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* apply suggestion

Signed-off-by: hlts2 <[email protected]>

* bugfix and refactor mirror client

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
Co-authored-by: Kiichiro YUKAWA <[email protected]>

* add discovery logic for other mirror target

Signed-off-by: hlts2 <[email protected]>

* add k8s template file

Signed-off-by: hlts2 <[email protected]>

* add crd for mirror target resource

Signed-off-by: hlts2 <[email protected]>

* add new values for mirror discovery logic

Signed-off-by: hlts2 <[email protected]>

* style: Format code with gofumpt and prettier

* fix schema register error and fix manifest to multi vald cluster

Signed-off-by: hlts2 <[email protected]>

* style: Format code with gofumpt and prettier

* bugfix: adapt the service account and add early return

Signed-off-by: hlts2 <[email protected]>

* bugfix: usage of errors join

Signed-off-by: hlts2 <[email protected]>

* bugfix: type conversion bug

Signed-off-by: hlts2 <[email protected]>

* fix metadata hash logic and add mirror group function

Signed-off-by: hlts2 <[email protected]>

* add status handling for network connection

Signed-off-by: hlts2 <[email protected]>

* refactoring

Signed-off-by: hlts2 <[email protected]>

* bugfix: status update handling

Signed-off-by: hlts2 <[email protected]>

* bugfix: update status using status writer

Signed-off-by: hlts2 <[email protected]>

* add status timestamp

Signed-off-by: hlts2 <[email protected]>

* fix yaml field format

Signed-off-by: hlts2 <[email protected]>

* improve status changes handling

Signed-off-by: hlts2 <[email protected]>

* reduced number of status updates

Signed-off-by: hlts2 <[email protected]>

* added status check handling before changing status

Signed-off-by: hlts2 <[email protected]>

* update vald mirror target definition and add new cluster role

Signed-off-by: hlts2 <[email protected]>

* style: Format code with gofumpt and prettier

* deploy multiple vald clusters and mirror target resource to connect with each other

Signed-off-by: hlts2 <[email protected]>

* fix e2d test to mirror-gateway and crd view field

Signed-off-by: hlts2 <[email protected]>

* define mirror app name

Signed-off-by: hlts2 <[email protected]>

* deleted unused code

Signed-off-by: hlts2 <[email protected]>

* fix golangci warning

Signed-off-by: hlts2 <[email protected]>

* crd generate command for mirror target using mirror-target-values

Signed-off-by: hlts2 <[email protected]>

* add string field validation

Signed-off-by: hlts2 <[email protected]>

* fix build error

Signed-off-by: hlts2 <[email protected]>

* add configuration comment

Signed-off-by: hlts2 <[email protected]>

* style: Format code with gofumpt and prettier

* add image tag for debug

Signed-off-by: hlts2 <[email protected]>

* fix rebase error

Signed-off-by: hlts2 <[email protected]>

* fix wait timeout option

Signed-off-by: hlts2 <[email protected]>

* add new option to set mirror address

Signed-off-by: hlts2 <[email protected]>

* add new comment

Signed-off-by: hlts2 <[email protected]>

* bugfix for ingress configuration

Signed-off-by: hlts2 <[email protected]>

* not create lb ingress when mirror is enabled

Signed-off-by: hlts2 <[email protected]>

* not create filter ingress when mirror is enabled

Signed-off-by: hlts2 <[email protected]>

* add error handling for unimplemented codes error

Signed-off-by: hlts2 <[email protected]>

* bugfix register addr process

Signed-off-by: hlts2 <[email protected]>

* fix build error

Signed-off-by: hlts2 <[email protected]>

* Revert "update docker file for build error"

This reverts commit f40986d.

* add new package for docker build error

Signed-off-by: hlts2 <[email protected]>

* Add mirror gateway example (#2082)

* add example code

Signed-off-by: hlts2 <[email protected]>

* execute search and getobject request to all vald clusters

Signed-off-by: hlts2 <[email protected]>

* fixed to send data to each cluster based on the dataset

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>

* add mirror target metrics

Signed-off-by: hlts2 <[email protected]>

* fix example ngt dimension

Signed-off-by: hlts2 <[email protected]>

* make proto/all & make format

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
Co-authored-by: Kiichiro YUKAWA <[email protected]>

* fix mirror image tag

Signed-off-by: hlts2 <[email protected]>

* Add mirror gateway document (#2105)

* add mirror document

Signed-off-by: hlts2 <[email protected]>

* fix svg to png

Signed-off-by: hlts2 <[email protected]>

* Update docs/api/mirror-gateway.md

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* Update docs/api/mirror-gateway.md

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* Update docs/api/mirror-gateway.md

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* style: Format code with prettier and gofumpt

* Update docs/overview/component/mirror-gateway.md

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* Apply suggestions from code review

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* style: Format code with prettier and gofumpt

* Apply suggestions from code review

* Update docs/overview/component/mirror-gateway.md

* fix expand bug for mirror tutorial

Signed-off-by: hlts2 <[email protected]>

* style: Format code with prettier and gofumpt

* fix filename typo

Signed-off-by: hlts2 <[email protected]>

* add new link

Signed-off-by: hlts2 <[email protected]>

* add cluster role settings for mirror gateway

Signed-off-by: hlts2 <[email protected]>

* add hdf5 installation section

Signed-off-by: hlts2 <[email protected]>

* Update docs/user-guides/mirroring-configuration.md

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* update link

Signed-off-by: hlts2 <[email protected]>

* delete quote

Signed-off-by: hlts2 <[email protected]>

* update mirror component overview image

Signed-off-by: hlts2 <[email protected]>

* update mirror component overview image

Signed-off-by: hlts2 <[email protected]>

* Update docs/overview/component/mirror-gateway.md

Co-authored-by: Kevin Diu <[email protected]>

* Update docs/overview/component/mirror-gateway.md

* Update docs/api/mirror-gateway.md

Co-authored-by: Yusuke Kadowaki <[email protected]>

* Update docs/api/mirror-gateway.md

* Update docs/user-guides/mirroring-configuration.md

Co-authored-by: Kevin Diu <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>
Co-authored-by: Kiichiro YUKAWA <[email protected]>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
Co-authored-by: Kevin Diu <[email protected]>
Co-authored-by: Yusuke Kadowaki <[email protected]>

* merge ingress configuration for lb and filter

Signed-off-by: hlts2 <[email protected]>

* fix duplicate definition error

Signed-off-by: hlts2 <[email protected]>

* make proto/all & make schema update & make format

Signed-off-by: hlts2 <[email protected]>

* fix test execution error for mirror handler

Signed-off-by: hlts2 <[email protected]>

* make proto/all format and update schema and fails build error

Signed-off-by: hlts2 <[email protected]>

* use resuable workflow to build mirror image

Signed-off-by: hlts2 <[email protected]>

* use internal sync package and refactor

Signed-off-by: hlts2 <[email protected]>

* fix error handling

Signed-off-by: hlts2 <[email protected]>

* add network policy settings and update deploy command

Signed-off-by: hlts2 <[email protected]>

* add default setting logic

Signed-off-by: hlts2 <[email protected]>

* add new fileld to crd schema and update crd

Signed-off-by: hlts2 <[email protected]>

* fix make command to deploy vald with mirror components

Signed-off-by: hlts2 <[email protected]>

* add e2e test for mirror

Signed-off-by: hlts2 <[email protected]>

* add debug command to get pod status

Signed-off-by: hlts2 <[email protected]>

* bugfix command

Signed-off-by: hlts2 <[email protected]>

* disable sidecar e2e and add mirror e2e command

Signed-off-by: hlts2 <[email protected]>

* update cluster role

Signed-off-by: hlts2 <[email protected]>

* add cluster-info dump command

Signed-off-by: hlts2 <[email protected]>

* Revert "add cluster-info dump command"

This reverts commit 7ece16f.

* debug: add logs command

Signed-off-by: hlts2 <[email protected]>

* Revert "debug: add logs command"

This reverts commit 454eaf3.

* add RemoveByTimestamp for mirror

Signed-off-by: hlts2 <[email protected]>

* fix: update sleep time for operator deploy

Signed-off-by: hlts2 <[email protected]>

* update wait time for vmt

Signed-off-by: hlts2 <[email protected]>

* Returns all connection information in the registration rpc (#2199)

* fix: returns all connection information in the registration rpc

Signed-off-by: hlts2 <[email protected]>

* fix: lint warnning

Signed-off-by: hlts2 <[email protected]>

* refactor: deleted unnecessary parameter

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>

* Add handler logic to continue processing (#2204)

* feat: add new crud logic

Signed-off-by: hlts2 <[email protected]>

* refactor code

Signed-off-by: hlts2 <[email protected]>

* refactor: error handling logic

Signed-off-by: hlts2 <[email protected]>

* fix: bugfix error handling for rpc

Signed-off-by: hlts2 <[email protected]>

* feat: add test for RemoveByTimestamp

Signed-off-by: hlts2 <[email protected]>

* fix: fails error test

Signed-off-by: hlts2 <[email protected]>

* refactor: test logic

Signed-off-by: hlts2 <[email protected]>

* fix: add new condition and add test case

Signed-off-by: hlts2 <[email protected]>

* refactor code

Signed-off-by: hlts2 <[email protected]>

* fix: error handling and comment

Signed-off-by: hlts2 <[email protected]>

* fix: test case name and test case order

Signed-off-by: hlts2 <[email protected]>

* fix: execute format

Signed-off-by: hlts2 <[email protected]>

* fix: add new comment

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>

* Update Mirror Gateway document (#2207)

* fix: update mirror document

Signed-off-by: hlts2 <[email protected]>

* fix: format

Signed-off-by: hlts2 <[email protected]>

* feat: add removeByTimestamp section

Signed-off-by: hlts2 <[email protected]>

* fix: grammar warning

Signed-off-by: hlts2 <[email protected]>

* fix: grammar warning and refactor document

Signed-off-by: hlts2 <[email protected]>

* fix: grammar warning

Signed-off-by: hlts2 <[email protected]>

* feat: add mirror gateway troubleshooting docs

Signed-off-by: hlts2 <[email protected]>

* style: format code with Gofumpt and Prettier

This commit fixes the style issues introduced in 2c492f7 according to the output
from Gofumpt and Prettier.

Details: #2207

* feat: add contents of troubleshooting document

Signed-off-by: hlts2 <[email protected]>

* fix: grammar warning

Signed-off-by: hlts2 <[email protected]>

* fix: grammar

Signed-off-by: hlts2 <[email protected]>

* fix: link path

Signed-off-by: hlts2 <[email protected]>

* fix: invalid link path

Signed-off-by: hlts2 <[email protected]>

* fix: refactor docs

Signed-off-by: hlts2 <[email protected]>

* fix: deleted unnecessary contents

Signed-off-by: hlts2 <[email protected]>

* fix: status handling logic document

Signed-off-by: hlts2 <[email protected]>

* fix: document refactor

Signed-off-by: hlts2 <[email protected]>

* fix: bugfix status handling document

Signed-off-by: hlts2 <[email protected]>

* fix: refactor sentence

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* feat: schema and protobuf update

Signed-off-by: hlts2 <[email protected]>

* fix: reviewdog warning and add comment

Signed-off-by: hlts2 <[email protected]>

* style: format code with Gofumpt and Prettier

This commit fixes the style issues introduced in 7d7a690 according to the output
from Gofumpt and Prettier.

Details: #2237

* fix: reviewdog warning

Signed-off-by: hlts2 <[email protected]>

* fix: reviewdog warning

Signed-off-by: hlts2 <[email protected]>

* fix: move mirror client mock definition to internal package

Signed-off-by: hlts2 <[email protected]>

* feat: add new handler base logic

Signed-off-by: hlts2 <[email protected]>

* fix: refactor stream list object rpc

Signed-off-by: hlts2 <[email protected]>

* fix: divide logic to other function

Signed-off-by: hlts2 <[email protected]>

* style: format code with Gofumpt and Prettier

This commit fixes the style issues introduced in e62a657 according to the output
from Gofumpt and Prettier.

Details: #2237

* make proto/all format

Signed-off-by: hlts2 <[email protected]>

* fix: return grpc error

Signed-off-by: hlts2 <[email protected]>

* fix: make proto/all format

Signed-off-by: hlts2 <[email protected]>

* feat: add mirror service test

Signed-off-by: hlts2 <[email protected]>

* fix: add mock definition code

Signed-off-by: hlts2 <[email protected]>

* style: format code with Gofumpt and Prettier

This commit fixes the style issues introduced in d6580ec according to the output
from Gofumpt and Prettier.

Details: #2237

* fix: use internal method

Signed-off-by: hlts2 <[email protected]>

* fix: delete Exist method because it is not needed

Signed-off-by: hlts2 <[email protected]>

* fix: use address cache insted of connectedAddr method

Signed-off-by: hlts2 <[email protected]>

* fix: make format

Signed-off-by: hlts2 <[email protected]>

* feat: improve connection management and add new test

Signed-off-by: hlts2 <[email protected]>

* fix: make format

Signed-off-by: hlts2 <[email protected]>

* fix: lint warnning

Signed-off-by: hlts2 <[email protected]>

* fix: refactor error handling

Signed-off-by: hlts2 <[email protected]>

* feat: add test for syncronizee based on address and small refactor

Signed-off-by: hlts2 <[email protected]>

* fix: improve error handling and example image tag

Signed-off-by: hlts2 <[email protected]>

* fix: schema update and format

Signed-off-by: hlts2 <[email protected]>

* Update charts/vald/values/multi-vald/dev-vald-with-mirror.yaml

* fix: lint warnning

Signed-off-by: hlts2 <[email protected]>

* style: format code with Gofumpt and Prettier

This commit fixes the style issues introduced in 4c11568 according to the output
from Gofumpt and Prettier.

Details: #2262

* fix: reviewdog warning and deepsource warning

Signed-off-by: hlts2 <[email protected]>

* feat: use new command to docker build

Signed-off-by: hlts2 <[email protected]>

* fix: make format

Signed-off-by: hlts2 <[email protected]>

* fix: update schema and format

Signed-off-by: hlts2 <[email protected]>

* fix: deleted unnecessary RPCs due to failure of previous rebasing

Signed-off-by: hlts2 <[email protected]>

* fix: proto and execute make proto/all format

Signed-off-by: hlts2 <[email protected]>

* fix: revert unnecessary changes

Signed-off-by: hlts2 <[email protected]>

* fix: make proto/all format

Signed-off-by: hlts2 <[email protected]>

* fix: deepsource warning

Signed-off-by: hlts2 <[email protected]>

* fix: deleted unnecessary code

Signed-off-by: hlts2 <[email protected]>

* fix: deepsource warning

Signed-off-by: hlts2 <[email protected]>

* fix: deepsource warning

Signed-off-by: hlts2 <[email protected]>

* fix: make proto/all format

Signed-off-by: hlts2 <[email protected]>

* fix: apply feedback for comment

Signed-off-by: hlts2 <[email protected]>

* feat: add internal hash package to generate hash value

Signed-off-by: hlts2 <[email protected]>

* fix: ignore deepsource warning

Signed-off-by: hlts2 <[email protected]>

* feat: add function and method comment

Signed-off-by: hlts2 <[email protected]>

* Update pkg/gateway/mirror/handler/grpc/handler.go

* fix: schema and proto update and format

Signed-off-by: hlts2 <[email protected]>

* feat: add ingress rule for lb and filter

Signed-off-by: hlts2 <[email protected]>

* fix: deleted wildcard path

Signed-off-by: hlts2 <[email protected]>

* fix: ingress unified into one manifest

Signed-off-by: hlts2 <[email protected]>

* fix: make format

Signed-off-by: hlts2 <[email protected]>

* fix: lb ingress port settings and small refactor

Signed-off-by: hlts2 <[email protected]>

* feat: add cluster wide ingress resource name

Signed-off-by: hlts2 <[email protected]>

* fix: add deploy ingress resource using make command

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
Co-authored-by: Kiichiro YUKAWA <[email protected]>
Co-authored-by: Kevin Diu <[email protected]>
Co-authored-by: Yusuke Kadowaki <[email protected]>
ykadowak added a commit that referenced this pull request Jan 21, 2024
* add mirror definition and update proto dependencies

Signed-off-by: hlts2 <[email protected]>

* Add mirror gateway component (#1949)

* add mirror component

Signed-off-by: hlts2 <[email protected]>

* fix mirror dockerfile path

Signed-off-by: hlts2 <[email protected]>

* fix deepsource warning

Signed-off-by: hlts2 <[email protected]>

* fix insert rpc handler

Signed-off-by: hlts2 <[email protected]>

* deleted unused file

Signed-off-by: hlts2 <[email protected]>

* fix api resource name

Signed-off-by: hlts2 <[email protected]>

* add mirror service and fix handler logic

Signed-off-by: hlts2 <[email protected]>

* fix values and helm template for new configuration

Signed-off-by: hlts2 <[email protected]>

* Format code with gofumpt and prettier

* fix template rendering bug of mirror configmap

Signed-off-by: hlts2 <[email protected]>

* fix nil pointer error

Signed-off-by: hlts2 <[email protected]>

* bugfix to advertize different address

Signed-off-by: hlts2 <[email protected]>

* returns error when there is no other mirror gateways

Signed-off-by: hlts2 <[email protected]>

* add info log

Signed-off-by: hlts2 <[email protected]>

* extract only mirror addresses

Signed-off-by: hlts2 <[email protected]>

* fix log variable

Signed-off-by: hlts2 <[email protected]>

* add logging

Signed-off-by: hlts2 <[email protected]>

* bugfix mirror connection logic

Signed-off-by: hlts2 <[email protected]>

* add remove api proxy implementation

Signed-off-by: hlts2 <[email protected]>

* add error handling for register API

Signed-off-by: hlts2 <[email protected]>

* fix debug message

Signed-off-by: hlts2 <[email protected]>

* refactor discover logic

Signed-off-by: hlts2 <[email protected]>

* refactor

Signed-off-by: hlts2 <[email protected]>

* add remove api

Signed-off-by: hlts2 <[email protected]>

* Format code with prettier and gofumpt

* add remove api and remove api rollback logic

Signed-off-by: hlts2 <[email protected]>

* refactor

Signed-off-by: hlts2 <[email protected]>

* add update rpc handler

Signed-off-by: hlts2 <[email protected]>

* refactor context variable for grpc method

Signed-off-by: hlts2 <[email protected]>

* fix trace span name

Signed-off-by: hlts2 <[email protected]>

* add getObjects method

Signed-off-by: hlts2 <[email protected]>

* refactor update and remove handler

Signed-off-by: hlts2 <[email protected]>

* Apply suggestions from code review

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* add multi handler implementation

Signed-off-by: hlts2 <[email protected]>

* fix mirror client trace span

Signed-off-by: hlts2 <[email protected]>

* rename discover service to mirror service

Signed-off-by: hlts2 <[email protected]>

* fix build error of bidirectional stream

Signed-off-by: hlts2 <[email protected]>

* add more error handling to search handler

Signed-off-by: hlts2 <[email protected]>

* add debug comment

Signed-off-by: hlts2 <[email protected]>

* add status code log

Signed-off-by: hlts2 <[email protected]>

* add status code log

Signed-off-by: hlts2 <[email protected]>

* add status code log

Signed-off-by: hlts2 <[email protected]>

* fix named return bug

Signed-off-by: hlts2 <[email protected]>

* add debug log

Signed-off-by: hlts2 <[email protected]>

* add debug command

Signed-off-by: hlts2 <[email protected]>

* add debug command

Signed-off-by: hlts2 <[email protected]>

* add debug command

Signed-off-by: hlts2 <[email protected]>

* add force status wrap

Signed-off-by: hlts2 <[email protected]>

* execute upsert method to local cluster's lb

Signed-off-by: hlts2 <[email protected]>

* add target debug log

Signed-off-by: hlts2 <[email protected]>

* fix delete unwrap of circuitbreaker

Signed-off-by: hlts2 <[email protected]>

* refactor error handling for new status parse function

Signed-off-by: hlts2 <[email protected]>

* Format code with prettier and gofumpt

* refactor error handling

Signed-off-by: hlts2 <[email protected]>

* style: Format code with prettier and gofumpt

* fix error handling for broadcast operation of getobject

Signed-off-by: hlts2 <[email protected]>

* fix error join bug of getobject

Signed-off-by: hlts2 <[email protected]>

* refactor

Signed-off-by: hlts2 <[email protected]>

* deleted unused code

Signed-off-by: hlts2 <[email protected]>

* fix status handling and add address to resource name

Signed-off-by: hlts2 <[email protected]>

* use vald client for update operation

Signed-off-by: hlts2 <[email protected]>

* add rollback test for mirror crud

Signed-off-by: hlts2 <[email protected]>

* style: Format code with prettier and gofumpt

* fix variable name

Signed-off-by: hlts2 <[email protected]>

* refactor mirror servie

Signed-off-by: hlts2 <[email protected]>

* deleted unused code

Signed-off-by: hlts2 <[email protected]>

* fix trace attribute and refactor variable name

Signed-off-by: hlts2 <[email protected]>

* add error handling when crud rpc fails

Signed-off-by: hlts2 <[email protected]>

* deleted unused value

Signed-off-by: hlts2 <[email protected]>

* make format

Signed-off-by: hlts2 <[email protected]>

* Revert "make format"

This reverts commit f605563.

* Apply suggestions from code review

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* apply suggestion

Signed-off-by: hlts2 <[email protected]>

* bugfix and refactor mirror client

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
Co-authored-by: Kiichiro YUKAWA <[email protected]>

* Rename ip to host of proto payload field for mirror gateway (#2031)

* fix field name and yaml indent

Signed-off-by: hlts2 <[email protected]>

* make proto/add format

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>

* make proto/add & make format

Signed-off-by: hlts2 <[email protected]>

* fix docker build for mirror

Signed-off-by: hlts2 <[email protected]>

* Revert "fix docker build for mirror"

This reverts commit 53ab94f.

* fix docker build error for mirror gateway

Signed-off-by: hlts2 <[email protected]>

* Add Custom Resource for mirror target (#2023)

* add mirror definition and update proto dependencies

Signed-off-by: hlts2 <[email protected]>

* Add mirror gateway component (#1949)

* add mirror component

Signed-off-by: hlts2 <[email protected]>

* fix mirror dockerfile path

Signed-off-by: hlts2 <[email protected]>

* fix deepsource warning

Signed-off-by: hlts2 <[email protected]>

* fix insert rpc handler

Signed-off-by: hlts2 <[email protected]>

* deleted unused file

Signed-off-by: hlts2 <[email protected]>

* fix api resource name

Signed-off-by: hlts2 <[email protected]>

* add mirror service and fix handler logic

Signed-off-by: hlts2 <[email protected]>

* fix values and helm template for new configuration

Signed-off-by: hlts2 <[email protected]>

* Format code with gofumpt and prettier

* fix template rendering bug of mirror configmap

Signed-off-by: hlts2 <[email protected]>

* fix nil pointer error

Signed-off-by: hlts2 <[email protected]>

* bugfix to advertize different address

Signed-off-by: hlts2 <[email protected]>

* returns error when there is no other mirror gateways

Signed-off-by: hlts2 <[email protected]>

* add info log

Signed-off-by: hlts2 <[email protected]>

* extract only mirror addresses

Signed-off-by: hlts2 <[email protected]>

* fix log variable

Signed-off-by: hlts2 <[email protected]>

* add logging

Signed-off-by: hlts2 <[email protected]>

* bugfix mirror connection logic

Signed-off-by: hlts2 <[email protected]>

* add remove api proxy implementation

Signed-off-by: hlts2 <[email protected]>

* add error handling for register API

Signed-off-by: hlts2 <[email protected]>

* fix debug message

Signed-off-by: hlts2 <[email protected]>

* refactor discover logic

Signed-off-by: hlts2 <[email protected]>

* refactor

Signed-off-by: hlts2 <[email protected]>

* add remove api

Signed-off-by: hlts2 <[email protected]>

* Format code with prettier and gofumpt

* add remove api and remove api rollback logic

Signed-off-by: hlts2 <[email protected]>

* refactor

Signed-off-by: hlts2 <[email protected]>

* add update rpc handler

Signed-off-by: hlts2 <[email protected]>

* refactor context variable for grpc method

Signed-off-by: hlts2 <[email protected]>

* fix trace span name

Signed-off-by: hlts2 <[email protected]>

* add getObjects method

Signed-off-by: hlts2 <[email protected]>

* refactor update and remove handler

Signed-off-by: hlts2 <[email protected]>

* Apply suggestions from code review

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* add multi handler implementation

Signed-off-by: hlts2 <[email protected]>

* fix mirror client trace span

Signed-off-by: hlts2 <[email protected]>

* rename discover service to mirror service

Signed-off-by: hlts2 <[email protected]>

* fix build error of bidirectional stream

Signed-off-by: hlts2 <[email protected]>

* add more error handling to search handler

Signed-off-by: hlts2 <[email protected]>

* add debug comment

Signed-off-by: hlts2 <[email protected]>

* add status code log

Signed-off-by: hlts2 <[email protected]>

* add status code log

Signed-off-by: hlts2 <[email protected]>

* add status code log

Signed-off-by: hlts2 <[email protected]>

* fix named return bug

Signed-off-by: hlts2 <[email protected]>

* add debug log

Signed-off-by: hlts2 <[email protected]>

* add debug command

Signed-off-by: hlts2 <[email protected]>

* add debug command

Signed-off-by: hlts2 <[email protected]>

* add debug command

Signed-off-by: hlts2 <[email protected]>

* add force status wrap

Signed-off-by: hlts2 <[email protected]>

* execute upsert method to local cluster's lb

Signed-off-by: hlts2 <[email protected]>

* add target debug log

Signed-off-by: hlts2 <[email protected]>

* fix delete unwrap of circuitbreaker

Signed-off-by: hlts2 <[email protected]>

* refactor error handling for new status parse function

Signed-off-by: hlts2 <[email protected]>

* Format code with prettier and gofumpt

* refactor error handling

Signed-off-by: hlts2 <[email protected]>

* style: Format code with prettier and gofumpt

* fix error handling for broadcast operation of getobject

Signed-off-by: hlts2 <[email protected]>

* fix error join bug of getobject

Signed-off-by: hlts2 <[email protected]>

* refactor

Signed-off-by: hlts2 <[email protected]>

* deleted unused code

Signed-off-by: hlts2 <[email protected]>

* fix status handling and add address to resource name

Signed-off-by: hlts2 <[email protected]>

* use vald client for update operation

Signed-off-by: hlts2 <[email protected]>

* add rollback test for mirror crud

Signed-off-by: hlts2 <[email protected]>

* style: Format code with prettier and gofumpt

* fix variable name

Signed-off-by: hlts2 <[email protected]>

* refactor mirror servie

Signed-off-by: hlts2 <[email protected]>

* deleted unused code

Signed-off-by: hlts2 <[email protected]>

* fix trace attribute and refactor variable name

Signed-off-by: hlts2 <[email protected]>

* add error handling when crud rpc fails

Signed-off-by: hlts2 <[email protected]>

* deleted unused value

Signed-off-by: hlts2 <[email protected]>

* make format

Signed-off-by: hlts2 <[email protected]>

* Revert "make format"

This reverts commit f605563.

* Apply suggestions from code review

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* apply suggestion

Signed-off-by: hlts2 <[email protected]>

* bugfix and refactor mirror client

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
Co-authored-by: Kiichiro YUKAWA <[email protected]>

* add discovery logic for other mirror target

Signed-off-by: hlts2 <[email protected]>

* add k8s template file

Signed-off-by: hlts2 <[email protected]>

* add crd for mirror target resource

Signed-off-by: hlts2 <[email protected]>

* add new values for mirror discovery logic

Signed-off-by: hlts2 <[email protected]>

* style: Format code with gofumpt and prettier

* fix schema register error and fix manifest to multi vald cluster

Signed-off-by: hlts2 <[email protected]>

* style: Format code with gofumpt and prettier

* bugfix: adapt the service account and add early return

Signed-off-by: hlts2 <[email protected]>

* bugfix: usage of errors join

Signed-off-by: hlts2 <[email protected]>

* bugfix: type conversion bug

Signed-off-by: hlts2 <[email protected]>

* fix metadata hash logic and add mirror group function

Signed-off-by: hlts2 <[email protected]>

* add status handling for network connection

Signed-off-by: hlts2 <[email protected]>

* refactoring

Signed-off-by: hlts2 <[email protected]>

* bugfix: status update handling

Signed-off-by: hlts2 <[email protected]>

* bugfix: update status using status writer

Signed-off-by: hlts2 <[email protected]>

* add status timestamp

Signed-off-by: hlts2 <[email protected]>

* fix yaml field format

Signed-off-by: hlts2 <[email protected]>

* improve status changes handling

Signed-off-by: hlts2 <[email protected]>

* reduced number of status updates

Signed-off-by: hlts2 <[email protected]>

* added status check handling before changing status

Signed-off-by: hlts2 <[email protected]>

* update vald mirror target definition and add new cluster role

Signed-off-by: hlts2 <[email protected]>

* style: Format code with gofumpt and prettier

* deploy multiple vald clusters and mirror target resource to connect with each other

Signed-off-by: hlts2 <[email protected]>

* fix e2d test to mirror-gateway and crd view field

Signed-off-by: hlts2 <[email protected]>

* define mirror app name

Signed-off-by: hlts2 <[email protected]>

* deleted unused code

Signed-off-by: hlts2 <[email protected]>

* fix golangci warning

Signed-off-by: hlts2 <[email protected]>

* crd generate command for mirror target using mirror-target-values

Signed-off-by: hlts2 <[email protected]>

* add string field validation

Signed-off-by: hlts2 <[email protected]>

* fix build error

Signed-off-by: hlts2 <[email protected]>

* add configuration comment

Signed-off-by: hlts2 <[email protected]>

* style: Format code with gofumpt and prettier

* add image tag for debug

Signed-off-by: hlts2 <[email protected]>

* fix rebase error

Signed-off-by: hlts2 <[email protected]>

* fix wait timeout option

Signed-off-by: hlts2 <[email protected]>

* add new option to set mirror address

Signed-off-by: hlts2 <[email protected]>

* add new comment

Signed-off-by: hlts2 <[email protected]>

* bugfix for ingress configuration

Signed-off-by: hlts2 <[email protected]>

* not create lb ingress when mirror is enabled

Signed-off-by: hlts2 <[email protected]>

* not create filter ingress when mirror is enabled

Signed-off-by: hlts2 <[email protected]>

* add error handling for unimplemented codes error

Signed-off-by: hlts2 <[email protected]>

* bugfix register addr process

Signed-off-by: hlts2 <[email protected]>

* fix build error

Signed-off-by: hlts2 <[email protected]>

* Revert "update docker file for build error"

This reverts commit f40986d.

* add new package for docker build error

Signed-off-by: hlts2 <[email protected]>

* Add mirror gateway example (#2082)

* add example code

Signed-off-by: hlts2 <[email protected]>

* execute search and getobject request to all vald clusters

Signed-off-by: hlts2 <[email protected]>

* fixed to send data to each cluster based on the dataset

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>

* add mirror target metrics

Signed-off-by: hlts2 <[email protected]>

* fix example ngt dimension

Signed-off-by: hlts2 <[email protected]>

* make proto/all & make format

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
Co-authored-by: Kiichiro YUKAWA <[email protected]>

* fix mirror image tag

Signed-off-by: hlts2 <[email protected]>

* Add mirror gateway document (#2105)

* add mirror document

Signed-off-by: hlts2 <[email protected]>

* fix svg to png

Signed-off-by: hlts2 <[email protected]>

* Update docs/api/mirror-gateway.md

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* Update docs/api/mirror-gateway.md

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* Update docs/api/mirror-gateway.md

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* style: Format code with prettier and gofumpt

* Update docs/overview/component/mirror-gateway.md

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* Apply suggestions from code review

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* style: Format code with prettier and gofumpt

* Apply suggestions from code review

* Update docs/overview/component/mirror-gateway.md

* fix expand bug for mirror tutorial

Signed-off-by: hlts2 <[email protected]>

* style: Format code with prettier and gofumpt

* fix filename typo

Signed-off-by: hlts2 <[email protected]>

* add new link

Signed-off-by: hlts2 <[email protected]>

* add cluster role settings for mirror gateway

Signed-off-by: hlts2 <[email protected]>

* add hdf5 installation section

Signed-off-by: hlts2 <[email protected]>

* Update docs/user-guides/mirroring-configuration.md

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* update link

Signed-off-by: hlts2 <[email protected]>

* delete quote

Signed-off-by: hlts2 <[email protected]>

* update mirror component overview image

Signed-off-by: hlts2 <[email protected]>

* update mirror component overview image

Signed-off-by: hlts2 <[email protected]>

* Update docs/overview/component/mirror-gateway.md

Co-authored-by: Kevin Diu <[email protected]>

* Update docs/overview/component/mirror-gateway.md

* Update docs/api/mirror-gateway.md

Co-authored-by: Yusuke Kadowaki <[email protected]>

* Update docs/api/mirror-gateway.md

* Update docs/user-guides/mirroring-configuration.md

Co-authored-by: Kevin Diu <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>
Co-authored-by: Kiichiro YUKAWA <[email protected]>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
Co-authored-by: Kevin Diu <[email protected]>
Co-authored-by: Yusuke Kadowaki <[email protected]>

* merge ingress configuration for lb and filter

Signed-off-by: hlts2 <[email protected]>

* fix duplicate definition error

Signed-off-by: hlts2 <[email protected]>

* make proto/all & make schema update & make format

Signed-off-by: hlts2 <[email protected]>

* fix test execution error for mirror handler

Signed-off-by: hlts2 <[email protected]>

* make proto/all format and update schema and fails build error

Signed-off-by: hlts2 <[email protected]>

* use resuable workflow to build mirror image

Signed-off-by: hlts2 <[email protected]>

* use internal sync package and refactor

Signed-off-by: hlts2 <[email protected]>

* fix error handling

Signed-off-by: hlts2 <[email protected]>

* add network policy settings and update deploy command

Signed-off-by: hlts2 <[email protected]>

* add default setting logic

Signed-off-by: hlts2 <[email protected]>

* add new fileld to crd schema and update crd

Signed-off-by: hlts2 <[email protected]>

* fix make command to deploy vald with mirror components

Signed-off-by: hlts2 <[email protected]>

* add e2e test for mirror

Signed-off-by: hlts2 <[email protected]>

* add debug command to get pod status

Signed-off-by: hlts2 <[email protected]>

* bugfix command

Signed-off-by: hlts2 <[email protected]>

* disable sidecar e2e and add mirror e2e command

Signed-off-by: hlts2 <[email protected]>

* update cluster role

Signed-off-by: hlts2 <[email protected]>

* add cluster-info dump command

Signed-off-by: hlts2 <[email protected]>

* Revert "add cluster-info dump command"

This reverts commit 7ece16f.

* debug: add logs command

Signed-off-by: hlts2 <[email protected]>

* Revert "debug: add logs command"

This reverts commit 454eaf3.

* add RemoveByTimestamp for mirror

Signed-off-by: hlts2 <[email protected]>

* fix: update sleep time for operator deploy

Signed-off-by: hlts2 <[email protected]>

* update wait time for vmt

Signed-off-by: hlts2 <[email protected]>

* Returns all connection information in the registration rpc (#2199)

* fix: returns all connection information in the registration rpc

Signed-off-by: hlts2 <[email protected]>

* fix: lint warnning

Signed-off-by: hlts2 <[email protected]>

* refactor: deleted unnecessary parameter

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>

* Add handler logic to continue processing (#2204)

* feat: add new crud logic

Signed-off-by: hlts2 <[email protected]>

* refactor code

Signed-off-by: hlts2 <[email protected]>

* refactor: error handling logic

Signed-off-by: hlts2 <[email protected]>

* fix: bugfix error handling for rpc

Signed-off-by: hlts2 <[email protected]>

* feat: add test for RemoveByTimestamp

Signed-off-by: hlts2 <[email protected]>

* fix: fails error test

Signed-off-by: hlts2 <[email protected]>

* refactor: test logic

Signed-off-by: hlts2 <[email protected]>

* fix: add new condition and add test case

Signed-off-by: hlts2 <[email protected]>

* refactor code

Signed-off-by: hlts2 <[email protected]>

* fix: error handling and comment

Signed-off-by: hlts2 <[email protected]>

* fix: test case name and test case order

Signed-off-by: hlts2 <[email protected]>

* fix: execute format

Signed-off-by: hlts2 <[email protected]>

* fix: add new comment

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>

* Update Mirror Gateway document (#2207)

* fix: update mirror document

Signed-off-by: hlts2 <[email protected]>

* fix: format

Signed-off-by: hlts2 <[email protected]>

* feat: add removeByTimestamp section

Signed-off-by: hlts2 <[email protected]>

* fix: grammar warning

Signed-off-by: hlts2 <[email protected]>

* fix: grammar warning and refactor document

Signed-off-by: hlts2 <[email protected]>

* fix: grammar warning

Signed-off-by: hlts2 <[email protected]>

* feat: add mirror gateway troubleshooting docs

Signed-off-by: hlts2 <[email protected]>

* style: format code with Gofumpt and Prettier

This commit fixes the style issues introduced in 2c492f7 according to the output
from Gofumpt and Prettier.

Details: #2207

* feat: add contents of troubleshooting document

Signed-off-by: hlts2 <[email protected]>

* fix: grammar warning

Signed-off-by: hlts2 <[email protected]>

* fix: grammar

Signed-off-by: hlts2 <[email protected]>

* fix: link path

Signed-off-by: hlts2 <[email protected]>

* fix: invalid link path

Signed-off-by: hlts2 <[email protected]>

* fix: refactor docs

Signed-off-by: hlts2 <[email protected]>

* fix: deleted unnecessary contents

Signed-off-by: hlts2 <[email protected]>

* fix: status handling logic document

Signed-off-by: hlts2 <[email protected]>

* fix: document refactor

Signed-off-by: hlts2 <[email protected]>

* fix: bugfix status handling document

Signed-off-by: hlts2 <[email protected]>

* fix: refactor sentence

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* feat: schema and protobuf update

Signed-off-by: hlts2 <[email protected]>

* fix: reviewdog warning and add comment

Signed-off-by: hlts2 <[email protected]>

* style: format code with Gofumpt and Prettier

This commit fixes the style issues introduced in 7d7a690 according to the output
from Gofumpt and Prettier.

Details: #2237

* fix: reviewdog warning

Signed-off-by: hlts2 <[email protected]>

* fix: reviewdog warning

Signed-off-by: hlts2 <[email protected]>

* fix: move mirror client mock definition to internal package

Signed-off-by: hlts2 <[email protected]>

* feat: add new handler base logic

Signed-off-by: hlts2 <[email protected]>

* fix: refactor stream list object rpc

Signed-off-by: hlts2 <[email protected]>

* fix: divide logic to other function

Signed-off-by: hlts2 <[email protected]>

* style: format code with Gofumpt and Prettier

This commit fixes the style issues introduced in e62a657 according to the output
from Gofumpt and Prettier.

Details: #2237

* make proto/all format

Signed-off-by: hlts2 <[email protected]>

* fix: return grpc error

Signed-off-by: hlts2 <[email protected]>

* fix: make proto/all format

Signed-off-by: hlts2 <[email protected]>

* feat: add mirror service test

Signed-off-by: hlts2 <[email protected]>

* fix: add mock definition code

Signed-off-by: hlts2 <[email protected]>

* style: format code with Gofumpt and Prettier

This commit fixes the style issues introduced in d6580ec according to the output
from Gofumpt and Prettier.

Details: #2237

* fix: use internal method

Signed-off-by: hlts2 <[email protected]>

* fix: delete Exist method because it is not needed

Signed-off-by: hlts2 <[email protected]>

* fix: use address cache insted of connectedAddr method

Signed-off-by: hlts2 <[email protected]>

* fix: make format

Signed-off-by: hlts2 <[email protected]>

* feat: improve connection management and add new test

Signed-off-by: hlts2 <[email protected]>

* fix: make format

Signed-off-by: hlts2 <[email protected]>

* fix: lint warnning

Signed-off-by: hlts2 <[email protected]>

* fix: refactor error handling

Signed-off-by: hlts2 <[email protected]>

* feat: add test for syncronizee based on address and small refactor

Signed-off-by: hlts2 <[email protected]>

* fix: improve error handling and example image tag

Signed-off-by: hlts2 <[email protected]>

* fix: schema update and format

Signed-off-by: hlts2 <[email protected]>

* Update charts/vald/values/multi-vald/dev-vald-with-mirror.yaml

* fix: lint warnning

Signed-off-by: hlts2 <[email protected]>

* style: format code with Gofumpt and Prettier

This commit fixes the style issues introduced in 4c11568 according to the output
from Gofumpt and Prettier.

Details: #2262

* fix: reviewdog warning and deepsource warning

Signed-off-by: hlts2 <[email protected]>

* feat: use new command to docker build

Signed-off-by: hlts2 <[email protected]>

* fix: make format

Signed-off-by: hlts2 <[email protected]>

* fix: update schema and format

Signed-off-by: hlts2 <[email protected]>

* fix: deleted unnecessary RPCs due to failure of previous rebasing

Signed-off-by: hlts2 <[email protected]>

* fix: proto and execute make proto/all format

Signed-off-by: hlts2 <[email protected]>

* fix: revert unnecessary changes

Signed-off-by: hlts2 <[email protected]>

* fix: make proto/all format

Signed-off-by: hlts2 <[email protected]>

* fix: deepsource warning

Signed-off-by: hlts2 <[email protected]>

* fix: deleted unnecessary code

Signed-off-by: hlts2 <[email protected]>

* fix: deepsource warning

Signed-off-by: hlts2 <[email protected]>

* fix: deepsource warning

Signed-off-by: hlts2 <[email protected]>

* fix: make proto/all format

Signed-off-by: hlts2 <[email protected]>

* fix: apply feedback for comment

Signed-off-by: hlts2 <[email protected]>

* feat: add internal hash package to generate hash value

Signed-off-by: hlts2 <[email protected]>

* fix: ignore deepsource warning

Signed-off-by: hlts2 <[email protected]>

* feat: add function and method comment

Signed-off-by: hlts2 <[email protected]>

* Update pkg/gateway/mirror/handler/grpc/handler.go

* fix: schema and proto update and format

Signed-off-by: hlts2 <[email protected]>

* feat: add ingress rule for lb and filter

Signed-off-by: hlts2 <[email protected]>

* fix: deleted wildcard path

Signed-off-by: hlts2 <[email protected]>

* fix: ingress unified into one manifest

Signed-off-by: hlts2 <[email protected]>

* fix: make format

Signed-off-by: hlts2 <[email protected]>

* fix: lb ingress port settings and small refactor

Signed-off-by: hlts2 <[email protected]>

* feat: add cluster wide ingress resource name

Signed-off-by: hlts2 <[email protected]>

* fix: add deploy ingress resource using make command

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
Co-authored-by: Kiichiro YUKAWA <[email protected]>
Co-authored-by: Kevin Diu <[email protected]>
Co-authored-by: Yusuke Kadowaki <[email protected]>
vankichi added a commit that referenced this pull request Jan 22, 2024
* Add mirror gateway definitions and Implementations (#2262)

* add mirror definition and update proto dependencies

Signed-off-by: hlts2 <[email protected]>

* Add mirror gateway component (#1949)

* add mirror component

Signed-off-by: hlts2 <[email protected]>

* fix mirror dockerfile path

Signed-off-by: hlts2 <[email protected]>

* fix deepsource warning

Signed-off-by: hlts2 <[email protected]>

* fix insert rpc handler

Signed-off-by: hlts2 <[email protected]>

* deleted unused file

Signed-off-by: hlts2 <[email protected]>

* fix api resource name

Signed-off-by: hlts2 <[email protected]>

* add mirror service and fix handler logic

Signed-off-by: hlts2 <[email protected]>

* fix values and helm template for new configuration

Signed-off-by: hlts2 <[email protected]>

* Format code with gofumpt and prettier

* fix template rendering bug of mirror configmap

Signed-off-by: hlts2 <[email protected]>

* fix nil pointer error

Signed-off-by: hlts2 <[email protected]>

* bugfix to advertize different address

Signed-off-by: hlts2 <[email protected]>

* returns error when there is no other mirror gateways

Signed-off-by: hlts2 <[email protected]>

* add info log

Signed-off-by: hlts2 <[email protected]>

* extract only mirror addresses

Signed-off-by: hlts2 <[email protected]>

* fix log variable

Signed-off-by: hlts2 <[email protected]>

* add logging

Signed-off-by: hlts2 <[email protected]>

* bugfix mirror connection logic

Signed-off-by: hlts2 <[email protected]>

* add remove api proxy implementation

Signed-off-by: hlts2 <[email protected]>

* add error handling for register API

Signed-off-by: hlts2 <[email protected]>

* fix debug message

Signed-off-by: hlts2 <[email protected]>

* refactor discover logic

Signed-off-by: hlts2 <[email protected]>

* refactor

Signed-off-by: hlts2 <[email protected]>

* add remove api

Signed-off-by: hlts2 <[email protected]>

* Format code with prettier and gofumpt

* add remove api and remove api rollback logic

Signed-off-by: hlts2 <[email protected]>

* refactor

Signed-off-by: hlts2 <[email protected]>

* add update rpc handler

Signed-off-by: hlts2 <[email protected]>

* refactor context variable for grpc method

Signed-off-by: hlts2 <[email protected]>

* fix trace span name

Signed-off-by: hlts2 <[email protected]>

* add getObjects method

Signed-off-by: hlts2 <[email protected]>

* refactor update and remove handler

Signed-off-by: hlts2 <[email protected]>

* Apply suggestions from code review

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* add multi handler implementation

Signed-off-by: hlts2 <[email protected]>

* fix mirror client trace span

Signed-off-by: hlts2 <[email protected]>

* rename discover service to mirror service

Signed-off-by: hlts2 <[email protected]>

* fix build error of bidirectional stream

Signed-off-by: hlts2 <[email protected]>

* add more error handling to search handler

Signed-off-by: hlts2 <[email protected]>

* add debug comment

Signed-off-by: hlts2 <[email protected]>

* add status code log

Signed-off-by: hlts2 <[email protected]>

* add status code log

Signed-off-by: hlts2 <[email protected]>

* add status code log

Signed-off-by: hlts2 <[email protected]>

* fix named return bug

Signed-off-by: hlts2 <[email protected]>

* add debug log

Signed-off-by: hlts2 <[email protected]>

* add debug command

Signed-off-by: hlts2 <[email protected]>

* add debug command

Signed-off-by: hlts2 <[email protected]>

* add debug command

Signed-off-by: hlts2 <[email protected]>

* add force status wrap

Signed-off-by: hlts2 <[email protected]>

* execute upsert method to local cluster's lb

Signed-off-by: hlts2 <[email protected]>

* add target debug log

Signed-off-by: hlts2 <[email protected]>

* fix delete unwrap of circuitbreaker

Signed-off-by: hlts2 <[email protected]>

* refactor error handling for new status parse function

Signed-off-by: hlts2 <[email protected]>

* Format code with prettier and gofumpt

* refactor error handling

Signed-off-by: hlts2 <[email protected]>

* style: Format code with prettier and gofumpt

* fix error handling for broadcast operation of getobject

Signed-off-by: hlts2 <[email protected]>

* fix error join bug of getobject

Signed-off-by: hlts2 <[email protected]>

* refactor

Signed-off-by: hlts2 <[email protected]>

* deleted unused code

Signed-off-by: hlts2 <[email protected]>

* fix status handling and add address to resource name

Signed-off-by: hlts2 <[email protected]>

* use vald client for update operation

Signed-off-by: hlts2 <[email protected]>

* add rollback test for mirror crud

Signed-off-by: hlts2 <[email protected]>

* style: Format code with prettier and gofumpt

* fix variable name

Signed-off-by: hlts2 <[email protected]>

* refactor mirror servie

Signed-off-by: hlts2 <[email protected]>

* deleted unused code

Signed-off-by: hlts2 <[email protected]>

* fix trace attribute and refactor variable name

Signed-off-by: hlts2 <[email protected]>

* add error handling when crud rpc fails

Signed-off-by: hlts2 <[email protected]>

* deleted unused value

Signed-off-by: hlts2 <[email protected]>

* make format

Signed-off-by: hlts2 <[email protected]>

* Revert "make format"

This reverts commit f605563.

* Apply suggestions from code review

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* apply suggestion

Signed-off-by: hlts2 <[email protected]>

* bugfix and refactor mirror client

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
Co-authored-by: Kiichiro YUKAWA <[email protected]>

* Rename ip to host of proto payload field for mirror gateway (#2031)

* fix field name and yaml indent

Signed-off-by: hlts2 <[email protected]>

* make proto/add format

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>

* make proto/add & make format

Signed-off-by: hlts2 <[email protected]>

* fix docker build for mirror

Signed-off-by: hlts2 <[email protected]>

* Revert "fix docker build for mirror"

This reverts commit 53ab94f.

* fix docker build error for mirror gateway

Signed-off-by: hlts2 <[email protected]>

* Add Custom Resource for mirror target (#2023)

* add mirror definition and update proto dependencies

Signed-off-by: hlts2 <[email protected]>

* Add mirror gateway component (#1949)

* add mirror component

Signed-off-by: hlts2 <[email protected]>

* fix mirror dockerfile path

Signed-off-by: hlts2 <[email protected]>

* fix deepsource warning

Signed-off-by: hlts2 <[email protected]>

* fix insert rpc handler

Signed-off-by: hlts2 <[email protected]>

* deleted unused file

Signed-off-by: hlts2 <[email protected]>

* fix api resource name

Signed-off-by: hlts2 <[email protected]>

* add mirror service and fix handler logic

Signed-off-by: hlts2 <[email protected]>

* fix values and helm template for new configuration

Signed-off-by: hlts2 <[email protected]>

* Format code with gofumpt and prettier

* fix template rendering bug of mirror configmap

Signed-off-by: hlts2 <[email protected]>

* fix nil pointer error

Signed-off-by: hlts2 <[email protected]>

* bugfix to advertize different address

Signed-off-by: hlts2 <[email protected]>

* returns error when there is no other mirror gateways

Signed-off-by: hlts2 <[email protected]>

* add info log

Signed-off-by: hlts2 <[email protected]>

* extract only mirror addresses

Signed-off-by: hlts2 <[email protected]>

* fix log variable

Signed-off-by: hlts2 <[email protected]>

* add logging

Signed-off-by: hlts2 <[email protected]>

* bugfix mirror connection logic

Signed-off-by: hlts2 <[email protected]>

* add remove api proxy implementation

Signed-off-by: hlts2 <[email protected]>

* add error handling for register API

Signed-off-by: hlts2 <[email protected]>

* fix debug message

Signed-off-by: hlts2 <[email protected]>

* refactor discover logic

Signed-off-by: hlts2 <[email protected]>

* refactor

Signed-off-by: hlts2 <[email protected]>

* add remove api

Signed-off-by: hlts2 <[email protected]>

* Format code with prettier and gofumpt

* add remove api and remove api rollback logic

Signed-off-by: hlts2 <[email protected]>

* refactor

Signed-off-by: hlts2 <[email protected]>

* add update rpc handler

Signed-off-by: hlts2 <[email protected]>

* refactor context variable for grpc method

Signed-off-by: hlts2 <[email protected]>

* fix trace span name

Signed-off-by: hlts2 <[email protected]>

* add getObjects method

Signed-off-by: hlts2 <[email protected]>

* refactor update and remove handler

Signed-off-by: hlts2 <[email protected]>

* Apply suggestions from code review

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* add multi handler implementation

Signed-off-by: hlts2 <[email protected]>

* fix mirror client trace span

Signed-off-by: hlts2 <[email protected]>

* rename discover service to mirror service

Signed-off-by: hlts2 <[email protected]>

* fix build error of bidirectional stream

Signed-off-by: hlts2 <[email protected]>

* add more error handling to search handler

Signed-off-by: hlts2 <[email protected]>

* add debug comment

Signed-off-by: hlts2 <[email protected]>

* add status code log

Signed-off-by: hlts2 <[email protected]>

* add status code log

Signed-off-by: hlts2 <[email protected]>

* add status code log

Signed-off-by: hlts2 <[email protected]>

* fix named return bug

Signed-off-by: hlts2 <[email protected]>

* add debug log

Signed-off-by: hlts2 <[email protected]>

* add debug command

Signed-off-by: hlts2 <[email protected]>

* add debug command

Signed-off-by: hlts2 <[email protected]>

* add debug command

Signed-off-by: hlts2 <[email protected]>

* add force status wrap

Signed-off-by: hlts2 <[email protected]>

* execute upsert method to local cluster's lb

Signed-off-by: hlts2 <[email protected]>

* add target debug log

Signed-off-by: hlts2 <[email protected]>

* fix delete unwrap of circuitbreaker

Signed-off-by: hlts2 <[email protected]>

* refactor error handling for new status parse function

Signed-off-by: hlts2 <[email protected]>

* Format code with prettier and gofumpt

* refactor error handling

Signed-off-by: hlts2 <[email protected]>

* style: Format code with prettier and gofumpt

* fix error handling for broadcast operation of getobject

Signed-off-by: hlts2 <[email protected]>

* fix error join bug of getobject

Signed-off-by: hlts2 <[email protected]>

* refactor

Signed-off-by: hlts2 <[email protected]>

* deleted unused code

Signed-off-by: hlts2 <[email protected]>

* fix status handling and add address to resource name

Signed-off-by: hlts2 <[email protected]>

* use vald client for update operation

Signed-off-by: hlts2 <[email protected]>

* add rollback test for mirror crud

Signed-off-by: hlts2 <[email protected]>

* style: Format code with prettier and gofumpt

* fix variable name

Signed-off-by: hlts2 <[email protected]>

* refactor mirror servie

Signed-off-by: hlts2 <[email protected]>

* deleted unused code

Signed-off-by: hlts2 <[email protected]>

* fix trace attribute and refactor variable name

Signed-off-by: hlts2 <[email protected]>

* add error handling when crud rpc fails

Signed-off-by: hlts2 <[email protected]>

* deleted unused value

Signed-off-by: hlts2 <[email protected]>

* make format

Signed-off-by: hlts2 <[email protected]>

* Revert "make format"

This reverts commit f605563.

* Apply suggestions from code review

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* apply suggestion

Signed-off-by: hlts2 <[email protected]>

* bugfix and refactor mirror client

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
Co-authored-by: Kiichiro YUKAWA <[email protected]>

* add discovery logic for other mirror target

Signed-off-by: hlts2 <[email protected]>

* add k8s template file

Signed-off-by: hlts2 <[email protected]>

* add crd for mirror target resource

Signed-off-by: hlts2 <[email protected]>

* add new values for mirror discovery logic

Signed-off-by: hlts2 <[email protected]>

* style: Format code with gofumpt and prettier

* fix schema register error and fix manifest to multi vald cluster

Signed-off-by: hlts2 <[email protected]>

* style: Format code with gofumpt and prettier

* bugfix: adapt the service account and add early return

Signed-off-by: hlts2 <[email protected]>

* bugfix: usage of errors join

Signed-off-by: hlts2 <[email protected]>

* bugfix: type conversion bug

Signed-off-by: hlts2 <[email protected]>

* fix metadata hash logic and add mirror group function

Signed-off-by: hlts2 <[email protected]>

* add status handling for network connection

Signed-off-by: hlts2 <[email protected]>

* refactoring

Signed-off-by: hlts2 <[email protected]>

* bugfix: status update handling

Signed-off-by: hlts2 <[email protected]>

* bugfix: update status using status writer

Signed-off-by: hlts2 <[email protected]>

* add status timestamp

Signed-off-by: hlts2 <[email protected]>

* fix yaml field format

Signed-off-by: hlts2 <[email protected]>

* improve status changes handling

Signed-off-by: hlts2 <[email protected]>

* reduced number of status updates

Signed-off-by: hlts2 <[email protected]>

* added status check handling before changing status

Signed-off-by: hlts2 <[email protected]>

* update vald mirror target definition and add new cluster role

Signed-off-by: hlts2 <[email protected]>

* style: Format code with gofumpt and prettier

* deploy multiple vald clusters and mirror target resource to connect with each other

Signed-off-by: hlts2 <[email protected]>

* fix e2d test to mirror-gateway and crd view field

Signed-off-by: hlts2 <[email protected]>

* define mirror app name

Signed-off-by: hlts2 <[email protected]>

* deleted unused code

Signed-off-by: hlts2 <[email protected]>

* fix golangci warning

Signed-off-by: hlts2 <[email protected]>

* crd generate command for mirror target using mirror-target-values

Signed-off-by: hlts2 <[email protected]>

* add string field validation

Signed-off-by: hlts2 <[email protected]>

* fix build error

Signed-off-by: hlts2 <[email protected]>

* add configuration comment

Signed-off-by: hlts2 <[email protected]>

* style: Format code with gofumpt and prettier

* add image tag for debug

Signed-off-by: hlts2 <[email protected]>

* fix rebase error

Signed-off-by: hlts2 <[email protected]>

* fix wait timeout option

Signed-off-by: hlts2 <[email protected]>

* add new option to set mirror address

Signed-off-by: hlts2 <[email protected]>

* add new comment

Signed-off-by: hlts2 <[email protected]>

* bugfix for ingress configuration

Signed-off-by: hlts2 <[email protected]>

* not create lb ingress when mirror is enabled

Signed-off-by: hlts2 <[email protected]>

* not create filter ingress when mirror is enabled

Signed-off-by: hlts2 <[email protected]>

* add error handling for unimplemented codes error

Signed-off-by: hlts2 <[email protected]>

* bugfix register addr process

Signed-off-by: hlts2 <[email protected]>

* fix build error

Signed-off-by: hlts2 <[email protected]>

* Revert "update docker file for build error"

This reverts commit f40986d.

* add new package for docker build error

Signed-off-by: hlts2 <[email protected]>

* Add mirror gateway example (#2082)

* add example code

Signed-off-by: hlts2 <[email protected]>

* execute search and getobject request to all vald clusters

Signed-off-by: hlts2 <[email protected]>

* fixed to send data to each cluster based on the dataset

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>

* add mirror target metrics

Signed-off-by: hlts2 <[email protected]>

* fix example ngt dimension

Signed-off-by: hlts2 <[email protected]>

* make proto/all & make format

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
Co-authored-by: Kiichiro YUKAWA <[email protected]>

* fix mirror image tag

Signed-off-by: hlts2 <[email protected]>

* Add mirror gateway document (#2105)

* add mirror document

Signed-off-by: hlts2 <[email protected]>

* fix svg to png

Signed-off-by: hlts2 <[email protected]>

* Update docs/api/mirror-gateway.md

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* Update docs/api/mirror-gateway.md

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* Update docs/api/mirror-gateway.md

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* style: Format code with prettier and gofumpt

* Update docs/overview/component/mirror-gateway.md

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* Apply suggestions from code review

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* style: Format code with prettier and gofumpt

* Apply suggestions from code review

* Update docs/overview/component/mirror-gateway.md

* fix expand bug for mirror tutorial

Signed-off-by: hlts2 <[email protected]>

* style: Format code with prettier and gofumpt

* fix filename typo

Signed-off-by: hlts2 <[email protected]>

* add new link

Signed-off-by: hlts2 <[email protected]>

* add cluster role settings for mirror gateway

Signed-off-by: hlts2 <[email protected]>

* add hdf5 installation section

Signed-off-by: hlts2 <[email protected]>

* Update docs/user-guides/mirroring-configuration.md

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* update link

Signed-off-by: hlts2 <[email protected]>

* delete quote

Signed-off-by: hlts2 <[email protected]>

* update mirror component overview image

Signed-off-by: hlts2 <[email protected]>

* update mirror component overview image

Signed-off-by: hlts2 <[email protected]>

* Update docs/overview/component/mirror-gateway.md

Co-authored-by: Kevin Diu <[email protected]>

* Update docs/overview/component/mirror-gateway.md

* Update docs/api/mirror-gateway.md

Co-authored-by: Yusuke Kadowaki <[email protected]>

* Update docs/api/mirror-gateway.md

* Update docs/user-guides/mirroring-configuration.md

Co-authored-by: Kevin Diu <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>
Co-authored-by: Kiichiro YUKAWA <[email protected]>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
Co-authored-by: Kevin Diu <[email protected]>
Co-authored-by: Yusuke Kadowaki <[email protected]>

* merge ingress configuration for lb and filter

Signed-off-by: hlts2 <[email protected]>

* fix duplicate definition error

Signed-off-by: hlts2 <[email protected]>

* make proto/all & make schema update & make format

Signed-off-by: hlts2 <[email protected]>

* fix test execution error for mirror handler

Signed-off-by: hlts2 <[email protected]>

* make proto/all format and update schema and fails build error

Signed-off-by: hlts2 <[email protected]>

* use resuable workflow to build mirror image

Signed-off-by: hlts2 <[email protected]>

* use internal sync package and refactor

Signed-off-by: hlts2 <[email protected]>

* fix error handling

Signed-off-by: hlts2 <[email protected]>

* add network policy settings and update deploy command

Signed-off-by: hlts2 <[email protected]>

* add default setting logic

Signed-off-by: hlts2 <[email protected]>

* add new fileld to crd schema and update crd

Signed-off-by: hlts2 <[email protected]>

* fix make command to deploy vald with mirror components

Signed-off-by: hlts2 <[email protected]>

* add e2e test for mirror

Signed-off-by: hlts2 <[email protected]>

* add debug command to get pod status

Signed-off-by: hlts2 <[email protected]>

* bugfix command

Signed-off-by: hlts2 <[email protected]>

* disable sidecar e2e and add mirror e2e command

Signed-off-by: hlts2 <[email protected]>

* update cluster role

Signed-off-by: hlts2 <[email protected]>

* add cluster-info dump command

Signed-off-by: hlts2 <[email protected]>

* Revert "add cluster-info dump command"

This reverts commit 7ece16f.

* debug: add logs command

Signed-off-by: hlts2 <[email protected]>

* Revert "debug: add logs command"

This reverts commit 454eaf3.

* add RemoveByTimestamp for mirror

Signed-off-by: hlts2 <[email protected]>

* fix: update sleep time for operator deploy

Signed-off-by: hlts2 <[email protected]>

* update wait time for vmt

Signed-off-by: hlts2 <[email protected]>

* Returns all connection information in the registration rpc (#2199)

* fix: returns all connection information in the registration rpc

Signed-off-by: hlts2 <[email protected]>

* fix: lint warnning

Signed-off-by: hlts2 <[email protected]>

* refactor: deleted unnecessary parameter

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>

* Add handler logic to continue processing (#2204)

* feat: add new crud logic

Signed-off-by: hlts2 <[email protected]>

* refactor code

Signed-off-by: hlts2 <[email protected]>

* refactor: error handling logic

Signed-off-by: hlts2 <[email protected]>

* fix: bugfix error handling for rpc

Signed-off-by: hlts2 <[email protected]>

* feat: add test for RemoveByTimestamp

Signed-off-by: hlts2 <[email protected]>

* fix: fails error test

Signed-off-by: hlts2 <[email protected]>

* refactor: test logic

Signed-off-by: hlts2 <[email protected]>

* fix: add new condition and add test case

Signed-off-by: hlts2 <[email protected]>

* refactor code

Signed-off-by: hlts2 <[email protected]>

* fix: error handling and comment

Signed-off-by: hlts2 <[email protected]>

* fix: test case name and test case order

Signed-off-by: hlts2 <[email protected]>

* fix: execute format

Signed-off-by: hlts2 <[email protected]>

* fix: add new comment

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>

* Update Mirror Gateway document (#2207)

* fix: update mirror document

Signed-off-by: hlts2 <[email protected]>

* fix: format

Signed-off-by: hlts2 <[email protected]>

* feat: add removeByTimestamp section

Signed-off-by: hlts2 <[email protected]>

* fix: grammar warning

Signed-off-by: hlts2 <[email protected]>

* fix: grammar warning and refactor document

Signed-off-by: hlts2 <[email protected]>

* fix: grammar warning

Signed-off-by: hlts2 <[email protected]>

* feat: add mirror gateway troubleshooting docs

Signed-off-by: hlts2 <[email protected]>

* style: format code with Gofumpt and Prettier

This commit fixes the style issues introduced in 2c492f7 according to the output
from Gofumpt and Prettier.

Details: #2207

* feat: add contents of troubleshooting document

Signed-off-by: hlts2 <[email protected]>

* fix: grammar warning

Signed-off-by: hlts2 <[email protected]>

* fix: grammar

Signed-off-by: hlts2 <[email protected]>

* fix: link path

Signed-off-by: hlts2 <[email protected]>

* fix: invalid link path

Signed-off-by: hlts2 <[email protected]>

* fix: refactor docs

Signed-off-by: hlts2 <[email protected]>

* fix: deleted unnecessary contents

Signed-off-by: hlts2 <[email protected]>

* fix: status handling logic document

Signed-off-by: hlts2 <[email protected]>

* fix: document refactor

Signed-off-by: hlts2 <[email protected]>

* fix: bugfix status handling document

Signed-off-by: hlts2 <[email protected]>

* fix: refactor sentence

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* feat: schema and protobuf update

Signed-off-by: hlts2 <[email protected]>

* fix: reviewdog warning and add comment

Signed-off-by: hlts2 <[email protected]>

* style: format code with Gofumpt and Prettier

This commit fixes the style issues introduced in 7d7a690 according to the output
from Gofumpt and Prettier.

Details: #2237

* fix: reviewdog warning

Signed-off-by: hlts2 <[email protected]>

* fix: reviewdog warning

Signed-off-by: hlts2 <[email protected]>

* fix: move mirror client mock definition to internal package

Signed-off-by: hlts2 <[email protected]>

* feat: add new handler base logic

Signed-off-by: hlts2 <[email protected]>

* fix: refactor stream list object rpc

Signed-off-by: hlts2 <[email protected]>

* fix: divide logic to other function

Signed-off-by: hlts2 <[email protected]>

* style: format code with Gofumpt and Prettier

This commit fixes the style issues introduced in e62a657 according to the output
from Gofumpt and Prettier.

Details: #2237

* make proto/all format

Signed-off-by: hlts2 <[email protected]>

* fix: return grpc error

Signed-off-by: hlts2 <[email protected]>

* fix: make proto/all format

Signed-off-by: hlts2 <[email protected]>

* feat: add mirror service test

Signed-off-by: hlts2 <[email protected]>

* fix: add mock definition code

Signed-off-by: hlts2 <[email protected]>

* style: format code with Gofumpt and Prettier

This commit fixes the style issues introduced in d6580ec according to the output
from Gofumpt and Prettier.

Details: #2237

* fix: use internal method

Signed-off-by: hlts2 <[email protected]>

* fix: delete Exist method because it is not needed

Signed-off-by: hlts2 <[email protected]>

* fix: use address cache insted of connectedAddr method

Signed-off-by: hlts2 <[email protected]>

* fix: make format

Signed-off-by: hlts2 <[email protected]>

* feat: improve connection management and add new test

Signed-off-by: hlts2 <[email protected]>

* fix: make format

Signed-off-by: hlts2 <[email protected]>

* fix: lint warnning

Signed-off-by: hlts2 <[email protected]>

* fix: refactor error handling

Signed-off-by: hlts2 <[email protected]>

* feat: add test for syncronizee based on address and small refactor

Signed-off-by: hlts2 <[email protected]>

* fix: improve error handling and example image tag

Signed-off-by: hlts2 <[email protected]>

* fix: schema update and format

Signed-off-by: hlts2 <[email protected]>

* Update charts/vald/values/multi-vald/dev-vald-with-mirror.yaml

* fix: lint warnning

Signed-off-by: hlts2 <[email protected]>

* style: format code with Gofumpt and Prettier

This commit fixes the style issues introduced in 4c11568 according to the output
from Gofumpt and Prettier.

Details: #2262

* fix: reviewdog warning and deepsource warning

Signed-off-by: hlts2 <[email protected]>

* feat: use new command to docker build

Signed-off-by: hlts2 <[email protected]>

* fix: make format

Signed-off-by: hlts2 <[email protected]>

* fix: update schema and format

Signed-off-by: hlts2 <[email protected]>

* fix: deleted unnecessary RPCs due to failure of previous rebasing

Signed-off-by: hlts2 <[email protected]>

* fix: proto and execute make proto/all format

Signed-off-by: hlts2 <[email protected]>

* fix: revert unnecessary changes

Signed-off-by: hlts2 <[email protected]>

* fix: make proto/all format

Signed-off-by: hlts2 <[email protected]>

* fix: deepsource warning

Signed-off-by: hlts2 <[email protected]>

* fix: deleted unnecessary code

Signed-off-by: hlts2 <[email protected]>

* fix: deepsource warning

Signed-off-by: hlts2 <[email protected]>

* fix: deepsource warning

Signed-off-by: hlts2 <[email protected]>

* fix: make proto/all format

Signed-off-by: hlts2 <[email protected]>

* fix: apply feedback for comment

Signed-off-by: hlts2 <[email protected]>

* feat: add internal hash package to generate hash value

Signed-off-by: hlts2 <[email protected]>

* fix: ignore deepsource warning

Signed-off-by: hlts2 <[email protected]>

* feat: add function and method comment

Signed-off-by: hlts2 <[email protected]>

* Update pkg/gateway/mirror/handler/grpc/handler.go

* fix: schema and proto update and format

Signed-off-by: hlts2 <[email protected]>

* feat: add ingress rule for lb and filter

Signed-off-by: hlts2 <[email protected]>

* fix: deleted wildcard path

Signed-off-by: hlts2 <[email protected]>

* fix: ingress unified into one manifest

Signed-off-by: hlts2 <[email protected]>

* fix: make format

Signed-off-by: hlts2 <[email protected]>

* fix: lb ingress port settings and small refactor

Signed-off-by: hlts2 <[email protected]>

* feat: add cluster wide ingress resource name

Signed-off-by: hlts2 <[email protected]>

* fix: add deploy ingress resource using make command

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
Co-authored-by: Kiichiro YUKAWA <[email protected]>
Co-authored-by: Kevin Diu <[email protected]>
Co-authored-by: Yusuke Kadowaki <[email protected]>

* Update values-readreplica.yaml with new index path and in-memory mode

* Update POD_NAME environment variable in e2e.yml

* Add readreplica e2e logic

* Refactor e2e test for read replica

* Update E2E test name and add read replica rotation

* Update E2E test parameters for improved performance

* Refactor setup-e2e action.yaml

* Refactor

* style: format code with Gofumpt and Prettier

This commit fixes the style issues introduced in a68a83d according to the output
from Gofumpt and Prettier.

Details: #2298

* Add kubectl package for Kubernetes operations

* Remove unused param

* Fix function parameter order in kubectl package

* Refactor kubectl.go: Add copyright notice and fix error handling

* FIx error handling

* Prevent command injection

* Apply format

* Seperate k8s client initialization in TestE2EReadReplica

* Fix comment

* style: format code with Gofumpt and Prettier

This commit fixes the style issues introduced in d127dbc according to the output
from Gofumpt and Prettier.

Details: #2298

---------

Signed-off-by: hlts2 <[email protected]>
Co-authored-by: Hiroto Funakoshi <[email protected]>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
Co-authored-by: Kiichiro YUKAWA <[email protected]>
Co-authored-by: Kevin Diu <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants