Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add implementation for save index job #2227

Merged
merged 18 commits into from
Nov 8, 2023
Merged

Add implementation for save index job #2227

merged 18 commits into from
Nov 8, 2023

Conversation

hlts2
Copy link
Collaborator

@hlts2 hlts2 commented Nov 6, 2023

Description:

I added a component to execute the saveIndex requests to agents.
This component will run as a k8s job in the future.

NOTE

This component name is index-save to match the naming of the other components (index-correction, index-creation). This may change in the future at the time of refactoring.

Related Issue:

Versions:

  • Go Version: 1.21.3
  • Docker Version: 20.10.8
  • Kubernetes Version: v1.28.2
  • NGT Version: 2.1.3

Checklist:

Special notes for your reviewer:

@vdaas-ci
Copy link
Collaborator

vdaas-ci commented Nov 6, 2023

[CHATOPS:HELP] ChatOps commands.

  • 🙆‍♀️ /approve - approve
  • 🍱 /format - format codes and add licenses
  • /gen-test - generate test codes
  • 🏷️ /label - add labels
  • 🔚 2️⃣ 🔚 /label actions/e2e-deploy - run E2E deploy & integration test

@vdaas-ci
Copy link
Collaborator

vdaas-ci commented Nov 6, 2023

[WARNING:INTCFG] Changes in interal/config may require you to change Helm charts. Please check.

Copy link

cloudflare-workers-and-pages bot commented Nov 6, 2023

Deploying with  Cloudflare Pages  Cloudflare Pages

Latest commit: 90cea88
Status: ✅  Deploy successful!
Preview URL: https://52f66bff.vald.pages.dev
Branch Preview URL: https://feature-index-job-save.vald.pages.dev

View logs

Copy link

codecov bot commented Nov 6, 2023

Codecov Report

Attention: 274 lines in your changes are missing coverage. Please review.

Files Coverage Δ
internal/config/index_save.go 0.00% <0.00%> (ø)
pkg/index/job/save/service/options.go 5.00% <5.00%> (ø)
pkg/index/job/save/config/config.go 0.00% <0.00%> (ø)
pkg/index/job/save/service/indexer.go 35.55% <35.55%> (ø)
pkg/index/job/save/usecase/save.go 0.00% <0.00%> (ø)

... and 7 files with indirect coverage changes

📢 Thoughts on this report? Let us know!

pkg/index/job/save/service/mock_test.go Outdated Show resolved Hide resolved
pkg/index/job/save/service/mock_test.go Outdated Show resolved Hide resolved
pkg/index/job/save/service/mock_test.go Outdated Show resolved Hide resolved
pkg/index/job/save/service/mock_test.go Outdated Show resolved Hide resolved
pkg/index/job/save/service/mock_test.go Outdated Show resolved Hide resolved
deepsource-autofix bot added a commit that referenced this pull request Nov 6, 2023
This commit fixes the style issues introduced in 84ade79 according to the output
from Gofumpt and Prettier.

Details: #2227
@hlts2 hlts2 changed the title Add implementation for index save job Add implementation for save index job Nov 6, 2023
hlts2 pushed a commit that referenced this pull request Nov 6, 2023
This commit fixes the style issues introduced in 84ade79 according to the output
from Gofumpt and Prettier.

Details: #2227
@hlts2 hlts2 force-pushed the feature/index-job/save branch from 13f9e44 to 82230bb Compare November 6, 2023 07:23
hlts2 and others added 8 commits November 7, 2023 09:49
This commit fixes the style issues introduced in 84ade79 according to the output
from Gofumpt and Prettier.

Details: #2227
Signed-off-by: hlts2 <[email protected]>
@hlts2 hlts2 force-pushed the feature/index-job/save branch from 82230bb to 78f349a Compare November 7, 2023 00:49
Signed-off-by: hlts2 <[email protected]>
@hlts2 hlts2 requested a review from a team November 7, 2023 00:52
@hlts2 hlts2 requested a review from vankichi November 8, 2023 03:39
ykadowak
ykadowak previously approved these changes Nov 8, 2023
ykadowak
ykadowak previously approved these changes Nov 8, 2023
@hlts2 hlts2 requested a review from vankichi November 8, 2023 07:05
vankichi
vankichi previously approved these changes Nov 8, 2023
@hlts2 hlts2 dismissed stale reviews from vankichi and ykadowak via 90cea88 November 8, 2023 07:22
@hlts2 hlts2 requested review from vankichi and ykadowak November 8, 2023 07:22
@vankichi vankichi merged commit c5cbfc9 into main Nov 8, 2023
95 of 97 checks passed
@vankichi vankichi deleted the feature/index-job/save branch November 8, 2023 07:43
ykadowak added a commit that referenced this pull request Nov 30, 2023
ykadowak added a commit that referenced this pull request Nov 30, 2023
ykadowak added a commit that referenced this pull request Nov 30, 2023
ykadowak added a commit that referenced this pull request Nov 30, 2023
ykadowak added a commit that referenced this pull request Nov 30, 2023
ykadowak added a commit that referenced this pull request Nov 30, 2023
ykadowak added a commit that referenced this pull request Nov 30, 2023
ykadowak added a commit that referenced this pull request Nov 30, 2023
ykadowak added a commit that referenced this pull request Nov 30, 2023
@vankichi vankichi mentioned this pull request Dec 4, 2023
kmrmt pushed a commit that referenced this pull request Dec 12, 2023
* add index save implementation

Signed-off-by: hlts2 <[email protected]>

* make gotest/gen and make format

Signed-off-by: hlts2 <[email protected]>

* fix: sample configuration data

Signed-off-by: hlts2 <[email protected]>

* feat: add save indexing test

Signed-off-by: hlts2 <[email protected]>

* style: format code with Gofumpt and Prettier

This commit fixes the style issues introduced in 84ade79 according to the output
from Gofumpt and Prettier.

Details: #2227

* fix: deleted unnecessary code

Signed-off-by: hlts2 <[email protected]>

* fix: update debug error message

Signed-off-by: hlts2 <[email protected]>

* fix: option name

Signed-off-by: hlts2 <[email protected]>

* fix: test case name

Signed-off-by: hlts2 <[email protected]>

* Update cmd/index/job/save/sample.yaml

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* Update pkg/index/job/save/config/config.go

Co-authored-by: Kiichiro YUKAWA <[email protected]>

* fix: add comment for test case

Signed-off-by: hlts2 <[email protected]>

* fix: fix method naming

Signed-off-by: hlts2 <[email protected]>

* feat: add mock for discoverer client and grpc client

Signed-off-by: hlts2 <[email protected]>

* fix: struct tag for config

Signed-off-by: hlts2 <[email protected]>

* fix: cyclic import for testing

Signed-off-by: hlts2 <[email protected]>

---------

Signed-off-by: hlts2 <[email protected]>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
Co-authored-by: Kiichiro YUKAWA <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants