Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DO-NOT-MERGE] Binarysearch/52 #2248

Closed
wants to merge 54 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
54 commits
Select commit Hold shift + click to select a range
5523f15
Revert "Add read replica rotator (#2241)"
ykadowak Nov 30, 2023
afe497b
Revert "Disable exhaustruct (#2240)"
ykadowak Nov 30, 2023
6da964e
Revert "Add document for RemoveByTimestamp RPC (#2238)"
ykadowak Nov 30, 2023
b87c89f
Revert "Improve index correction performance (#2234)"
ykadowak Nov 30, 2023
ff4761e
Revert "Implement manifests for Index Management Job (#2235)"
ykadowak Nov 30, 2023
79e5e58
Revert "Refactor Index Management Job (#2232)"
ykadowak Nov 30, 2023
ff24295
Revert "Add job error to report index correction error status (#2231)"
ykadowak Nov 30, 2023
e16b487
Revert "Add implementation for save index job (#2227)"
ykadowak Nov 30, 2023
833fdab
Revert "fix: deleted contour ingress contoller apply (#2229)"
ykadowak Nov 30, 2023
f2827c4
Revert "Fix invalid networkPolicy schema (#2230)"
ykadowak Nov 30, 2023
c2fb02c
Revert "Add minikube to create volume snapshot development environmen…
ykadowak Nov 30, 2023
e69eccc
Revert "Add implementation for create index job (#2223)"
ykadowak Nov 30, 2023
41ea3e9
Revert "fix: fails when there are format differences (#2226)"
ykadowak Nov 30, 2023
f368850
Revert ":robot: Update license headers / Format Go codes and YAML fil…
ykadowak Nov 30, 2023
c4c5877
Revert "Add index correction metrics (#2215)"
ykadowak Nov 30, 2023
117e483
Revert "Add index correction document (#2217)"
ykadowak Nov 30, 2023
549c426
Revert "Add make command to update template (#2212)"
ykadowak Nov 30, 2023
fe0246d
Revert "Add job to check format difference (#2214)"
ykadowak Nov 30, 2023
260a546
Revert "Enable ingress resource in the getStarted document (#2211)"
ykadowak Nov 30, 2023
faebeb5
Revert ":robot: Automatically update PULL_REQUEST_TEMPLATE and ISSUE_…
ykadowak Nov 30, 2023
9392285
Revert "update deps (#2208)"
ykadowak Nov 30, 2023
9b0a210
Revert "Add verification for index correction e2e and add clusterrole…
ykadowak Nov 30, 2023
6c7f2e7
Revert "Add step to get k3s latest version (#2206)"
ykadowak Nov 30, 2023
bcc256b
Revert "Add StreamListObject to LB (#2203)"
ykadowak Nov 30, 2023
1ace402
Revert "Add index correction helm templates and E2E (#2200)"
ykadowak Nov 30, 2023
da306ea
Revert "Add index correction internal logic (#2194)"
ykadowak Nov 30, 2023
0794174
Revert "update telepresence and helm-docs installer and update deps (…
ykadowak Nov 30, 2023
28b25f3
Revert "Replace x/slices with standard slices pkg (#2193)"
ykadowak Nov 30, 2023
2d8340e
Revert ":robot: Update license headers / Format Go codes and YAML fil…
ykadowak Nov 30, 2023
aa5d229
Revert "Add bbolt as internal/db/kvs (#2177)"
ykadowak Nov 30, 2023
82cb6e6
Revert ":bookmark: :robot: Release v1.7.8"
ykadowak Nov 30, 2023
fd7e880
Revert "change default creation poolsize (#2190)"
ykadowak Nov 30, 2023
7d71a5a
Revert "List kvs and vqueue data (#2188)"
ykadowak Nov 30, 2023
56b8f5a
Revert "refactor semver ci (#2189)"
ykadowak Nov 30, 2023
f5394db
Revert ":robot: Update license headers / Format Go codes and YAML fil…
ykadowak Nov 30, 2023
4995439
Revert ":robot: Automatically update k8s manifests (#2184)"
ykadowak Nov 30, 2023
bba5a75
Revert "style: format code with prettier and gofumpt (#2183)"
ykadowak Nov 30, 2023
a8f5be3
Revert ":bookmark: :robot: Release v1.7.7"
ykadowak Nov 30, 2023
76b1e32
Revert ":robot: Automatically update PULL_REQUEST_TEMPLATE and ISSUE_…
ykadowak Nov 30, 2023
961dc6d
Revert "Bugfix lb gateway pacicked caused by pairing heap search aggr…
ykadowak Nov 30, 2023
b9084b4
Revert "Add troubleshooting for each rpc (#2163)"
ykadowak Nov 30, 2023
9e2fa13
Revert "Update testing guideline for updated testing policy (#2131)"
ykadowak Nov 30, 2023
78a8c72
Revert "Modified svg images (#2178)"
ykadowak Nov 30, 2023
0ed9671
Revert ":robot: Automatically update PULL_REQUEST_TEMPLATE and ISSUE_…
ykadowak Nov 30, 2023
1484815
Revert "Refactor agent ngt core. (#2172)"
ykadowak Nov 30, 2023
bc61f53
Revert "refactor proto (#2173)"
ykadowak Nov 30, 2023
045b2c6
Revert "update license text (#2169)"
ykadowak Nov 30, 2023
e62b152
Revert "refactor search status (#2168)"
ykadowak Nov 30, 2023
8e6566c
Revert "Add CopyBuffer to copy.go (#2167)"
ykadowak Nov 30, 2023
f5fd1e4
Revert "Fix duplicate make command (#2165)"
ykadowak Nov 30, 2023
6001309
Revert ":robot: Automatically update PULL_REQUEST_TEMPLATE and ISSUE_…
ykadowak Nov 30, 2023
4d0e667
Revert "refactor internal/core/algorithm/ngt mutex lock timing (#2144)"
ykadowak Nov 30, 2023
893abbc
Revert "Add RemoveByTimestamp RPC (#2158)"
ykadowak Nov 30, 2023
6ddf899
Revert ":robot: Automatically update PULL_REQUEST_TEMPLATE and ISSUE_…
ykadowak Nov 30, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
2 changes: 1 addition & 1 deletion .commit_template
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Copyright (C) 2019-2023 vdaas.org vald team <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# You may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
Expand Down
2 changes: 1 addition & 1 deletion .deepsource.toml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Copyright (C) 2019-2023 vdaas.org vald team <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# You may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
Expand Down
2 changes: 1 addition & 1 deletion .fossa.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Copyright (C) 2019-2023 vdaas.org vald team <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# You may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
Expand Down
2 changes: 1 addition & 1 deletion .gitattributes
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Copyright (C) 2019-2023 vdaas.org vald team <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# You may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
Expand Down
6 changes: 3 additions & 3 deletions .github/ISSUE_TEMPLATE/bug_report.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ assignees: ""

<!--- Please change the versions below along with your environment -->

- Go Version: 1.21.3
- Go Version: 1.20.6
- Docker Version: 20.10.8
- Kubernetes Version: v1.28.2
- NGT Version: 2.1.3
- Kubernetes Version: v1.27.3
- NGT Version: 2.0.16
6 changes: 3 additions & 3 deletions .github/ISSUE_TEMPLATE/security_issue_report.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ assignees: ""

<!--- Please change the versions below along with your environment -->

- Go Version: 1.21.3
- Go Version: 1.20.6
- Docker Version: 20.10.8
- Kubernetes Version: v1.28.2
- NGT Version: 2.1.3
- Kubernetes Version: v1.27.3
- NGT Version: 2.0.16
6 changes: 3 additions & 3 deletions .github/PULL_REQUEST_TEMPLATE.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,10 +16,10 @@

<!--- Please change the versions below along with your environment -->

- Go Version: 1.21.3
- Go Version: 1.20.6
- Docker Version: 20.10.8
- Kubernetes Version: v1.28.2
- NGT Version: 2.1.3
- Kubernetes Version: v1.27.3
- NGT Version: 2.0.16

### Checklist:

Expand Down
9 changes: 7 additions & 2 deletions .github/actions/deploy-chaos-mesh/action.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Copyright (C) 2019-2023 vdaas.org vald team <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# You may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
Expand All @@ -15,6 +15,7 @@
#
name: "Deploy Chaos Mesh"
description: "A action to deploy Chaos Mesh"

inputs:
chaos_mesh_version:
description: "The Chaos Mesh version to use. The default version is `versions/CHAOS_MESH_VERSION`"
Expand All @@ -24,6 +25,7 @@ inputs:
description: "Extra options that passed to Helm command"
required: false
default: ""

runs:
using: "composite"
steps:
Expand All @@ -36,15 +38,18 @@ runs:
echo "version=${CHAOS_MESH_VERSION}" >> $GITHUB_OUTPUT
env:
CHAOS_MESH_VERSION: ${{ inputs.chaos_mesh_version }}

- name: Check k3d
shell: bash
id: check_k3d
run: |
kubectl cluster-info dump
kubectl cluster-info

- name: Check Helm
shell: bash
run: |
helm version

- name: Deploy Chaos Mesh
shell: bash
run: |
Expand Down
2 changes: 1 addition & 1 deletion .github/actions/detect-docker-image-tags/action.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Copyright (C) 2019-2023 vdaas.org vald team <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# You may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
Expand Down
2 changes: 1 addition & 1 deletion .github/actions/determine-docker-image-tag/action.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Copyright (C) 2019-2023 vdaas.org vald team <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# You may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
Expand Down
2 changes: 1 addition & 1 deletion .github/actions/docker-build/action.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Copyright (C) 2019-2023 vdaas.org vald team <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# You may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
Expand Down
2 changes: 1 addition & 1 deletion .github/actions/dump-context/action.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Copyright (C) 2019-2023 vdaas.org vald team <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# You may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
Expand Down
2 changes: 1 addition & 1 deletion .github/actions/e2e-deploy-vald-helm-operator/action.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Copyright (C) 2019-2023 vdaas.org vald team <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# You may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
Expand Down
2 changes: 1 addition & 1 deletion .github/actions/e2e-deploy-vald/action.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Copyright (C) 2019-2023 vdaas.org vald team <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# You may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
Expand Down
2 changes: 1 addition & 1 deletion .github/actions/notify-slack/action.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Copyright (C) 2019-2023 vdaas.org vald team <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# You may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
Expand Down
2 changes: 1 addition & 1 deletion .github/actions/scan-docker-image/action.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Copyright (C) 2019-2023 vdaas.org vald team <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# You may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
Expand Down
20 changes: 17 additions & 3 deletions .github/actions/setup-e2e/action.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Copyright (C) 2019-2023 vdaas.org vald team <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# You may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
Expand All @@ -15,6 +15,7 @@
#
name: "Setup E2E environment"
description: "A action to set up the environment for executing E2E test"

inputs:
require_libhdf5:
description: "If libhdf5 is not required, set this to false"
Expand All @@ -39,14 +40,19 @@ inputs:
target_images:
description: "Image names"
required: false
default: "vdaas/vald-agent-ngt vdaas/vald-discoverer-k8s vdaas/vald-lb-gateway vdaas/vald-manager-index"
default: "vdaas/vald-agent-ngt \
vdaas/vald-discoverer-k8s \
vdaas/vald-lb-gateway \
vdaas/vald-manager-index"

outputs:
HELM_EXTRA_OPTIONS:
description: "Helm extra options that specifies E2E target image tags"
value: ${{ steps.specify_container_versions.outputs.HELM_EXTRA_OPTIONS }}
IMAGE_TAGS:
description: "Specifies E2E target image tags"
value: ${{ steps.specify_container_versions.outputs.IMAGE_TAGS }}

runs:
using: "composite"
steps:
Expand All @@ -56,32 +62,40 @@ runs:
run: |
sudo apt-get update
sudo apt-get install -y libhdf5-dev

- name: Setup Go environment
if: ${{ inputs.require_go == 'true' }}
uses: ./.github/actions/setup-go

- name: Setup Helm environment
if: ${{ inputs.require_helm == 'true' }}
uses: ./.github/actions/setup-helm

- name: Wait for target Docker images
if: startsWith( github.ref, 'refs/tags/')
uses: ./.github/actions/wait-for-docker-image
with:
images: ${{ inputs.target_images }}

- name: Determine Docker image tag
id: determine_tag_name
uses: ./.github/actions/determine-docker-image-tag

- name: Specify container versions
id: specify_container_versions
uses: ./.github/actions/detect-docker-image-tags
with:
tag_name: ${{ steps.determine_tag_name.outputs.PRIMARY_TAG }}
images: ${{ inputs.target_images }}

- uses: ./.github/actions/setup-k3d
if: ${{ inputs.require_k3d == 'true' }}
with:
agents: 3
ingress_port: ${{ inputs.ingress_port }}
options: "--image docker.io/rancher/k3s:latest"

- name: Check Kubernetes cluster
shell: bash
run: |
kubectl cluster-info dump
kubectl cluster-info
2 changes: 1 addition & 1 deletion .github/actions/setup-go/action.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Copyright (C) 2019-2023 vdaas.org vald team <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# You may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
Expand Down
2 changes: 1 addition & 1 deletion .github/actions/setup-helm/action.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Copyright (C) 2019-2023 vdaas.org vald team <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# You may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
Expand Down
18 changes: 1 addition & 17 deletions .github/actions/setup-k3d/action.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Copyright (C) 2019-2023 vdaas.org vald team <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# You may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
Expand All @@ -21,10 +21,6 @@ inputs:
description: "k3d version"
required: false
default: "latest"
k3s_version:
description: "The k3s to use. The default version is `versions/K3S_VERSION`"
required: false
default: ""
name:
description: "Cluster name"
required: false
Expand Down Expand Up @@ -56,16 +52,6 @@ runs:
env:
K3D_VERSION: ${{ inputs.version }}

- name: Detect k3s version
id: k3s_version
shell: bash
run: |
K3S_VERSION=${K3S_VERSION:-`cat versions/K3S_VERSION`}

echo "tag=${K3S_VERSION=$}" >> $GITHUB_OUTPUT
env:
K3S_VERSION: ${{ inputs.k3s_version }}

- name: Install k3d
shell: bash
run: |
Expand All @@ -88,13 +74,11 @@ runs:
if [ "${INGRESS_PORT}" != 0 ]; then
OPTIONS="${OPTIONS} -p ${INGRESS_PORT}:80@loadbalancer"
fi
OPTIONS="${OPTIONS} --image rancher/k3s:${K3S_VERSION}"
echo "options=${OPTIONS}" >> $GITHUB_OUTPUT
env:
AGENTS: ${{ inputs.agents }}
INGRESS_PORT: ${{ inputs.ingress_port }}
OPTIONS: ${{ inputs.options }}
K3S_VERSION: ${{ steps.k3s_version.outputs.tag }}

- name: Create k8s cluster
shell: bash
Expand Down
2 changes: 1 addition & 1 deletion .github/actions/setup-yq/action.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Copyright (C) 2019-2023 vdaas.org vald team <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# You may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
Expand Down
2 changes: 1 addition & 1 deletion .github/actions/wait-for-docker-image/action.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Copyright (C) 2019-2023 vdaas.org vald team <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# You may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
Expand Down
2 changes: 1 addition & 1 deletion .github/chatops_permissions.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Copyright (C) 2019-2023 vdaas.org vald team <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# You may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
Expand Down
2 changes: 1 addition & 1 deletion .github/codeql/codeql-config.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Copyright (C) 2019-2023 vdaas.org vald team <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# You may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
Expand Down
2 changes: 1 addition & 1 deletion .github/conflint.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Copyright (C) 2019-2023 vdaas.org vald team <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# You may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
Expand Down
2 changes: 1 addition & 1 deletion .github/dependabot.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Copyright (C) 2019-2023 vdaas.org vald team <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# You may not use this file except in compliance with the License.
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
Expand Down
Loading
Loading