Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replica of 3.6.0 #2325

Merged
merged 106 commits into from
Oct 31, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
106 commits
Select commit Hold shift + click to select a range
75322b1
Update mkdocs.yml
cooper-lzy Aug 11, 2023
0da9de2
release 3.6.0 (#2222)
cooper-lzy Aug 11, 2023
d4b4f64
Update nebula-comm-release-note.md
cooper-lzy Aug 11, 2023
a24128a
Update 1.text-based-index-restrictions.md
cooper-lzy Aug 11, 2023
6a6ad6c
Update mkdocs.yml
cooper-lzy Aug 11, 2023
2a83718
Update nebula-comm-release-note.md
cooper-lzy Aug 11, 2023
129cec3
Update 1.introduction-to-nebula-operator.md
abby-cyber Aug 14, 2023
6b2b485
add compile using docker (#2223)
abby-cyber Aug 14, 2023
bfb6523
Update canvas-snapshot.md
cooper-lzy Aug 14, 2023
dbb3b96
index desc updates (#2227)
abby-cyber Aug 14, 2023
e9a8d24
Update 1.numeric.md
cooper-lzy Aug 15, 2023
7128e0a
helm chart install updates (#2228)
abby-cyber Aug 15, 2023
99066e1
Update 2.management-user.md
cooper-lzy Aug 16, 2023
b5c06f1
exchange vid support prefix (#2232) (#2233)
cooper-lzy Aug 17, 2023
8d0735d
Update use-importer.md
cooper-lzy Aug 17, 2023
71eb73e
Update upgrade-nebula-ent-from-3.x-3.4.md (#2234)
abby-cyber Aug 17, 2023
31d7911
add-find-single-shortest-path (#2236)
abby-cyber Aug 17, 2023
24e4c18
Update ex-ug-export-from-nebula.md
cooper-lzy Aug 17, 2023
563becb
Update 4.ldap.md
cooper-lzy Aug 18, 2023
ea6161d
Update 0-2.relates.md
cooper-lzy Aug 21, 2023
2f1ad86
Update logs.md
cooper-lzy Aug 22, 2023
c82cea6
Update 0.FAQ.md
cooper-lzy Aug 22, 2023
13ad36b
add-reserved-keywords-in-ent3.6.0 (#2237)
abby-cyber Aug 22, 2023
6beab9e
Update 1.configurations.md
cooper-lzy Aug 22, 2023
aa06e58
Update 4.schema.md
cooper-lzy Aug 23, 2023
98588f1
hide ent-content in 3.6.0 (#2238)
abby-cyber Aug 23, 2023
e107e6d
add the inner join clause doc (#2239)
abby-cyber Aug 23, 2023
a4424dd
Update use-importer.md
cooper-lzy Aug 24, 2023
207b61d
sync-sc-to-v3.6.0-ent (#2242)
abby-cyber Aug 24, 2023
37538cf
Update mkdocs.yml
abby-cyber Aug 24, 2023
b09eb20
fix links (#2243)
cooper-lzy Aug 25, 2023
e280fb7
Update 1.text-based-index-restrictions.md
cooper-lzy Aug 28, 2023
98a33f4
Update 3.graph-config.md
cooper-lzy Aug 28, 2023
ad26a61
Update 1.authentication.md
cooper-lzy Aug 28, 2023
a8770cb
Update 2.compile-br.md
cooper-lzy Aug 29, 2023
ccb0ccd
Update mkdocs.yml (#2244)
abby-cyber Aug 29, 2023
b7f3f97
Update st-ug-limitations.md
cooper-lzy Aug 30, 2023
5c84f84
Update st-ug-import-data.md
cooper-lzy Aug 30, 2023
100fe45
Update 11.import-data.md
cooper-lzy Aug 30, 2023
10040cb
Update st-ug-import-data.md
cooper-lzy Aug 30, 2023
e939251
Update use-importer.md
cooper-lzy Aug 31, 2023
78fd03c
Update use-importer.md
cooper-lzy Sep 1, 2023
9f35787
Update notification-endpoint.md
cooper-lzy Sep 1, 2023
3773273
dashboard advanced config (#2245)
cooper-lzy Sep 4, 2023
b8527de
balance leader desc updates (#2247)
abby-cyber Sep 5, 2023
e922b2c
Update notification-endpoint.md
cooper-lzy Sep 5, 2023
3261764
Update 2.deploy-connect-dashboard-ent.md (#2248)
cooper-lzy Sep 6, 2023
a0f071f
Update manage-storage-host.md (#2249)
abby-cyber Sep 6, 2023
f906723
Update 2.deploy-connect-dashboard-ent.md
cooper-lzy Sep 6, 2023
0110543
Update 4.storage-config.md
cooper-lzy Sep 6, 2023
72a2dbb
comment fixes (#2252)
abby-cyber Sep 7, 2023
501805f
Update 5.show-native-index-status.md
cooper-lzy Sep 8, 2023
062c83a
Update 9.notification.md
cooper-lzy Sep 11, 2023
7b53e00
Update notification-endpoint.md
cooper-lzy Sep 11, 2023
5b3b8ad
update screenshots (#2256)
cooper-lzy Sep 13, 2023
cf63124
fixed missing installation step (#2257)
omar-araboghli Sep 14, 2023
9945685
Update 3.2create-cluster-with-helm.md
abby-cyber Sep 14, 2023
d989746
[TO BE REVIEWED]v3.5.0-sc core-zone updates (#2250) (#2258)
abby-cyber Sep 19, 2023
6445de2
[wip] [sc]updates for operator (#2255) (#2259)
abby-cyber Sep 20, 2023
b59d9c5
Update 4.ssl.md (#2260)
cooper-lzy Sep 20, 2023
b8dddde
Update 6.delete-tag.md (#2262)
abby-cyber Sep 21, 2023
31b5834
Update 1.search-with-text-based-index.md
cooper-lzy Sep 21, 2023
ba7d245
Opt fix (#2266)
abby-cyber Sep 22, 2023
b4c410f
operator-version-updated (#2269)
abby-cyber Sep 26, 2023
0f87ccc
returned info updates using docker compose deployment (#2270)
abby-cyber Sep 26, 2023
137568c
Update 5.zone.md
abby-cyber Sep 27, 2023
9d85fdd
add note for using memtracker (#2271)
abby-cyber Oct 7, 2023
36fcc31
Remove parameters from dynamic flags (#2273)
abby-cyber Oct 7, 2023
08ee84f
update (#2276)
cooper-lzy Oct 7, 2023
23ba9ea
dashboard database user (#2275)
cooper-lzy Oct 7, 2023
3795137
Update 1.configurations.md (#2279)
abby-cyber Oct 8, 2023
261f636
example of scope and order of variable and set operator (#2280)
abby-cyber Oct 8, 2023
c17c65d
update explorer iframe (#2282)
cooper-lzy Oct 9, 2023
dcb0df0
update (#2281)
cooper-lzy Oct 9, 2023
d73af93
Update nebula-console.md
cooper-lzy Oct 10, 2023
adb4349
Update nebula-console.md
cooper-lzy Oct 10, 2023
7cf50a0
Update 1.numeric.md
cooper-lzy Oct 10, 2023
78599a9
update use-importer.md: add notes on csv delimiter (#2285) (#2287)
abby-cyber Oct 11, 2023
e5f6393
update alter user (#2289)
cooper-lzy Oct 11, 2023
55f6387
Update 2.management-user.md
cooper-lzy Oct 12, 2023
f011440
Update 2.management-user.md
cooper-lzy Oct 12, 2023
0454694
rotate audit logs (#2296)
abby-cyber Oct 13, 2023
f272f8c
record slow queries in log files (#2297)
abby-cyber Oct 13, 2023
5904754
remove DML from slow queries (#2298)
abby-cyber Oct 13, 2023
48f1396
3.6.0 ent release note (#2300)
cooper-lzy Oct 17, 2023
62264b8
Update 3.graph-config.md
cooper-lzy Oct 17, 2023
7db6cca
Update source-monitoring-metrics.md
cooper-lzy Oct 17, 2023
2a4c6f6
Explorer compatibility (#2299)
cooper-lzy Oct 17, 2023
848e60c
change zone fields to dynamically configurable (#2304)
abby-cyber Oct 17, 2023
fef5b0f
upgrade-doc-for-3.6.0-ent (#2303)
abby-cyber Oct 18, 2023
f3ce56e
upgrade 2.x-3.x (#2305)
abby-cyber Oct 18, 2023
1623d86
Update nebula-ent-release-note.md
cooper-lzy Oct 18, 2023
986ba38
Update nebula-ent-release-note.md
cooper-lzy Oct 18, 2023
7edc85e
Update ex-ug-connect.md
cooper-lzy Oct 19, 2023
968cdf8
Importer 4.1.0 update (#2286)
cooper-lzy Oct 19, 2023
bb4f773
importer 4.1.0 support ssl (#2284)
cooper-lzy Oct 19, 2023
7bdb709
Operator updates for 3.6.0 (#2277)
abby-cyber Oct 20, 2023
5a0f316
studio 3.8.0 (#2307)
cooper-lzy Oct 20, 2023
ca93141
Update Java and go client versions (#2308)
ChrisChen2023 Oct 20, 2023
cdac749
Filter out community content and support bilingual (#2314)
cooper-lzy Oct 25, 2023
0d2de7a
Update keywords-and-reserved-words.md
cooper-lzy Oct 25, 2023
a8e4c82
Update keywords-and-reserved-words.md
cooper-lzy Oct 25, 2023
095118b
new docs pv expansion & admission control (#2319)
abby-cyber Oct 30, 2023
f488eba
keep operator comm content consistency between en & ch (#2318)
abby-cyber Oct 30, 2023
67588ee
Add operator port (#2320)
ChrisChen2023 Oct 31, 2023
757396a
Merge branch 'master' into replica_of_3.6.0
ChrisChen2023 Oct 31, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .github/workflows/deploy-all.yml
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@ on:
# Remember to add v before the following version number unless the version is master.
- master


jobs:
deploy-zh:
uses: ./.github/workflows/deploy-zh.yml
Expand Down
5 changes: 5 additions & 0 deletions .github/workflows/deploy-en.yml
Original file line number Diff line number Diff line change
@@ -1,12 +1,16 @@
name: Publish English docs via GitHub Pages
env:

ACTIONTEST: master # no need to add v before the version number

on:
workflow_call:
push:
branches:
# Remember to add v before the following version number unless the version is master.

- master

paths:
- 'docs-2.0-en/**'

Expand Down Expand Up @@ -35,6 +39,7 @@ jobs:
git fetch origin gh-pages --depth=1 # fix mike's CI update
mike list
mike deploy ${{ env.ACTIONTEST }} -p --rebase

# The set-default command is only applicable to the latest version and must be commented in older versions.
# mike set-default ${{ env.ACTIONTEST }} -p --rebase
# mike list
Expand Down
6 changes: 6 additions & 0 deletions .github/workflows/deploy-zh.yml
Original file line number Diff line number Diff line change
@@ -1,15 +1,19 @@
name: Publish Chinese docs via GitHub Pages and upload to server
env:
# Remember to add v before the following version number unless the version is master.

ACTIONTEST: master

on:
workflow_call:
secrets:
ZHSITE_PASSWORD:
required: true
push:
branches:

- master

paths:
- 'docs-2.0-zh/**'

Expand Down Expand Up @@ -43,9 +47,11 @@ jobs:
git fetch origin gh-pages-zh --depth=1 # fix mike's CI update
mike list
mike deploy ${{ env.ACTIONTEST }} -b gh-pages-zh -p --rebase

# The set-default command is only applicable to the latest version and must be commented in older versions.
# mike set-default ${{ env.ACTIONTEST }} -b gh-pages-zh -p --rebase
# mike list


- name: show Chinese git branches
run: |
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -163,6 +163,7 @@ ELSE
END
ENDS
ENDS_WITH
FALSE
FORCE
FULLTEXT
FUZZY
Expand Down Expand Up @@ -230,6 +231,7 @@ TEXT
TEXT_SEARCH
THEN
TOP
TRUE
TTL_COL
TTL_DURATION
UNWIND
Expand All @@ -242,6 +244,4 @@ VID_TYPE
WILDCARD
ZONE
ZONES
FALSE
TRUE
```
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ NebulaGraph Operator does not support the v1.x version of NebulaGraph. NebulaGra

| NebulaGraph | NebulaGraph Operator |
| ------------- | -------------------- |
| 3.5.x ~ 3.6.0 | 1.5.0, 1.6.x |
| 3.5.x ~ 3.6.0 | 1.5.0 ~ 1.7.x |
| 3.0.0 ~ 3.4.1 | 1.3.0, 1.4.0 ~ 1.4.2 |
| 3.0.0 ~ 3.3.x | 1.0.0, 1.1.0, 1.2.0 |
| 2.5.x ~ 2.6.x | 0.9.0 |
Expand All @@ -43,9 +43,6 @@ NebulaGraph Operator does not support the v1.x version of NebulaGraph. NebulaGra
- The 1.x version NebulaGraph Operator is not compatible with NebulaGraph of version below v3.x.
- Starting from NebulaGraph Operator 0.9.0, logs and data are stored separately. Using NebulaGraph Operator 0.9.0 or later versions to manage a NebulaGraph 2.5.x cluster created with Operator 0.8.0 can cause compatibility issues. You can backup the data of the NebulaGraph 2.5.x cluster and then create a 2.6.x cluster with Operator 0.9.0.

### Feature limitations

The NebulaGraph Operator scaling feature is only available for the Enterprise Edition of NebulaGraph clusters and does not support scaling the Community Edition version of NebulaGraph clusters.

## Release note

Expand Down
3 changes: 2 additions & 1 deletion docs-2.0-en/nebula-operator/2.deploy-nebula-operator.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,8 @@ Before installing NebulaGraph Operator, you need to install the following softwa

!!! note

- If using a role-based access control policy, you need to enable [RBAC](https://kubernetes.io/docs/admin/authorization/rbac) (optional).
- If using a role-based access control policy, you need to enable [RBAC](https://kubernetes.io/docs/reference/access-authn-authz/rbac/) (optional).


- [CoreDNS](https://coredns.io/) is a flexible and scalable DNS server that is [installed](https://github.com/coredns/helm) for Pods in NebulaGraph clusters.

Expand Down

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
Expand Up @@ -65,23 +65,11 @@
kubectl -n "${NEBULA_CLUSTER_NAMESPACE}" get pod -l "app.kubernetes.io/cluster=${NEBULA_CLUSTER_NAME}"
```

Output:

```bash
NAME READY STATUS RESTARTS AGE
nebula-graphd-0 1/1 Running 0 5m34s
nebula-graphd-1 1/1 Running 0 5m34s
nebula-metad-0 1/1 Running 0 5m34s
nebula-metad-1 1/1 Running 0 5m34s
nebula-metad-2 1/1 Running 0 5m34s
nebula-storaged-0 1/1 Running 0 5m34s
nebula-storaged-1 1/1 Running 0 5m34s
nebula-storaged-2 1/1 Running 0 5m34s
```

## Scaling clusters

- The cluster scaling feature is for NebulaGraph Enterprise Edition only.
The cluster scaling feature is for NebulaGraph Enterprise Edition only.


## Delete clusters

Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,8 @@
# Customize configuration parameters for a NebulaGraph cluster

Meta, Storage, and Graph services in a NebulaGraph Cluster have their own configuration settings, which are defined in the YAML file of the NebulaGraph cluster instance as `config`. These settings are mapped and loaded into the corresponding service's ConfigMap in Kubernetes. At the time of startup, the configuration present in the ConfigMap is mounted onto the directory `/usr/local/nebula/etc/` for every service.
# Customize parameters for a NebulaGraph cluster

Meta, Storage, and Graph services in a NebulaGraph cluster have their own configuration settings, which are defined in the YAML file of the NebulaGraph cluster instance as `config`. These settings are mapped and loaded into the corresponding service's ConfigMap in Kubernetes. At the time of startup, the configuration present in the ConfigMap is mounted onto the directory `/usr/local/nebula/etc/` for every service.


!!! note

Expand All @@ -11,6 +13,9 @@ The structure of `config` is as follows.
```go
Config map[string]string `json:"config,omitempty"`
```



## Prerequisites

You have created a NebulaGraph cluster. For how to create a cluster with Kubectl, see [Create a cluster with Kubectl](../3.deploy-nebula-graph-cluster/3.1create-cluster-with-kubectl.md).
Expand All @@ -25,7 +30,9 @@ The following example uses a cluster named `nebula` and the cluster's configurat
kubectl edit nebulaclusters.apps.nebula-graph.io nebula
```

2. Add `enable_authorize` and `auth_type` under `spec.graphd.config`.

2. Customize parameters under the `spec.graphd.config` field. In the following sample, the `enable_authorize` and `auth_type` parameters are used for demonstration purposes.


```yaml
apiVersion: apps.nebula-graph.io/v1alpha1
Expand Down Expand Up @@ -55,20 +62,122 @@ The following example uses a cluster named `nebula` and the cluster's configurat
"auth_type": "password"
...
```


The parameters that can be added under the `config` field are listed in detail in the [Meta service configuration parameters](../../5.configurations-and-logs/1.configurations/2.meta-config.md), [Storage service configuration parameters](../../5.configurations-and-logs/1.configurations/4.storage-config.md), and [Graph service configuration parameters](../../5.configurations-and-logs/1.configurations/3.graph-config.md) topics.

!!! note

* To update cluster configurations without incurring pod restart, ensure that all parameters added under the `config` field support runtime dynamic modification. Check the **Whether supports runtime dynamic modifications** column of the parameter tables on the aforementioned parameter details pages to see if a parameter supports runtime dynamic modification.
* If one or more parameters that do not support runtime dynamic modification are added under the `config` field, pod restart is required for the parameters to take effect.



To add the `config` for the Meta and Storage services, add `spec.metad.config` and `spec.storaged.config` respectively.

3. Run `kubectl apply -f nebula_cluster.yaml` to push your configuration changes to the cluster.

After customizing the parameters `enable_authorize` and `auth_type`, the configurations in the corresponding ConfigMap (`nebula-graphd`) of the Graph service will be overwritten.

## Modify cluster configurations online
After customizing the parameters, the configurations in the corresponding ConfigMap (`nebula-graphd`) of the Graph service will be overwritten.


## Customize port configurations

You can add the `port` and `ws_http_port` parameters under the `config` field to customize port configurations. For details about these two parameters, see the Networking configurations section in [Meta service configuration parameters](../../5.configurations-and-logs/1.configurations/2.meta-config.md), [Storage service configuration parameters](../../5.configurations-and-logs/1.configurations/4.storage-config.md), and [Graph service configuration parameters](../../5.configurations-and-logs/1.configurations/3.graph-config.md).

!!! note

* Pod restart is required for the `port` and `ws_http_port` parameters to take effect.
* It is NOT recommnended to modify the `port` parameter after the cluster is started.

1. Modifiy the cluster configuration file.

```yaml
apiVersion: apps.nebula-graph.io/v1alpha1
kind: NebulaCluster
metadata:
name: nebula
namespace: default
spec:
graphd:
config:
port: "3669"
ws_http_port: "8080"
resources:
requests:
cpu: "200m"
memory: "500Mi"
limits:
cpu: "1"
memory: "1Gi"
replicas: 1
image: vesoft/nebula-graphd
version: {{nebula.tag}}
metad:
config:
ws_http_port: 8081
resources:
requests:
cpu: "300m"
memory: "500Mi"
limits:
cpu: "1"
memory: "1Gi"
replicas: 1
image: vesoft/nebula-metad
version: {{nebula.tag}}
dataVolumeClaim:
resources:
requests:
storage: 2Gi
storageClassName: local-path
storaged:
config:
ws_http_port: 8082
resources:
requests:
cpu: "300m"
memory: "500Mi"
limits:
cpu: "1"
memory: "1Gi"
replicas: 1
image: vesoft/nebula-storaged
version: {{nebula.tag}}
dataVolumeClaims:
- resources:
requests:
storage: 2Gi
storageClassName: local-path
enableAutoBalance: true
reference:
name: statefulsets.apps
version: v1
schedulerName: default-scheduler
imagePullPolicy: IfNotPresent
imagePullSecrets:
- name: nebula-image
enablePVReclaim: true
topologySpreadConstraints:
- topologyKey: kubernetes.io/hostname
whenUnsatisfiable: "ScheduleAnyway"
```

Cluster configurations are modified online by calling the HTTP interface, without the need to restart the cluster Pod.
2. Run the `kubectl apply -f nebula_cluster.yaml` to push your configuration changes to the cluster.

It should be noted that only when all configuration items in `config` are the parameters that can be dynamically modified at runtime, can the operation of online modifications be triggered. If the configuration items in `config` contain parameters that cannot be dynamically modified, then the cluster configuration will be updated by restarting the Pod.
3. Verify that the configuration takes effect.

For information about the parameters that can be dynamically modified for each service, see the parameter table column of **Whether supports runtime dynamic modifications** in [Meta service configuration parameters](../../5.configurations-and-logs/1.configurations/2.meta-config.md), [Storage service configuration parameters](../../5.configurations-and-logs/1.configurations/4.storage-config.md), and [Graph service configuration parameters](../../5.configurations-and-logs/1.configurations/3.graph-config.md), respectively.
```bash
kubectl get svc
```

Sample response:

```
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
nebula-graphd-headless ClusterIP None <none> 3669/TCP,8080/TCP 10m
nebula-graphd-svc ClusterIP 10.102.13.115 <none> 3669/TCP,8080/TCP 10m
nebula-metad-headless ClusterIP None <none> 9559/TCP,8081/TCP 11m
nebula-storaged-headless ClusterIP None <none> 9779/TCP,8082/TCP,9778/TCP 11m
```

Loading