Deploy -> KnowledgePlatform -> Neo4jDefinitionUpdate #151

daveanvit · 2022-09-12T08:51:44Z

daveanvit
Sep 12, 2022

Followed this thread for setup
`Started by user admin
Checking out git https://github.com/project-sunbird/sunbird-learning-platform.git into /var/lib/jenkins/workspace/Deploy/dev/KnowledgePlatform/Neo4jDefinitionUpdate@script/59115e63d0c6b69e8742ea936ed6286806291a871c9dc76e3f9cc0e75a998e1c to read pipelines/deploy/neo4j-definition-update/Jenkinsfile
The recommended git tool is: git
No credentials specified

git rev-parse --resolve-git-dir /var/lib/jenkins/workspace/Deploy/dev/KnowledgePlatform/Neo4jDefinitionUpdate@script/59115e63d0c6b69e8742ea936ed6286806291a871c9dc76e3f9cc0e75a998e1c/.git # timeout=10
Fetching changes from the remote Git repository
git config remote.origin.url https://github.com/project-sunbird/sunbird-learning-platform.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/project-sunbird/sunbird-learning-platform.git
git --version # timeout=10
git --version # 'git version 2.37.3'
git fetch --tags --force --progress --depth=1 -- https://github.com/project-sunbird/sunbird-learning-platform.git +refs/heads/:refs/remotes/origin/ # timeout=10
git rev-parse origin/release-4.6.0_RC2^{commit} # timeout=10
git rev-parse release-4.6.0_RC2^{commit} # timeout=10
Checking out Revision d708cf824572355205448d7695e9885b033c769a (release-4.6.0_RC2)
git config core.sparsecheckout # timeout=10
git checkout -f d708cf824572355205448d7695e9885b033c769a # timeout=10
Commit message: "Issue #SB-28039 merge: Merge pull request #1657 from krgauraw/release-4.6.0"
git rev-list --no-walk d708cf824572355205448d7695e9885b033c769a # timeout=10
Loading library deploy-conf@heads/shared-lib
Attempting to resolve heads/shared-lib from remote references...
git --version # timeout=10
git --version # 'git version 2.37.3'
git ls-remote -- https://github.com/project-sunbird/sunbird-devops.git # timeout=10
The recommended git tool is: NONE
No credentials specified
git rev-parse --resolve-git-dir /var/lib/jenkins/workspace/Deploy/dev/KnowledgePlatform/Neo4jDefinitionUpdate@libs/deploy-conf/.git # timeout=10
Fetching changes from the remote Git repository
git config remote.origin.url https://github.com/project-sunbird/sunbird-devops.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/project-sunbird/sunbird-devops.git
git --version # timeout=10
git --version # 'git version 2.37.3'
git fetch --no-tags --force --progress --depth=1 -- https://github.com/project-sunbird/sunbird-devops.git +refs/heads/:refs/remotes/origin/ refs/heads/shared-lib # timeout=10
Checking out Revision 778da7ce7f97efd003eed98071921a837d209343 (778da7ce7f97efd003eed98071921a837d209343)
git config core.sparsecheckout # timeout=10
git checkout -f 778da7ce7f97efd003eed98071921a837d209343 # timeout=10
Commit message: "fix: move variables to be accessible across both try blocks"
git rev-list --no-walk 778da7ce7f97efd003eed98071921a837d209343 # timeout=10
[Pipeline] Start of Pipeline
[Pipeline] node
Running on Jenkins in /var/lib/jenkins/workspace/Deploy/dev/KnowledgePlatform/Neo4jDefinitionUpdate
[Pipeline] {
[Pipeline] stage
[Pipeline] { (checkout public repo)
[Pipeline] echo
Found .git folder. Clearing it..
[Pipeline] sh

git clean -fxd
Removing private@tmp/
[Pipeline] checkout
The recommended git tool is: git
No credentials specified

git rev-parse --resolve-git-dir /var/lib/jenkins/workspace/Deploy/dev/KnowledgePlatform/Neo4jDefinitionUpdate/.git # timeout=10
Fetching changes from the remote Git repository
git config remote.origin.url https://github.com/project-sunbird/sunbird-learning-platform.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/project-sunbird/sunbird-learning-platform.git
git --version # timeout=10
git --version # 'git version 2.37.3'
git fetch --tags --force --progress --depth=1 -- https://github.com/project-sunbird/sunbird-learning-platform.git +refs/heads/:refs/remotes/origin/ # timeout=10
git rev-parse origin/release-4.6.0_RC2^{commit} # timeout=10
git rev-parse release-4.6.0_RC2^{commit} # timeout=10
Checking out Revision d708cf824572355205448d7695e9885b033c769a (release-4.6.0_RC2)
git config core.sparsecheckout # timeout=10
git checkout -f d708cf824572355205448d7695e9885b033c769a # timeout=10
Commit message: "Issue #SB-28039 merge: Merge pull request #1657 from krgauraw/release-4.6.0"
[Pipeline] }
[Pipeline] // stage
[Pipeline] ansiColor
[Pipeline] {

[Pipeline] stage
[Pipeline] { (deploy)
[Pipeline] sh

echo Deploy/dev/KnowledgePlatform/Neo4jDefinitionUpdate
[Pipeline] sh
echo Deploy/dev/KnowledgePlatform/Neo4jDefinitionUpdate
[Pipeline] sh
echo Deploy/dev/KnowledgePlatform/Neo4jDefinitionUpdate
[Pipeline] sh
pwd
[Pipeline] echo
{currentWs=/var/lib/jenkins/workspace/Deploy/dev/KnowledgePlatform/Neo4jDefinitionUpdate, env=dev, module=KnowledgePlatform, jobName=Neo4jDefinitionUpdate, ansiblePlaybook=/var/lib/jenkins/workspace/Deploy/dev/KnowledgePlatform/Neo4jDefinitionUpdate/ansible/lp_definition_update.yml, ansibleExtraArgs=--vault-password-file /var/lib/jenkins/secrets/vault-pass}
[Pipeline] ansiColor
[Pipeline] {

[Pipeline] stage
[Pipeline] { (ansible-run)
[Pipeline] echo
{currentWs=/var/lib/jenkins/workspace/Deploy/dev/KnowledgePlatform/Neo4jDefinitionUpdate, env=dev, module=KnowledgePlatform, jobName=Neo4jDefinitionUpdate, ansiblePlaybook=/var/lib/jenkins/workspace/Deploy/dev/KnowledgePlatform/Neo4jDefinitionUpdate/ansible/lp_definition_update.yml, ansibleExtraArgs=--vault-password-file /var/lib/jenkins/secrets/vault-pass}
[Pipeline] dir
Running in /var/lib/jenkins/workspace/Deploy/dev/KnowledgePlatform/Neo4jDefinitionUpdate/private
[Pipeline] {
[Pipeline] echo
Info: Branch override is enabled
[Pipeline] checkout
The recommended git tool is: NONE
using credential github-cred

git rev-parse --resolve-git-dir /var/lib/jenkins/workspace/Deploy/dev/KnowledgePlatform/Neo4jDefinitionUpdate/private/.git # timeout=10
Fetching changes from the remote Git repository
git config remote.origin.url https://github.com/daveanvit/searce-diksha-sunbird.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/daveanvit/searce-diksha-sunbird.git
git --version # timeout=10
git --version # 'git version 2.37.3'
using GIT_ASKPASS to set credentials
git fetch --no-tags --force --progress --depth=1 -- https://github.com/daveanvit/searce-diksha-sunbird.git +refs/heads/:refs/remotes/origin/ # timeout=10
git rev-parse origin/main^{commit} # timeout=10
Checking out Revision 7792a318c641898203e6f08faeaae583eedcdd4f (origin/main)
git config core.sparsecheckout # timeout=10
git checkout -f 7792a318c641898203e6f08faeaae583eedcdd4f # timeout=10
Commit message: "Add files via upload"
git rev-list --no-walk e86d1d2ac82607ac8114933043e5b3eebc0b6b26 # timeout=10
[Pipeline] }
[Pipeline] // dir
[Pipeline] sh

rsync -Lkr /var/lib/jenkins/workspace/Deploy/dev/KnowledgePlatform/Neo4jDefinitionUpdate/private/ansible/inventory/dev/KnowledgePlatform/common.yml /var/lib/jenkins/workspace/Deploy/dev/KnowledgePlatform/Neo4jDefinitionUpdate/private/ansible/inventory/dev/KnowledgePlatform/hosts /var/lib/jenkins/workspace/Deploy/dev/KnowledgePlatform/Neo4jDefinitionUpdate/private/ansible/inventory/dev/KnowledgePlatform/secrets.yml /var/lib/jenkins/workspace/Deploy/dev/KnowledgePlatform/Neo4jDefinitionUpdate/ansible/inventory/env/
[ -f /var/lib/jenkins/workspace/Deploy/dev/KnowledgePlatform/Neo4jDefinitionUpdate/ansible/inventory/env/kubernetes.yaml ]
ansible-playbook -i /var/lib/jenkins/workspace/Deploy/dev/KnowledgePlatform/Neo4jDefinitionUpdate/ansible/inventory/env/hosts /var/lib/jenkins/workspace/Deploy/dev/KnowledgePlatform/Neo4jDefinitionUpdate/ansible/lp_definition_update.yml --vault-password-file /var/lib/jenkins/secrets/vault-pass
[WARNING]: Invalid characters were found in group names but not replaced, use
-vvvv to see details

PLAY [learningall] *************************************************************

TASK [Gathering Facts] *********************************************************
/usr/lib/python3/dist-packages/requests/init.py:80: RequestsDependencyWarning: urllib3 (1.26.12) or chardet (3.0.4) doesn't match a supported version!
RequestsDependencyWarning)
ok: [192.170.0.10]

TASK [Update definitions] ******************************************************
[DEPRECATION WARNING]: Supplying headers via HEADER_* is deprecated. Please use
headers to supply headers for the request. This feature will be removed in
version 2.9. Deprecation warnings can be disabled by setting
deprecation_warnings=False in ansible.cfg.
failed: [192.170.0.10] (item=content_definition) => {
"ansible_loop_var": "item",
"changed": false,
"connection": "close",
"content": "{"id":"ekstep.definition.create","ver":"1.0","ts":"2022-09-12T08:49:03ZZ","params":{"resmsgid":"69ed0ad9-d097-47c6-ab2a-a43b96f3ca69","msgid":null,"err":"ERR_GRAPH_PROCESSING_ERROR","status":"failed","errmsg":"Error! Something went wrong while validating the request"},"responseCode":"SERVER_ERROR","result":{}}",
"content_type": "application/json;charset=UTF-8",
"date": "Mon, 12 Sep 2022 08:49:03 GMT",
"elapsed": 1,
"item": "content_definition",
"json": {
"id": "ekstep.definition.create",
"params": {
"err": "ERR_GRAPH_PROCESSING_ERROR",
"errmsg": "Error! Something went wrong while validating the request",
"msgid": null,
"resmsgid": "69ed0ad9-d097-47c6-ab2a-a43b96f3ca69",
"status": "failed"
},
"responseCode": "SERVER_ERROR",
"result": {},
"ts": "2022-09-12T08:49:03ZZ",
"ver": "1.0"
},
"redirected": false,
"server": "Apache-Coyote/1.1",
"status": 500,
"transfer_encoding": "chunked",
"url": "http://localhost:8080/learning-service/taxonomy/domain/definition"
}

MSG:

Status code was 500 and not [200]: HTTP Error 500: Internal Server Error

failed: [192.170.0.10] (item=content_image_definition) => {
"ansible_loop_var": "item",
"changed": false,
"connection": "close",
"content": "{"id":"ekstep.definition.create","ver":"1.0","ts":"2022-09-12T08:49:04ZZ","params":{"resmsgid":"45f51192-79f3-4971-823a-0c77b59a6c6d","msgid":null,"err":"ERR_GRAPH_PROCESSING_ERROR","status":"failed","errmsg":"Error! Something went wrong while validating the request"},"responseCode":"SERVER_ERROR","result":{}}",
"content_type": "application/json;charset=UTF-8",
"date": "Mon, 12 Sep 2022 08:49:03 GMT",
"elapsed": 0,
"item": "content_image_definition",
"json": {
"id": "ekstep.definition.create",
"params": {
"err": "ERR_GRAPH_PROCESSING_ERROR",
"errmsg": "Error! Something went wrong while validating the request",
"msgid": null,
"resmsgid": "45f51192-79f3-4971-823a-0c77b59a6c6d",
"status": "failed"
},
"responseCode": "SERVER_ERROR",
"result": {},
"ts": "2022-09-12T08:49:04ZZ",
"ver": "1.0"
},
"redirected": false,
"server": "Apache-Coyote/1.1",
"status": 500,
"transfer_encoding": "chunked",
"url": "http://localhost:8080/learning-service/taxonomy/domain/definition"
}

MSG:

Status code was 500 and not [200]: HTTP Error 500: Internal Server Error

ok: [192.170.0.10] => (item=item_definition)
ok: [192.170.0.10] => (item=itemset_definition)
ok: [192.170.0.10] => (item=channel_definition)
ok: [192.170.0.10] => (item=concept_definition)
ok: [192.170.0.10] => (item=dimension_definition)
ok: [192.170.0.10] => (item=domain_definition)
ok: [192.170.0.10] => (item=method_definition)
ok: [192.170.0.10] => (item=category_definition)
ok: [192.170.0.10] => (item=categoryInstance_definition)
ok: [192.170.0.10] => (item=framework_definition)
ok: [192.170.0.10] => (item=term_definition)
ok: [192.170.0.10] => (item=misconception_definition)
ok: [192.170.0.10] => (item=license_definition)
ok: [192.170.0.10] => (item=objectcategory_definition)
ok: [192.170.0.10] => (item=objectcategorydefinition_definition)
failed: [192.170.0.10] (item=collection_definition) => {
"ansible_loop_var": "item",
"changed": false,
"connection": "close",
"content": "{"id":"ekstep.definition.create","ver":"1.0","ts":"2022-09-12T08:49:11ZZ","params":{"resmsgid":"8ba2e470-9c69-4ffd-9640-cf29ebc290ab","msgid":null,"err":"ERR_GRAPH_PROCESSING_ERROR","status":"failed","errmsg":"Error! Something went wrong while validating the request"},"responseCode":"SERVER_ERROR","result":{}}",
"content_type": "application/json;charset=UTF-8",
"date": "Mon, 12 Sep 2022 08:49:11 GMT",
"elapsed": 0,
"item": "collection_definition",
"json": {
"id": "ekstep.definition.create",
"params": {
"err": "ERR_GRAPH_PROCESSING_ERROR",
"errmsg": "Error! Something went wrong while validating the request",
"msgid": null,
"resmsgid": "8ba2e470-9c69-4ffd-9640-cf29ebc290ab",
"status": "failed"
},
"responseCode": "SERVER_ERROR",
"result": {},
"ts": "2022-09-12T08:49:11ZZ",
"ver": "1.0"
},
"redirected": false,
"server": "Apache-Coyote/1.1",
"status": 500,
"transfer_encoding": "chunked",
"url": "http://localhost:8080/learning-service/taxonomy/domain/definition"
}

MSG:

Status code was 500 and not [200]: HTTP Error 500: Internal Server Error

failed: [192.170.0.10] (item=collection_image_definition) => {
"ansible_loop_var": "item",
"changed": false,
"connection": "close",
"content": "{"id":"ekstep.definition.create","ver":"1.0","ts":"2022-09-12T08:49:12ZZ","params":{"resmsgid":"bd5a457e-23f2-4bfd-8b04-4063febdc4f4","msgid":null,"err":"ERR_GRAPH_PROCESSING_ERROR","status":"failed","errmsg":"Error! Something went wrong while validating the request"},"responseCode":"SERVER_ERROR","result":{}}",
"content_type": "application/json;charset=UTF-8",
"date": "Mon, 12 Sep 2022 08:49:11 GMT",
"elapsed": 0,
"item": "collection_image_definition",
"json": {
"id": "ekstep.definition.create",
"params": {
"err": "ERR_GRAPH_PROCESSING_ERROR",
"errmsg": "Error! Something went wrong while validating the request",
"msgid": null,
"resmsgid": "bd5a457e-23f2-4bfd-8b04-4063febdc4f4",
"status": "failed"
},
"responseCode": "SERVER_ERROR",
"result": {},
"ts": "2022-09-12T08:49:12ZZ",
"ver": "1.0"
},
"redirected": false,
"server": "Apache-Coyote/1.1",
"status": 500,
"transfer_encoding": "chunked",
"url": "http://localhost:8080/learning-service/taxonomy/domain/definition"
}

MSG:

Status code was 500 and not [200]: HTTP Error 500: Internal Server Error

failed: [192.170.0.10] (item=asset_definition) => {
"ansible_loop_var": "item",
"changed": false,
"connection": "close",
"content": "{"id":"ekstep.definition.create","ver":"1.0","ts":"2022-09-12T08:49:12ZZ","params":{"resmsgid":"a7b0b2fe-2763-459c-b5f0-f99b7a7f9edb","msgid":null,"err":"ERR_GRAPH_PROCESSING_ERROR","status":"failed","errmsg":"Error! Something went wrong while validating the request"},"responseCode":"SERVER_ERROR","result":{}}",
"content_type": "application/json;charset=UTF-8",
"date": "Mon, 12 Sep 2022 08:49:12 GMT",
"elapsed": 0,
"item": "asset_definition",
"json": {
"id": "ekstep.definition.create",
"params": {
"err": "ERR_GRAPH_PROCESSING_ERROR",
"errmsg": "Error! Something went wrong while validating the request",
"msgid": null,
"resmsgid": "a7b0b2fe-2763-459c-b5f0-f99b7a7f9edb",
"status": "failed"
},
"responseCode": "SERVER_ERROR",
"result": {},
"ts": "2022-09-12T08:49:12ZZ",
"ver": "1.0"
},
"redirected": false,
"server": "Apache-Coyote/1.1",
"status": 500,
"transfer_encoding": "chunked",
"url": "http://localhost:8080/learning-service/taxonomy/domain/definition"
}

MSG:

Status code was 500 and not [200]: HTTP Error 500: Internal Server Error

ok: [192.170.0.10] => (item=question_definition)
ok: [192.170.0.10] => (item=question_image_definition)
ok: [192.170.0.10] => (item=questionset_definition)
ok: [192.170.0.10] => (item=questionset_image_definition)

PLAY RECAP *********************************************************************
192.170.0.10 : ok=1 changed=0 unreachable=0 failed=1 skipped=0 rescued=0 ignored=0

[Pipeline] }
[Pipeline] // stage
[Pipeline] }

[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // stage
[Pipeline] }

[Pipeline] // ansiColor
[Pipeline] ansiColor
[Pipeline] {

[Pipeline] stage
[Pipeline] { (slack_notify)
[Pipeline] sh

git rev-parse --short HEAD
[Pipeline] sh
git name-rev --name-only HEAD
rev
cut -d / -f1
rev
[Pipeline] sh
echo Deploy/dev/KnowledgePlatform/Neo4jDefinitionUpdate
[Pipeline] echo
Could not find env specific Slack channel. Check for global slack channel..
[Pipeline] echo
Could not find slack environment variable. Skipping slack notification..
[Pipeline] }
[Pipeline] // stage
[Pipeline] }

[Pipeline] // ansiColor
[Pipeline] ansiColor
[Pipeline] {

[Pipeline] stage
[Pipeline] { (email_notify)
[Pipeline] sh

echo Deploy/dev/KnowledgePlatform/Neo4jDefinitionUpdate
[Pipeline] echo
Could not find env specific email group. Check for global email group..
[Pipeline] echo
Could not find global email group variable. Skipping email notification..
[Pipeline] }
[Pipeline] // stage
[Pipeline] }

[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // node
[Pipeline] End of Pipeline
ERROR: script returned exit code 2
Finished: FAILURE`

Answered by daveanvit

Sep 12, 2022

Redis is running on different VM is this causing the issue?

root@kp-learning:/# curl -sS localhost:8080/learning-service/health | jq .
{
  "id": "learning-service.health",
  "ver": "1.0",
  "ts": "2022-09-12T08:59:07ZZ",
  "params": {
    "resmsgid": "66d6774b-b059-4fbe-9277-46022b72ec76",
    "msgid": null,
    "err": null,
    "status": "successful",
    "errmsg": null
  },
  "responseCode": "OK",
  "result": {
    "checks": [
      {
        "healthy": true,
        "name": "domain graph"
      },
      {
        "err": "503",
        "healthy": false,
        "name": "redis cache",
        "errmsg": "Could not get a resource from the pool"
      },
      {
        "healthy": true,
   …

View full answer

daveanvit · 2022-09-12T09:12:37Z

daveanvit
Sep 12, 2022
Author

Redis is running on different VM is this causing the issue?

root@kp-learning:/# curl -sS localhost:8080/learning-service/health | jq .
{
  "id": "learning-service.health",
  "ver": "1.0",
  "ts": "2022-09-12T08:59:07ZZ",
  "params": {
    "resmsgid": "66d6774b-b059-4fbe-9277-46022b72ec76",
    "msgid": null,
    "err": null,
    "status": "successful",
    "errmsg": null
  },
  "responseCode": "OK",
  "result": {
    "checks": [
      {
        "healthy": true,
        "name": "domain graph"
      },
      {
        "err": "503",
        "healthy": false,
        "name": "redis cache",
        "errmsg": "Could not get a resource from the pool"
      },
      {
        "healthy": true,
        "name": "cassandra db"
      }
    ],
    "healthy": false
  }
}

1 reply

daveanvit Sep 12, 2022
Author

Redis was not running on same VM, that was causing issue

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Sunbird-ED (Sunbird for Education)

Deploy -> KnowledgePlatform -> Neo4jDefinitionUpdate #151

{{title}}

Replies: 1 comment 1 reply

{{title}}

{{title}}

Select a reply

Sunbird-ED (Sunbird for Education)

Deploy -> KnowledgePlatform -> Neo4jDefinitionUpdate #151

daveanvit Sep 12, 2022

Replies: 1 comment · 1 reply

daveanvit Sep 12, 2022 Author

daveanvit Sep 12, 2022 Author

daveanvit
Sep 12, 2022

Replies: 1 comment 1 reply

daveanvit
Sep 12, 2022
Author

daveanvit Sep 12, 2022
Author