Deploy VDK Demo

Create new repo: https://github.com/new

Create https://test.pypi.org/account/register/ Go to https://test.pypi.org/manage/account/

Let's create our sdk flavour folder

mkdir my-org-sdk

cd my-org-sdk

Then we simply create setup.py

code setup.py

The minimum content is all the plugins (lego blocks) that we need. Here we can add our own custom plugins as well.

import setuptools

setuptools.setup( name="my-org-vdk", version="1.0", install_requires=[ "vdk-core", "vdk-plugin-control-cli", "vdk-postgres", "vdk-snowflake", "vdk-ingest-http", "vdk-ingest-file", ] )

And then we simply release this to Python central repository

python setup.py sdist --formats=gztar

twine upload --repository-url $PIP_REPO_UPLOAD_URL -u "$PIP_REPO_UPLOAD_USER_NAME" -p "$PIP_REPO_UPLOAD_USER_PASSWORD" dist/my-org-vdk-

code Dockerfile-vdk-base

FROM python:3.7-slim

WORKDIR /vdk

ENV VDK_VERSION $vdk_version

Install VDK

RUN pip install --extra-index-url https://test.pypi.org/simple my-org-vdk

docker build -t ghcr.io/tozka/my-org-vdk:1.0 -t ghcr.io/tozka/my-org-vdk:release -f Dockerfile-vdk-base .

docker push ghcr.io/tozka/my-org-vdk:release docker push ghcr.io/tozka/my-org-vdk:1.0

code values.yaml

deploymentVdkDistributionImage:

registryUsernameReadOnly: "tozka" registryPasswordReadOnly: "${GIT_TOKEN}"

registry: ghcr.io/tozka repository: "my-org-vdk" tag: "release"

helm install --wait --timeout 5m0s my-vdk-runtime vdk-gitlab/pipelines-control-service -f values.yaml

---