Added kubernetes artifacts #2640

MATRIX4284 · 2021-09-30T21:38:10Z

What's in the PR

Kubernetes config file to run INCEpTION

How to test manually

kubectl create -f inception.yaml

Automatic testing

PR includes unit tests

Documentation

PR updates documentation

ukp-svc-jenkins · 2021-09-30T21:38:12Z

Can one of the admins verify this patch?

reckart · 2021-10-02T11:07:20Z

Thanks for the PR :) Could you please fill in the description template so we have an idea what the PR actually is?

MATRIX4284 · 2021-10-02T17:38:12Z

Added kuberetes artifact for inception so that it can e run as cloud native

MATRIX4284 · 2021-10-02T17:38:52Z

Thanks for the PR :) Could you please fill in the description template so we have an idea what the PR actually is?

I provided the kubernetes artifact so that we can run inception on kubernetes .

reckart · 2021-10-05T09:42:39Z

Ok, nice. How can one use it?

MATRIX4284 · 2021-10-05T11:30:52Z

Hi , It is executed by this command below. kubectl create -f inception.yaml I am giving the manual as a part of next pr. Thanks & Regards, Ka

…

On Tue, Oct 5, 2021, 3:12 PM Richard Eckart de Castilho < ***@***.***> wrote: Ok, nice. How can one use it? — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#2640 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AE7YQAGCY674PFFYPY3RSPTUFLCBTANCNFSM5FDI2JZA> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.

MATRIX4284 · 2021-10-07T18:05:33Z

Ok, nice. How can one use it?

Hi ,

It is executed by this command below.

kubectl create -f inception.yaml

I am giving the manual as a part of next pr.

Please let me know about the decision to merge.

Thanks & Regards,
Kaustav

reckart · 2021-10-08T05:13:04Z

The PR looks very helpful indeed.

However, I cannot tell if the location where the PR places the file is a good one.

Is it something that should be used out of the box? Probably not because there seem to be lots of settings that a particular user would want to change for their particular deployment. So a new module (as in the PR) doesn't seem quite right to me.

So it may be more an example file like the docker-compose.yml? In that case it would probably go next to the docker-compose.yml in the admin documentation: inception/inception-doc/src/main/resources/META-INF/asciidoc/admin-guide/scripts/ - and then a short piece of text explaining what the file does and how one would use it would be very useful - some installation_kubernetes.adoc file in /inception/inception-doc/src/main/resources/META-INF/asciidoc/admin-guide.

reckart · 2021-10-08T05:26:44Z

I have enabled Kubernetes on my Docker Desktop and tried the command that you said, but it doesn't seem to work:

% kubectl create -f inception.yaml
persistentvolume/inception-pv created
persistentvolumeclaim/inception-pvc created
service/inception-svc created
The Deployment "inception" is invalid: spec.template.spec.containers[0].volumeMounts[0].name: Not found: "mapr"

Corrwcted the volume name typo for which it was failing

MATRIX4284 · 2021-10-08T09:02:04Z

Corrected the typo in the volume name which was causing it to fail .

MATRIX4284 · 2021-10-08T09:02:50Z

I have enabled Kubernetes on my Docker Desktop and tried the command that you said, but it doesn't seem to work:

% kubectl create -f inception.yaml
persistentvolume/inception-pv created
persistentvolumeclaim/inception-pvc created
service/inception-svc created
The Deployment "inception" is invalid: spec.template.spec.containers[0].volumeMounts[0].name: Not found: "mapr"

Hi there was a typo in volume name I fixed that ..now it will run without errors

reckart · 2021-10-12T10:49:40Z

I still have not managed to actually start it. While the required things now all seem to be configured ok, the docker image does not start on my M1 Mac - interestingly I get further than if I try running the same image via docker run. I'm looking into doing a multi-platform image and then need to have another look at the kubernetes file. Looks like there is no database? How would one inject a custom settings.properties with kubernetes?

MATRIX4284 · 2021-10-12T11:58:32Z

M1 is a ARM architecture that is the reason it is failing . It is not a kubernetes issue but rather a docker image issue. I am using the docker image supplied in our inception docker which I guess is a X64 docker . In that case we need to add another docker for ARM to support m1 mac as m1 is a arm64 based architecture. Reference: https://www.toptal.com/apple/apple-m1-processor-compatibility-overview Thanks, Kaustav

…

On Tue, Oct 12, 2021, 4:19 PM Richard Eckart de Castilho < ***@***.***> wrote: I still have not managed to actually start it. While the required things now all seem to be configured ok, the docker image does not start on my M1 Mac - interestingly I get further than if I try running the same image via docker run. I'm looking into doing a multi-platform image and then need to have another look at the kubernetes file. Looks like there is no database? How would one inject a custom settings.properties with kubernetes? — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#2640 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AE7YQAAEYTT5KZW2MAA4HZLUGQHE5ANCNFSM5FDI2JZA> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.

reckart · 2021-10-12T12:01:06Z

Yes, as I said, I am looking into setting up a multi-platform image using docker buildx. Actually, I have meanwhile already managed to build an M1 compatible image. Next I need to look into how the multi-image setup can be pushed as part of the Maven build. Normally, I am using a Maven plugin to do that and that picks up the dockerhub credentials from my machine. When I try the same thing using docker buildx, it currently fails because of missing credentials. Baby steps...

reckart · 2021-10-12T17:51:28Z

Ok, so have a multi-platform image now -> #2651

I have managed to start INCEpTION using kubectl but I was unable to access port 8080 despite the YAML listing that port as exposed. docker ps also shows no accessible ports:

% docker ps
CONTAINER ID   IMAGE                                  COMMAND                  CREATED          STATUS          PORTS     NAMES
8be0756cb2df   inceptionproject/inception-snapshots   "/bin/sh -c 'java ${…"   22 seconds ago   Up 21 seconds             k8s_inception_inception-5c7dd56bc-9qqj2_default_fb030190-fddf-41f1-aa9e-b78cd2ba8ebf_0

Also, every once in a while when I start, the start fails:

% kubectl describe pods
...
Events:
  Type     Reason            Age              From               Message
  ----     ------            ----             ----               -------
  Warning  FailedScheduling  5s (x2 over 6s)  default-scheduler  0/1 nodes are available: 1 pod has unbound immediate PersistentVolumeClaims.

It seems that I always need to run kubectl delete -f ...; kubectl create -f ... twice until the whole thing starts up again.

MATRIX4284 · 2021-10-13T04:28:36Z

Seems like the volume is not getting created resulting in pvc without any bounded volume. I will run my check and update. Thanks & Regards, Kaustav

…

On Tue, Oct 12, 2021, 11:21 PM Richard Eckart de Castilho < ***@***.***> wrote: Ok, so have a multi-platform image now -> #2651 <#2651> I have managed to start INCEpTION using kubectl but I was unable to access port 8080 despite the YAML listing that port as exposed. docker ps also shows no accessible ports: % docker ps CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 8be0756cb2df inceptionproject/inception-snapshots "/bin/sh -c 'java ${…" 22 seconds ago Up 21 seconds k8s_inception_inception-5c7dd56bc-9qqj2_default_fb030190-fddf-41f1-aa9e-b78cd2ba8ebf_0 Also, every once in a while when I start, the start fails: % kubectl describe pods ... Events: Type Reason Age From Message ---- ------ ---- ---- ------- Warning FailedScheduling 5s (x2 over 6s) default-scheduler 0/1 nodes are available: 1 pod has unbound immediate PersistentVolumeClaims. It seems that I always need to run kubectl delete -f ...; kubectl create -f ... twice until the whole thing starts up again. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#2640 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AE7YQACQZ3CTCEB32UKCSCDUGRYSVANCNFSM5FDI2JZA> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.

reckart · 2021-10-13T06:18:03Z

@MATRIX4284 IMHO the question why the port doesn't seem accessible would be more interesting to look at. The volume seems a bit flaky but at least it also works from time to time. Do you have any idea regarding the port?

MATRIX4284 · 2021-10-13T09:16:38Z

Hi, I will look into it and get back to you. Thanks & Regards, Kaustav

…

On Wed, Oct 13, 2021, 11:48 AM Richard Eckart de Castilho < ***@***.***> wrote: @MATRIX4284 <https://github.com/MATRIX4284> IMHO the question why the port doesn't seem accessible would be more interesting to look at. The volume seems a bit flaky but at least it also works from time to time. Do you have any idea regarding the port? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#2640 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AE7YQAAAGGCGASTJU24W633UGUQCNANCNFSM5FDI2JZA> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.

blochs · 2021-12-13T14:41:23Z

You may want to look into an init container and mounting the volume for the config's required to get this to run in Kubernetes. In addition, having an Ingress config in the code might be helpful as well.

reckart · 2023-11-21T19:24:17Z

Trying this again now using Docker Desktop 4.25.1 (128006) and its built-in Kubernetes v1.28.2 - and ... it actually launches! 🚀

reckart · 2023-11-27T19:03:37Z

Superseded by #4325

1

3148a26

reckart added the 📖 Documentation label Oct 8, 2021

Update inception.yaml

d4546d7

Corrwcted the volume name typo for which it was failing

Merge branch 'main' into main

f27c81a

reckart marked this pull request as draft June 1, 2022 20:19

Merge branch 'main' into main

fdbc57a

reckart closed this Nov 27, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Added kubernetes artifacts #2640

Added kubernetes artifacts #2640

MATRIX4284 commented Sep 30, 2021 •

edited by reckart

Loading

ukp-svc-jenkins commented Sep 30, 2021

reckart commented Oct 2, 2021

MATRIX4284 commented Oct 2, 2021

MATRIX4284 commented Oct 2, 2021 •

edited

Loading

reckart commented Oct 5, 2021

MATRIX4284 commented Oct 5, 2021 via email

MATRIX4284 commented Oct 7, 2021

reckart commented Oct 8, 2021

reckart commented Oct 8, 2021

MATRIX4284 commented Oct 8, 2021

MATRIX4284 commented Oct 8, 2021

reckart commented Oct 12, 2021

MATRIX4284 commented Oct 12, 2021 via email

reckart commented Oct 12, 2021

reckart commented Oct 12, 2021

MATRIX4284 commented Oct 13, 2021 via email

reckart commented Oct 13, 2021

MATRIX4284 commented Oct 13, 2021 via email

blochs commented Dec 13, 2021

reckart commented Nov 21, 2023

reckart commented Nov 27, 2023

Added kubernetes artifacts #2640

Added kubernetes artifacts #2640

Conversation

MATRIX4284 commented Sep 30, 2021 • edited by reckart Loading

ukp-svc-jenkins commented Sep 30, 2021

reckart commented Oct 2, 2021

MATRIX4284 commented Oct 2, 2021

MATRIX4284 commented Oct 2, 2021 • edited Loading

reckart commented Oct 5, 2021

MATRIX4284 commented Oct 5, 2021 via email

MATRIX4284 commented Oct 7, 2021

reckart commented Oct 8, 2021

reckart commented Oct 8, 2021

MATRIX4284 commented Oct 8, 2021

MATRIX4284 commented Oct 8, 2021

reckart commented Oct 12, 2021

MATRIX4284 commented Oct 12, 2021 via email

reckart commented Oct 12, 2021

reckart commented Oct 12, 2021

MATRIX4284 commented Oct 13, 2021 via email

reckart commented Oct 13, 2021

MATRIX4284 commented Oct 13, 2021 via email

blochs commented Dec 13, 2021

reckart commented Nov 21, 2023

reckart commented Nov 27, 2023

MATRIX4284 commented Sep 30, 2021 •

edited by reckart

Loading

MATRIX4284 commented Oct 2, 2021 •

edited

Loading