Sunbird Knowlg
Replies: 10 comments 35 replies
-
|
could you please log all the build and deployment job details(github repo and tag/branch) for flinkjobs. I am not sure QR code flinkjob is part of which build and deploy job. eg. |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
@ddevadat , FYI Build/KnowledgePlatform/FlinkJobs: Repo: https://github.com/Sunbird-Knowlg/knowledge-platform-jobs.git
Repo: https://github.com/Sunbird-Knowlg/sunbird-learning-platform
|
Beta Was this translation helpful? Give feedback.
-
|
can you show the contents of the config map for qrcode-image-generator. You can mask out any sensitive fields |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
@ddevadat , please find the configmap |
Beta Was this translation helpful? Give feedback.
-
|
i noticed a few things..not sure if this is related https://github.com/Sunbird-Knowlg/knowledge-platform-jobs/tree/release-5.5.0_RC2 Its not taking the proxy host values...its taking the endpoint only. Also in the config map, the below should not be same. proxy host should be something like https://files.sunbird.ex001.in |
Beta Was this translation helpful? Give feedback.
3 replies
-
|
@ddevadat, in the other working OCI environment (hotfix), we've checked it and it is using the same endpoint for the proxy_host. |
Beta Was this translation helpful? Give feedback.
-
|
@vj4a can you update cloud_storage_proxy_host value in the configmag to https://files.sunbird.ex001.in and check? |
Beta Was this translation helpful? Give feedback.
-
|
@gandham-santhosh , Tried with https://files.sunbird.ex001.in/ but still results in same error. |
Beta Was this translation helpful? Give feedback.
-
|
can you get the output of the the below command from oci cloud shell oci iam region-subscription list |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
@ddevadat , FYI |
Beta Was this translation helpful? Give feedback.
-
|
Trying to narrow down the problem, is the cloud store sdk 1.4.6 working as expected for other services like content etc. Or is it failing only for the flinkjob For the kpflinkjob build job...search for the keyword jclouds-all..something like below |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
@ddevadat , it is failing only for this particular flink job. Other services are working fine. |
Beta Was this translation helpful? Give feedback.
-
|
is this bucket dial-ed already present? If not can you try to create the bucket first manuall and then then the job. I am interested to know what level of permission is given to this user to manage object storage |
Beta Was this translation helpful? Give feedback.
2 replies
-
|
@ddevadat , the bucket is already present. We've checked the permissions of the keys mentioned in configmap by uploading a file to the bucket using boto3. The customer secret keys were created with my account which has full s3 permissions. |
Beta Was this translation helpful? Give feedback.
-
|
Verified so far. Could you please show the compartment structure. e.g root---> deployment_compartment in which compartment is the bucket dial-ed located? |
Beta Was this translation helpful? Give feedback.
-
|
Dial-ed bucket is in SBEd-Sandbox compartment. I have access only for this compartment.
@gandham-santhosh , kindly confirm if I have admin access inside this compartment. |
Beta Was this translation helpful? Give feedback.
4 replies
-
|
@santhosh-tg can you please check the permission? |
Beta Was this translation helpful? Give feedback.
-
|
@vj4a user is part of cloudifyops group which has access to all the resources in the compartment.
|
Beta Was this translation helpful? Give feedback.
-
|
is the bucket dial-ed created in the compartment SBEd-Sandbox? |
Beta Was this translation helpful? Give feedback.
-
|
yes @ddevadat |
Beta Was this translation helpful? Give feedback.
-
|
Based on the exception stack Its calling But if you look at the code base of OCIS3StorageService.scala:46, its checking if the container exist or not. Ideally if it has detected that the container exists , it should not have gone to invoke blobStore.createContainerInLocation(null, container) Is it possible to add this policy also temporarily
|
Beta Was this translation helpful? Give feedback.
4 replies
-
|
@ddevadat Added the policy |
Beta Was this translation helpful? Give feedback.
-
|
test the scenario again to see if it makes any difference |
Beta Was this translation helpful? Give feedback.
-
|
@ddevadat @santhosh-tg, checking it now |
Beta Was this translation helpful? Give feedback.
-
|
@ddevadat @santhosh-tg , the option to download QR code is not showing up in UI. |
Beta Was this translation helpful? Give feedback.
-
|
can you enable flink debug logs to track the request progress..to see if it reached or passed the previous point of failure |
Beta Was this translation helpful? Give feedback.
3 replies
-
|
@ddevadat , Redeployed the job once again and QR codes are getting downloaded now as expected. |
Beta Was this translation helpful? Give feedback.
-
|
Please find the logs, |
Beta Was this translation helpful? Give feedback.
-
|
may the code is taking the bucket name as dial and not honouring the bucket name given in the variable cloud_storage_container as far as the bucket dial getting created in the root compartment..thats the default behaviour if the bucket doesnt pre exist. You can move the bucket to the SBEd-Sandbox compartment. I guess, it was always trying to upload to dial bucket which never existed. So it tried to create one in the root compartment, which your user didnt have the permission to do so. |
Beta Was this translation helpful? Give feedback.
-
@vj4a Its not root compartment , its created in SunbirdedHotfix which we are using. Can you create the bucket with name dial in SBEd-Sandbox compartment and test again to see if the files getting created there? |
Beta Was this translation helpful? Give feedback.
15 replies
-
|
please find logs |
Beta Was this translation helpful? Give feedback.
-
|
@vj4a Where are you getting wrong URL? from above logs url path is updated correctly only |
Beta Was this translation helpful? Give feedback.
-
|
yeah it is showing the correct URL there but the reponse for https://sunbird.ex001.in/action/dialcode/v1/process/status/52ecbd43-df92-4a62-85b2-af6028c22796 and so the subsequent request goes as ,
|
Beta Was this translation helpful? Give feedback.
-
|
Changed the metadata.replace_absolute_path to true in dial service configmap and it is working as expected. |
Beta Was this translation helpful? Give feedback.
-
|
@vj4a I got the issue. It because in dial-service below configuration is set it as |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi team,
On creating QR codes for textbook, the upload fails and we are getting the below error in qrcode-image-generator-taskmanager pod.
CC: @gandham-santhosh @ddevadat
Beta Was this translation helpful? Give feedback.
All reactions