Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Metadata writer component error #5872

Closed
santoshmarepally opened this issue Jun 16, 2021 · 2 comments
Closed

Metadata writer component error #5872

santoshmarepally opened this issue Jun 16, 2021 · 2 comments
Labels
area/backend help wanted The community is welcome to contribute. kind/bug lifecycle/stale The issue / pull request is stale, any activities remove this label.

Comments

@santoshmarepally
Copy link

There is an error in metadata writer component that seems to be not propagated to the application. When I run describe on application, it is coming back with "NoError".

Environment

  • How did you deploy Kubeflow Pipelines (KFP)?
  • KFP version:
  • KFP SDK version:

kfp 1.4.0
kfp-pipeline-spec 0.1.7
kfp-server-api 1 .5.0

Steps to reproduce

kubectl apply -k ./. (this is creating issues)

Error from the logs:
2021-06-16T14:07:48.349192561Z2021-06-16 14:07:48.348369: F ml_metadata/metadata_store/metadata_store_server_main.cc:226] Non-OK-status: status status: Internal: mysql_real_connect failed: errno: 0, error: MetadataStore cannot be created with the given connection config.

(this is failing because of metadata component issues from above command)
kubectl wait applications/pipeline -n kubeflow --for condition=Ready --timeout=1800s
error: timed out waiting for the condition on applications/pipeline

kubectl get applications -n kubeflow
NAME AGE
pipeline 8d

kubectl describe applications -n kubeflow
Conditions:
Last Transition Time: 2021-06-16T04:18:53Z
Last Update Time: 2021-06-16T04:18:53Z
Message: some components not ready
Reason: ComponentsNotReady
Status: False
Type: Ready
Last Transition Time: 2021-06-07T19:19:14Z
Last Update Time: 2021-06-07T19:19:14Z
Message: No error seen
Reason: NoError
Status: False
Type: Error

Expected result

this should run without errors

kubectl wait applications/pipeline -n kubeflow --for condition=Ready --timeout=1800s

Materials and Reference


Impacted by this bug? Give it a 👍. We prioritise the issues with the most 👍.

@capri-xiyue capri-xiyue added the help wanted The community is welcome to contribute. label Jun 18, 2021
@stale
Copy link

stale bot commented Oct 2, 2021

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@stale stale bot added the lifecycle/stale The issue / pull request is stale, any activities remove this label. label Oct 2, 2021
@stale
Copy link

stale bot commented Mar 3, 2022

This issue has been automatically closed because it has not had recent activity. Please comment "/reopen" to reopen it.

@stale stale bot closed this as completed Mar 3, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/backend help wanted The community is welcome to contribute. kind/bug lifecycle/stale The issue / pull request is stale, any activities remove this label.
Projects
None yet
Development

No branches or pull requests

2 participants