Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix timestamp parse failure for k8s executor pod tailing #31175

Merged

Conversation

dstandish
Copy link
Contributor

@dstandish dstandish commented May 9, 2023

When we tail stdout over kube API, we get ansi color codes which must be escaped in order for timestamps to be properly parsed so that messages can be properly interleaved by the file task handler (i.e. / a.k.a. the web UI task log reader).

While at it, fixed an issue with improper appending of "messages" (e.g. "fetching logs from kube API") and added one such message for good measure.

Before:
image

After:
image

@dstandish dstandish requested a review from jedcunningham as a code owner May 9, 2023 23:14
@boring-cyborg boring-cyborg bot added provider:cncf-kubernetes Kubernetes provider related issues area:logging area:Scheduler including HA (high availability) scheduler labels May 9, 2023
@dstandish dstandish requested review from jedcunningham and removed request for jedcunningham May 9, 2023 23:14
@dstandish dstandish added this to the Airflow 2.6.1 milestone May 9, 2023
@dstandish dstandish requested a review from uranusjr May 10, 2023 17:58
dstandish added 3 commits May 10, 2023 13:14
When we tail stdout over kube API, we get ansi color codes which must be escaped in order for timestamps to be properly parsed so that messages can be properly interleaved by the file task handler (i.e. / a.k.a. the web UI task log reader).

While at it, fixed an issue with improper appending of "messages" (e.g. "fetching logs from kube API") and added one such message for good measure.
@dstandish dstandish force-pushed the k8s-executor-log-fetch-timestamp-parse-fix branch from 9b25182 to d015efb Compare May 10, 2023 20:14
@uranusjr uranusjr merged commit 86d62d3 into apache:main May 11, 2023
@uranusjr uranusjr deleted the k8s-executor-log-fetch-timestamp-parse-fix branch May 11, 2023 01:56
@ephraimbuddy ephraimbuddy added the type:bug-fix Changelog: Bug Fixes label May 11, 2023
ephraimbuddy pushed a commit that referenced this pull request May 11, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:logging area:Scheduler including HA (high availability) scheduler provider:cncf-kubernetes Kubernetes provider related issues type:bug-fix Changelog: Bug Fixes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants