Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Expose status of running queries via command or REST endpoint #3208

Closed
vcrfxia opened this issue Aug 14, 2019 · 1 comment · Fixed by #3570
Closed

Expose status of running queries via command or REST endpoint #3208

vcrfxia opened this issue Aug 14, 2019 · 1 comment · Fixed by #3570

Comments

@vcrfxia
Copy link
Contributor

vcrfxia commented Aug 14, 2019

Today it's rather difficult for a user to know whether a continuous query is still processing data or has failed. Options to detect failure include:

  • Noticing that the query is no longer processing data, by either monitoring the sink topic or via the runtime stats in the output of DESCRIBE EXTENDED on the sink stream/table

  • Checking KSQL server logs and seeing errors indicating the Streams threads have died

  • Observing that the JMX metric that exposes the status of the particular query has transitioned away from RUNNING

The last option isn't too bad, but ideally we'd also have a way for users to get query status more directly, either as part of EXPLAIN <query id> or a REST endpoint.

Note that this request is different from the existing /status/ endpoint which exposes status of the query in terms of whether KSQL has run the query or not. The request in this issue is about after KSQL has run the query, what is the status of the Streams application started by the continuous query.

@vcrfxia vcrfxia changed the title Expose status of running queries Expose status of running queries via command or REST endpoint Aug 14, 2019
@big-andy-coates
Copy link
Contributor

Yeah, we should report the current running/not running state in DESCRIBE EXTENDED.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants