Add manual pass state for long-running jobs

[fm3]

Shows convert_to_wkw jobs that failed as “Manual“ (meaning an admin will try to repair this job), unless an admin has alreadyset the job’s manualState to SUCCESS or FAILURE in the database.

Steps to test:

• set up worker, jobsEnabled
• upload datasets that work and that don’t work
• run other jobs as well
• in postgres, set a job to manually repaired or failure (i.e. wontfix)
• that state should be shown then, links should become available in success case

Note:

I am unsure about the wording (e.g. the displayed name “Manual” for that new state), and the tooltips. Feedback welcome :)

Issues:

• fixes “Manual pass” state for long-running jobs #5516
• fixes Job list view: Tooltip on “Started” state has wrong text #5466

---

• Updated (unreleased) changelog
• Updated (unreleased) migration guide if applicable
• Ready for review

[fm3]

@youri-k I would like to add a line to the evolution setting the manualState to FAILURE for all existing jobs where the celery state is also FAILURE (because we don’t want to repair all old jobs). Since you are more familiar with json in SQL, could you give me a pointer there? No hurry.

@philippotto I incorporated your feedback :) Another question: Do you think we should make this feature opt-in? (e.g. add a manualPassJobs array to the features block of the config?) Currently I think we have only one instance with jobsEnabled, but that may change

[philippotto]

Front-end looks great! However, I added some comments regarding the typing which we should harden a bit to make the job handling more robust. The typing was already not optimal before this PR, but I think we should use the chance now to improve it :)

[fm3]

@philippotto Thanks for your feedback! :) Could you have another look?

[youri-k]

Since you are more familiar with json in SQL, could you give me a pointer there?

I hope this line from the evolution 57 is helpful:

UPDATE webknossos.dataSet_layers dl
SET adminViewConfiguration = dS.adminViewConfiguration->'layers'->dl.name
FROM webknossos.dataSets dS
WHERE dl._dataSet = dS._id AND dS.adminViewConfiguration ? 'layers' AND dS.adminViewConfiguration->'layers' ? dl.name;

This sets the layer's adminViewConfiguration based on the entry of the layer in the general adminViewConfiguration. The WHERE clause checks whether the adminViewConfiguration contains a layer object and whether that object contains the specific layer entry.

I really like this cheat sheet, where all the operators are explained: https://devhints.io/postgresql-json

Hope this helps, but you can ping me again if something does not work

[philippotto]

Front-end looks top notch 🎉

[youri-k]

Backend and SQL LGTM 🎉