airflow is not accepting configuration from Admin UI

[vikramcse]

Apache Airflow version: 2.1.1

Kubernetes version (if you are using kubernetes) (use kubectl version): NO

Environment: local (docker + ubuntu)

• Cloud provider or hardware configuration:
• OS (e.g. from /etc/os-release): Debian GNU/Linux 10 (buster)
• Kernel (e.g. uname -a): linux

What happened:
airflow is not accepting configuration from Admin UI

when I submit a DAG configuration from UI, it is giving me error Invalid JSON configuration, must be a dict

the same workflow is working in airflow 2.1.0 version
I think this issue occurred in this PR #15057

What you expected to happen:
Airflow admin should accept the conf from UI and trigger the dag

How to reproduce it:
It can be reproduced for all cases, we have to put any valid JSON into the configuration window on a DAG

Willing to submit PR
YES

[potiuk]

Can't use my PC at the moment but it does look awfully a lot like we need to release 2.1.2 with a fix if it is confirmed @ashb @kaxil @jhtimmins

[ashb]

Agreed, will confirm.

[potiuk]

Got hold of my PC. Confirmed that it does not occur in main but it DOES occur in 2.1.1.

[potiuk]

I have a fix (conf-> run_conf) - likely bad cherry-pick. Looking at why it has not been caught by the test_harness (the tests for dag triggering seem to pass :(.

[kaxil]

Looks like we already had a fix: #16648

[potiuk]

Yep. That's it. Also it has not been caught in the tests because the test was quarantined. Looks like we need to take a close look at the quarantined tests and fix them.

[kaxil]

I have cherry-picked it to v2-1-stable and v2-1-test, we will cut a 2.1.2 release which should be available to the users by the end of this week.

Until then, please use the API or CLI to trigger dags.

[vikramcse]

yes I will use the api till then
thanks @potiuk and @kaxil for checking this issue 👍

[ashb]

Closing this issue as the fix is merged and it will be released soon.