Use DB where possible for quicker airflow dag subcommands

[ashb]

Some of the subcommands here don't actually need a full dag, so there is
no point paying the (possibly long) time to parse a dagfile if we could
go directly to the DB instead.

Closes #21450

---

^ Add meaningful description above

Read the Pull Request Guidelines for more information.
In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.

[MatrixManAtYrService]

just curious: does this apply to airflow dags show? I haven’t set up an experiment to be sure, but my feeling was that that one was working pretty hard despite the serialized dag being available.

[ashb]

No, some I chose to leave respecting the dag-as-parsed, and dag show felt like one of those

[github-actions]

The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not modify the core of Airflow. If the committers decide that the full tests matrix is needed, they will add the label 'full tests needed'. Then you should rebase to the latest main or amend the last commit of the PR, and push it with --force-with-lease.

[potiuk]

Nice one 👍

[atishkathpal]

@ashb this is very useful. Worth considering adding this to all v2.0+ releases rather than just the upcoming release ?

[ashb]

@ashb this is very useful. Worth considering adding this to all v2.0+ releases rather than just the upcoming release ?

On the open source project we only maintain one version (currently 2.2.x), and only back-port bug fixes to it

cc @ephraimbuddy who is preparing the release for 2.2.5 - it could be viewed as a (performance) bug fix

[potiuk]

@ashb this is very useful. Worth considering adding this to all v2.0+ releases rather than just the upcoming release ?

BTW. I recommend you to upgrade to latest versions quickly :) I know it is not an easy one but the more often you do it, the less scary it is and the more up-to-date/secure system you have.

[atishbits]

@ashb this is very useful. Worth considering adding this to all v2.0+ releases rather than just the upcoming release ?

BTW. I recommend you to upgrade to latest versions quickly :) I know it is not an easy one but the more often you do it, the less scary it is and the more up-to-date/secure system you have.

Agree :). I'm using AWS MWAA so I don't have the privilege to keep my Airflow cluster updated with latest release until it shows up on the AWS console as a supported Airflow version.