Add Ruby and Swift language autodetect test

[angelapwen]

This PR check adds Swift and Ruby to the existing multi-language autodetect check. Once Swift is in GA, we will be able to remove the CODEQL_ENABLE_EXPERIMENTAL_FEATURES_SWIFT: "true" set in that check.

Merge / deployment checklist

• Confirm this change is backwards compatible with existing workflows.
• Confirm the readme has been updated if necessary.
• Confirm the changelog has been updated if necessary.

[henrymercer]

🤔 Hmm, I think Swift can only be auto-detected in the CLI as of nightly-latest at the moment. I think possibly there's still some part of the Action that's doing language autodetection, even when we're parsing the config in the CLI, but I haven't dug into it.

[angelapwen]

🤔 Hmm, I think Swift can only be auto-detected in the CLI as of nightly-latest at the moment. I think possibly there's still some part of the Action that's doing language autodetection, even when we're parsing the config in the CLI, but I haven't dug into it.

I thought so too, but was surprised that it passed in a previous run (before I marked ready for review and merged main in): https://github.com/github/codeql-action/actions/runs/3474223934/jobs/5807144328

I can make this repo draft until 2.11.4 is released (so it would be caught under latest and cached) if you think that's safer?

[henrymercer]

I think it would be fine to set CODEQL_ENABLE_EXPERIMENTAL_FEATURES_SWIFT=true in multi-language-autodetect.yml to help cut down on the number of jobs. We could add some checks on the tools version to make sure that language autodetection does the right thing for old CLIs too.

[angelapwen]

I'm not sure if this is what you'd meant by using the tools version, but I saw there was precedent for using the matrix.version in the ml-powered-queries PR check.

Currently, just checking Ruby and Swift in the most recent 3 CLIs and the other languages in the hardcoded 3 prior CLIs. This can be made more robust when we work out our testing plan for all supported releases.

[angelapwen]

Ah, I am having some errors come up in nightly-latest runs due to a bug in the CLI that has been fixed:

  ERROR: Referenced pack 'codeql/regex' not found. (/opt/hostedtoolcache/CodeQL/0.0.0-20221118/x64/codeql/qlpacks/codeql/python-all/0.6.4-dev/qlpack.yml:1,1-1)
  A fatal error occurred: Could not resolve library path for /home/runner/work/codeql-action/codeql-action/codeql-qlpacks/complex-python-qlpack

will have to re-run these checks when the version in nightly-latest is superseded by the version with the fix.