GH-38239: [CI][Python] Disable -W error on Python CI jobs temporarily

[jorisvandenbossche]

• Closes: [CI][Python] test-conda-python is failing due to new DeprecationWarning raised on aiohttp #38239

[jorisvandenbossche]

@github-actions crossbow submit test-conda-python-3.11

[github-actions]

⚠️ GitHub issue #38239 has been automatically assigned in GitHub to PR creator.

[github-actions]

Revision: d20f7c9

Submitted crossbow builds: ursacomputing/crossbow @ actions-8e5c6e6b8b

Task	Status
test-conda-python-3.11

[jorisvandenbossche]

@github-actions crossbow submit test-conda-python-3.11

[github-actions]

Revision: 7b8e9db

Submitted crossbow builds: ursacomputing/crossbow @ actions-ecf19f5340

Task	Status
test-conda-python-3.11

[jorisvandenbossche]

@github-actions crossbow submit test-conda-python-3.11

[github-actions]

Revision: 78460fa

Submitted crossbow builds: ursacomputing/crossbow @ actions-77ba2e9d8a

Task	Status
test-conda-python-3.11

[jorisvandenbossche]

@github-actions crossbow submit test-conda-python-3.11

[github-actions]

Revision: 4b07aca

Submitted crossbow builds: ursacomputing/crossbow @ actions-e7fc135add

Task	Status
test-conda-python-3.11

[jorisvandenbossche]

@github-actions crossbow submit test-conda-python-3.11

[github-actions]

Revision: 33c672a

Submitted crossbow builds: ursacomputing/crossbow @ actions-c9b7a68d6e

Task	Status
test-conda-python-3.11

[jorisvandenbossche]

@github-actions crossbow submit test-conda-python-3.11

[github-actions]

Revision: 33c672a

Submitted crossbow builds: ursacomputing/crossbow @ actions-055887eb3e

Task	Status
test-conda-python-3.11

[danepitkin]

It would be nice to disable all DeprecationWarnings and FutureWarnings since they pop up a lot in our dependencies 😬 I hadn't anticipated that when enabling initially.

[assignUser]

@github-actions crossbow submit test-conda-python-3.11

[raulcd]

@github-actions crossbow submit test-conda-python-3.11

[github-actions]

Revision: 3115ea6

Submitted crossbow builds: ursacomputing/crossbow @ actions-3f3cee7e54

Task	Status
test-conda-python-3.11

[jorisvandenbossche]

@raulcd I am afraid that will fail, that was the first thing I tried as well .. 78460fa

[jorisvandenbossche]

And also locally that fails:

$ export PYTEST_ARGS="-W error -W 'ignore:Setting custom ClientSession:DeprecationWarning'"
$ PYTHONASYNCIODEBUG=1 pytest python/pyarrow/tests/test_dataset.py::test_open_dataset_from_uri_s3_fsspec $PYTEST_ARGS
ERROR: while parsing the following warning configuration:

  'ignore:Setting

This error occurred:

invalid action: "'ignore"

So indeed it seems to be something with passing it as an env var as Jakob mentions, and how spaces/quotes get treated in that case ..

[jorisvandenbossche]

It works if there are no spaces in the argument to -W and so not needing the quotes:

export PYTEST_ARGS="-W error -W ignore:Setting:DeprecationWarning"

But, the problem is that this could be a bit generic, ignoring also other warnings. It's maybe good enough for now, though.

[raulcd]

This works:

export PYTEST_ARGS="-W error -W 'ignore:Setting custom ClientSession:DeprecationWarning'"
pytest -r s $(PYTEST_ARGS)

[jorisvandenbossche]

That gives me PYTEST_ARGS: command not found, but that might depend on the bash terminal I am using?

(the tests then do run, so that might mask the error)

[raulcd]

@github-actions crossbow submit test-conda-python-3.11

[github-actions]

Revision: d278376

Submitted crossbow builds: ursacomputing/crossbow @ actions-4cb298fb5a

Task	Status
test-conda-python-3.11

[raulcd]

It is green but the whole PYTEST_ARGS were ignored:

 PYTEST_ARGS: command not found

[jorisvandenbossche]

Yep, that's what I said above ;) I see that locally as well, and then the tests are green, because also the -W error (which is causing the error) wasn't actually passed.

[raulcd]

@github-actions crossbow submit test-conda-python-3.11

[github-actions]

Revision: 148d5b2

Submitted crossbow builds: ursacomputing/crossbow @ actions-5b81a9c311

Task	Status
test-conda-python-3.11

[raulcd]

@jorisvandenbossche I agree with your statement here: #38259 (comment)
I've removed the -W error and created a follow up issue here: #38262

[raulcd]

👍

[conbench-apache-arrow]

After merging your PR, Conbench analyzed the 5 benchmarking runs that have been run so far on merge-commit f325ce9.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details. It also includes information about 4 possible false positives for unstable benchmarks that are known to sometimes produce them.