Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GH-36199: [Python][CI][Spark] Update spark versions used on our nightly tests #36347

Merged
merged 2 commits into from
Aug 1, 2023

Conversation

raulcd
Copy link
Member

@raulcd raulcd commented Jun 28, 2023

Rationale for this change

We are currently testing with very old or deprecated spark versions.

What changes are included in this PR?

Update the spark versions to be tested.

Are these changes tested?

They will via archery

Are there any user-facing changes?

No

@github-actions
Copy link

⚠️ GitHub issue #36199 has been automatically assigned in GitHub to PR creator.

@github-actions github-actions bot added the awaiting committer review Awaiting committer review label Jun 28, 2023
@raulcd
Copy link
Member Author

raulcd commented Jun 28, 2023

This is currently blocked by: #36332

@raulcd
Copy link
Member Author

raulcd commented Aug 1, 2023

@github-actions crossbow submit spark

@github-actions
Copy link

github-actions bot commented Aug 1, 2023

Revision: 1a71645

Submitted crossbow builds: ursacomputing/crossbow @ actions-32d56069dc

Task Status
test-conda-python-3.10-spark-v3.4.0 Github Actions
test-conda-python-3.11-spark-master Github Actions
test-conda-python-3.8-spark-v3.4.1 Github Actions

@raulcd raulcd marked this pull request as ready for review August 1, 2023 15:06
@raulcd raulcd requested review from assignUser and kou as code owners August 1, 2023 15:06
Copy link
Member

@kou kou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

dev/tasks/tasks.yml Outdated Show resolved Hide resolved
@github-actions github-actions bot added awaiting merge Awaiting merge and removed awaiting committer review Awaiting committer review labels Aug 1, 2023
@github-actions github-actions bot added awaiting changes Awaiting changes and removed awaiting merge Awaiting merge labels Aug 1, 2023
@assignUser assignUser merged commit e34d4c9 into apache:main Aug 1, 2023
@assignUser assignUser removed the awaiting changes Awaiting changes label Aug 1, 2023
@conbench-apache-arrow
Copy link

After merging your PR, Conbench analyzed the 5 benchmarking runs that have been run so far on merge-commit e34d4c9.

There was 1 benchmark result indicating a performance regression:

The full Conbench report has more details. It also includes information about possible false positives for unstable benchmarks that are known to sometimes produce them.

loicalleyne pushed a commit to loicalleyne/arrow that referenced this pull request Nov 13, 2023
… nightly tests (apache#36347)

### Rationale for this change

We are currently testing with very old or deprecated spark versions.

### What changes are included in this PR?

Update the spark versions to be tested.

### Are these changes tested?

They will via archery

### Are there any user-facing changes?

No
* Closes: apache#36199

Authored-by: Raúl Cumplido <[email protected]>
Signed-off-by: Jacob Wujciak-Jens <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Python][CI] Update spark versions tested on our nightly tests
3 participants