Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Spark QA] [WIP] Include commit hash in Spark QA messages #1811

Closed
wants to merge 30 commits into from
Closed

[Spark QA] [WIP] Include commit hash in Spark QA messages #1811

wants to merge 30 commits into from

Conversation

nchammas
Copy link
Contributor

@nchammas nchammas commented Aug 6, 2014

There is currently no JIRA issue for this PR, but you can find the motivating discussion here. This is a work in progress.

The goal of this PR (and related ones to come) is to include useful detail in Spark QA's messages that are intended to make a committer's job easier to do.

Since this work depends on Jenkins, I cannot test this locally. Hence, I will be iterating via this PR.

The RAT and PEP8 checks don’t print a blank line after successful runs.
The scalastyle check shouldn’t either.
This guy just runs the pep8 utility on all code in the python
directory, minus cloudpickle, which is a 3rd-party library.
This guy just calls scalastyle.
Mostly done using autopep8, plus some hand fixes.
*fingers crossed*

I admit I’m not exactly sure how this works… Let’s see if I did the
right thing.
merge upstream changes
Everything looks cramped and it’s hard to tell at a glance where
sections begin. Adding a blank line between sections should fix that.
See the discussion here:
#1744 (comment)

Get the pep8 utility at runtime so that it’s not required to be
installed on the build server.
Don’t just assume curl got the file alright. Check and exit properly if
there were any problems.
“then” goes on the same line as the opening “if”.
merge upstream changes
No need to exclude files in the call to pep8. The tool references
tox.ini for config information, so we should use that.
“Undo” unnecessary line breaks introduced by accident when I called
autopep8 on the whole Python directory without setting the max line
length to 100. (autopep8 defaults to 79.)
[SPARK-1687] [PySpark] fix unit tests related to pickable namedtuple
PEP 8 is the bee’s knees.
merge upstream changes
merge upstream changes
merge upstream changes
@JoshRosen
Copy link
Contributor

It looks like this PR pulled in a bunch of unrelated commits. Do you mind closing this, creating a new feature branch containing only the commits you want, and opening an new PR from that branch?

@nchammas
Copy link
Contributor Author

nchammas commented Aug 6, 2014

No problem. Will do.

@nchammas nchammas closed this Aug 6, 2014
asfgit pushed a commit that referenced this pull request Aug 15, 2014
You can find the [discussion that motivated this PR here](http://mail-archives.apache.org/mod_mbox/spark-dev/201408.mbox/%3CCABPQxssy0ri2QAz=cc9Tx+EXYWARm7pNcVm8apqCwc-esLbO4Qmail.gmail.com%3E).

As described in [SPARK-2912](https://issues.apache.org/jira/browse/SPARK-2912), the goal of this PR (and related ones to come) is to include useful detail in Spark QA's messages that are intended to make a committer's job easier to do.

Since this work depends on Jenkins, I cannot test this locally. Hence, I will be iterating via this PR.

Notes:
* This is a duplicate of a [previous PR](#1811), without the extraneous commits.
* This PR also resolves an issue targeted by [another open PR](#1809).

Closes #1809.

Author: Nicholas Chammas <[email protected]>
Author: nchammas <[email protected]>

Closes #1816 from nchammas/master and squashes the following commits:

c1be644 [Nicholas Chammas] [SPARK-2912] include commit hash in messages
8f641ac [nchammas] Merge pull request #7 from apache/master
xiliu82 pushed a commit to xiliu82/spark that referenced this pull request Sep 4, 2014
You can find the [discussion that motivated this PR here](http://mail-archives.apache.org/mod_mbox/spark-dev/201408.mbox/%3CCABPQxssy0ri2QAz=cc9Tx+EXYWARm7pNcVm8apqCwc-esLbO4Qmail.gmail.com%3E).

As described in [SPARK-2912](https://issues.apache.org/jira/browse/SPARK-2912), the goal of this PR (and related ones to come) is to include useful detail in Spark QA's messages that are intended to make a committer's job easier to do.

Since this work depends on Jenkins, I cannot test this locally. Hence, I will be iterating via this PR.

Notes:
* This is a duplicate of a [previous PR](apache#1811), without the extraneous commits.
* This PR also resolves an issue targeted by [another open PR](apache#1809).

Closes apache#1809.

Author: Nicholas Chammas <[email protected]>
Author: nchammas <[email protected]>

Closes apache#1816 from nchammas/master and squashes the following commits:

c1be644 [Nicholas Chammas] [SPARK-2912] include commit hash in messages
8f641ac [nchammas] Merge pull request apache#7 from apache/master
viirya pushed a commit to viirya/spark-1 that referenced this pull request Oct 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants