-
Notifications
You must be signed in to change notification settings - Fork 141
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Refactor query param #2519
Refactor query param #2519
Conversation
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## main #2519 +/- ##
============================================
+ Coverage 95.42% 95.43% +0.01%
- Complexity 5027 5031 +4
============================================
Files 483 484 +1
Lines 14020 14034 +14
Branches 944 940 -4
============================================
+ Hits 13378 13394 +16
+ Misses 621 619 -2
Partials 21 21
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. |
Confirmed the BWC failure unrelated to this PR by reproducing the same issue with a shadow PR checked from main branch https://github.com/opensearch-project/sql/actions/runs/7894433419/job/21545080478?pr=2520 |
dec7bb8
to
0a8ba80
Compare
0a8ba80
to
ca3d66e
Compare
Signed-off-by: Louis Chu <[email protected]>
1cc9819
to
7592f7a
Compare
Signed-off-by: Louis Chu <[email protected]>
7592f7a
to
7c86b3a
Compare
* Refactor query param Signed-off-by: Louis Chu <[email protected]> * Reduce scope of changes Signed-off-by: Louis Chu <[email protected]> --------- Signed-off-by: Louis Chu <[email protected]> (cherry picked from commit ee2dbd5) Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
documenting some findings on an issue with batch flint job on EMR-S after this PR. Batch job submitted to EMR-S will fail. For clearer error message, modified this line:
From the error message, perhaps it has something to do with how EMR parse the Spark Submit Parameters The entire stderr file for the batch jobExample 1:
Example 2:
|
after wrapping the query with quotes, job succeeds |
* Refactor query param Signed-off-by: Louis Chu <[email protected]> * Reduce scope of changes Signed-off-by: Louis Chu <[email protected]> --------- Signed-off-by: Louis Chu <[email protected]>
* Refactor query param * Reduce scope of changes --------- (cherry picked from commit ee2dbd5) Signed-off-by: Louis Chu <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Description
spark/src/main/java/org/opensearch/sql/spark/client/StartJobRequest.java
intospark/src/main/java/org/opensearch/sql/spark/asyncquery/model/SparkSubmitParameters.java
to avoid input limitation from EMRSIssues Resolved
#2376
Check List
New functionality has been documented.New functionality has javadoc addedNew functionality has user manual doc addedBy submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.