forked from opensearch-project/sql
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Introduce SparkParameterComposerCollection (opensearch-project#2774)
* Introduce SparkParameterComposerCollection Signed-off-by: Tomoyuki Morita <[email protected]> * Fix comments Signed-off-by: Tomoyuki Morita <[email protected]> * Fix integ test Signed-off-by: Tomoyuki Morita <[email protected]> --------- Signed-off-by: Tomoyuki Morita <[email protected]> (cherry picked from commit a151a7d)
- Loading branch information
Showing
37 changed files
with
1,387 additions
and
706 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
231 changes: 0 additions & 231 deletions
231
...y-core/src/main/java/org/opensearch/sql/spark/asyncquery/model/SparkSubmitParameters.java
This file was deleted.
Oops, something went wrong.
7 changes: 4 additions & 3 deletions
7
...uery-core/src/main/java/org/opensearch/sql/spark/config/SparkSubmitParameterModifier.java
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,11 +1,12 @@ | ||
package org.opensearch.sql.spark.config; | ||
|
||
import org.opensearch.sql.spark.asyncquery.model.SparkSubmitParameters; | ||
import org.opensearch.sql.spark.parameter.SparkSubmitParametersBuilder; | ||
|
||
/** | ||
* Interface for extension point to allow modification of spark submit parameter. modifyParameter | ||
* method is called after the default spark submit parameter is build. | ||
* method is called after the default spark submit parameter is build. To be deprecated in favor of | ||
* {@link org.opensearch.sql.spark.parameter.GeneralSparkParameterComposer} | ||
*/ | ||
public interface SparkSubmitParameterModifier { | ||
void modifyParameters(SparkSubmitParameters parameters); | ||
void modifyParameters(SparkSubmitParametersBuilder parametersBuilder); | ||
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.