Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-18120 ][SQL] Call QueryExecutionListener callback methods for … #16664

Closed
wants to merge 5 commits into from

Commits on Jan 20, 2017

  1. [SPARK-18120 ][SQL] Call QueryExecutionListener callback methods for …

    …DataFrameWriter methods
    
    QueryExecutionListener has two methods onSuccess() and onFailure() that takes a QueryExecution object as a parameter that gets called when a query is executed. It gets called for several of the DataSet methods like take, head, first, collect etc. but doesn't get called for any of the DataFrameWriter methods like saveAsTable, save etc. This commit fixes this issue and makes calls to these two methods from DataFrameWriter output methods.
    Also, added a new property "spark.sql.queryExecutionListeners" that can be used to specify instances of QueryExecutionListeners that should be attached to the SparkSession when the spark application starts up. Testing was done using unit tests.
    Salil Surendran committed Jan 20, 2017
    Configuration menu
    Copy the full SHA
    751ded0 View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2017

  1. Configuration menu
    Copy the full SHA
    b0392ed View commit details
    Browse the repository at this point in the history
  2. Fixing code review comments

    Salil Surendran committed Jan 30, 2017
    Configuration menu
    Copy the full SHA
    752125a View commit details
    Browse the repository at this point in the history

Commits on Feb 3, 2017

  1. Committing to fix code review issues.

    Salil Surendran committed Feb 3, 2017
    Configuration menu
    Copy the full SHA
    ecf9f34 View commit details
    Browse the repository at this point in the history

Commits on Feb 5, 2017

  1. Committing to fix code review comments

    Salil Surendran committed Feb 5, 2017
    Configuration menu
    Copy the full SHA
    a0c7c22 View commit details
    Browse the repository at this point in the history