Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-13543][SQL] Support for specifying compression codec for Parquet/ORC via option() #11464

Closed
wants to merge 17 commits into from
Closed

[SPARK-13543][SQL] Support for specifying compression codec for Parquet/ORC via option() #11464

wants to merge 17 commits into from

Commits on Mar 2, 2016

  1. Add the support to specify compression codec for Parquet and Orc

    @HyukjinKwon
    HyukjinKwon committed Mar 2, 2016
    Configuration menu
    Copy the full SHA
    9a43e72 View commit details
    Browse the repository at this point in the history

  2. Add some tests for testing compressions

    @HyukjinKwon
    HyukjinKwon committed Mar 2, 2016
    Configuration menu
    Copy the full SHA
    9ce0ab7 View commit details
    Browse the repository at this point in the history

  3. Merge upstream

    @HyukjinKwon
    HyukjinKwon committed Mar 2, 2016
    Configuration menu
    Copy the full SHA
    59a77d4 View commit details
    Browse the repository at this point in the history

  4. Add tests and some comments

    @HyukjinKwon
    HyukjinKwon committed Mar 2, 2016
    Configuration menu
    Copy the full SHA
    04e4a51 View commit details
    Browse the repository at this point in the history

  5. Correct comments

    @HyukjinKwon
    HyukjinKwon committed Mar 2, 2016
    Configuration menu
    Copy the full SHA
    a96e510 View commit details
    Browse the repository at this point in the history

  6. Remove the duplicated test

    @HyukjinKwon
    HyukjinKwon committed Mar 2, 2016
    Configuration menu
    Copy the full SHA
    d107d50 View commit details
    Browse the repository at this point in the history

  7. Remove unused imports

    @HyukjinKwon
    HyukjinKwon committed Mar 2, 2016
    Configuration menu
    Copy the full SHA
    9c53d10 View commit details
    Browse the repository at this point in the history

  8. Add compression as an argument and make shorten names as lower cases

    @HyukjinKwon
    HyukjinKwon committed Mar 2, 2016
    Configuration menu
    Copy the full SHA
    12e7275 View commit details
    Browse the repository at this point in the history

Commits on Mar 3, 2016

  1. Resolve conflicts

    @HyukjinKwon
    HyukjinKwon committed Mar 3, 2016
    Configuration menu
    Copy the full SHA
    2304bfb View commit details
    Browse the repository at this point in the history

  2. Add some comments for consistent compression names and add none/uncom… 

    …pressed for test-based datasources
    @HyukjinKwon
    HyukjinKwon committed Mar 3, 2016
    Configuration menu
    Copy the full SHA
    baf7a63 View commit details
    Browse the repository at this point in the history

  3. Use lower-cases for compression codec names

    @HyukjinKwon
    HyukjinKwon committed Mar 3, 2016
    Configuration menu
    Copy the full SHA
    99c39c6 View commit details
    Browse the repository at this point in the history

  4. Update error meesages for TextSuite

    @HyukjinKwon
    HyukjinKwon committed Mar 3, 2016
    Configuration menu
    Copy the full SHA
    4e212b1 View commit details
    Browse the repository at this point in the history

  5. Add some tests and functionality for expliclty setting no compression

    @HyukjinKwon
    HyukjinKwon committed Mar 3, 2016
    Configuration menu
    Copy the full SHA
    4c1ffc5 View commit details
    Browse the repository at this point in the history

  6. Remove unused variable

    @HyukjinKwon
    HyukjinKwon committed Mar 3, 2016
    Configuration menu
    Copy the full SHA
    29a8d61 View commit details
    Browse the repository at this point in the history

  7. Add removed test

    @HyukjinKwon
    HyukjinKwon committed Mar 3, 2016
    Configuration menu
    Copy the full SHA
    2817c9a View commit details
    Browse the repository at this point in the history

  8. Update test names

    @HyukjinKwon
    HyukjinKwon committed Mar 3, 2016
    Configuration menu
    Copy the full SHA
    d2ace37 View commit details
    Browse the repository at this point in the history

  9. Make the options function

    @HyukjinKwon
    HyukjinKwon committed Mar 3, 2016
    Configuration menu
    Copy the full SHA
    e4d4cfb View commit details
    Browse the repository at this point in the history