Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Rdd related helpers #132

Merged
merged 6 commits into from
Feb 24, 2022
Merged

Rdd related helpers #132

merged 6 commits into from
Feb 24, 2022

Commits on Feb 18, 2022

  1. added streaming and exploring how it works with kotlin spark api

    @Jolanrensen
    Jolanrensen committed Feb 18, 2022
    Configuration menu
    Copy the full SHA
    c57eaaf View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2022

  1. Adds helpful rdd to dataset conversion, as well as a new withSpark fu… 

    …nction taking a SparkConf
    @Jolanrensen
    Jolanrensen committed Feb 21, 2022
    Configuration menu
    Copy the full SHA
    bb39fc7 View commit details
    Browse the repository at this point in the history

  2. makes javaRDD toDS function more generic. 

    Adds sc JavaSparkContext to KSparkSession
    @Jolanrensen
    Jolanrensen committed Feb 21, 2022
    Configuration menu
    Copy the full SHA
    4bd3fe1 View commit details
    Browse the repository at this point in the history

Commits on Feb 22, 2022

  1. Arity is now Serializable, removed sc.stop(), sc is now lazy, updates… 

    … tests, removed streaming example
    @Jolanrensen
    Jolanrensen committed Feb 22, 2022
    Configuration menu
    Copy the full SHA
    09e9bb5 View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2022

  1. removed .show() from rdd test

    @Jolanrensen
    Jolanrensen committed Feb 23, 2022
    Configuration menu
    Copy the full SHA
    38486bb View commit details
    Browse the repository at this point in the history

Commits on Feb 24, 2022

  1. split up rdd tests, added list test. 

    Added kotlin official code style prop for later
    @Jolanrensen
    Jolanrensen committed Feb 24, 2022
    Configuration menu
    Copy the full SHA
    bcf99b8 View commit details
    Browse the repository at this point in the history