Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adds Kotlin Jupyter notebook support #137

Merged
merged 41 commits into from
May 6, 2022
Merged

Adds Kotlin Jupyter notebook support #137

merged 41 commits into from
May 6, 2022

Conversation

Jolanrensen
Copy link
Collaborator

WIP: Adds integration for Kotlin Spark API in Jupyter.
Automatically starts Spark session and it can render Datasets. Will probably allow to render Grouped Datasets and RDDs as well.

There are some issues with ClassNotFoundExceptions thanks to Scala and Spark being weird. I'm still trying to solve this.

Kotlin/kotlin-jupyter-libraries#144

# Conflicts:
#	kotlin-spark-api/3.2/pom_2.12.xml
# Conflicts:
#	.github/workflows/build.yml
#	kotlin-spark-api/3.2/pom_2.12.xml
#	pom.xml
@Jolanrensen Jolanrensen requested a review from asm0dey May 5, 2022 14:33
Copy link
Contributor

@asm0dey asm0dey left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The most important question is modularization, others are more or less minor

kotlin-spark-api.json Outdated Show resolved Hide resolved
pom.xml Outdated Show resolved Hide resolved
pom.xml Outdated Show resolved Hide resolved
kotlin-spark-api/3.2/pom_2.12.xml Outdated Show resolved Hide resolved
README.md Show resolved Hide resolved
@Jolanrensen Jolanrensen requested a review from asm0dey May 6, 2022 12:49
core/3.2/pom_2.12.xml Outdated Show resolved Hide resolved
examples/pom-3.2_2.12.xml Outdated Show resolved Hide resolved
kotlin-spark-api/3.2/pom_2.12.xml Outdated Show resolved Hide resolved
kotlin-spark-api/3.2/pom_2.12.xml Outdated Show resolved Hide resolved
kotlin-spark-api/3.2/pom_2.12.xml Outdated Show resolved Hide resolved
pom.xml Outdated Show resolved Hide resolved
pom_2.12.xml Outdated Show resolved Hide resolved
@asm0dey asm0dey merged commit 63bebaf into spark-3.2 May 6, 2022
@asm0dey asm0dey deleted the jupyter-test branch May 6, 2022 18:33
@Jolanrensen Jolanrensen added this to the 1.1.0 milestone May 30, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants