Skip to content

Build a complex spark execution plan by composing many different spark operations.

License

Notifications You must be signed in to change notification settings

gabrielenizzoli/spark_engine

Repository files navigation

Welcome to spark_engine project

Build a complex spark execution plan using composition, and yaml :D.

Table of contents

Status

Master branch status: Build

Versions supported

We are just focused on the latest versions right now. So if you use it, be aware that it will only work with:

  • Java: 1.11
  • Scala 2.12
  • Spark: 3.0.0