Skip to content

An example of usage apache spark windows functions

Notifications You must be signed in to change notification settings

Normal/spark-windows

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

20 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Requirements

  • sbt
  • spark 2.3
  • java 6+

Run locally with IDE (checked on intellij idea)

  • checkout git branch ide-run
  • just run AppLauncher class

Run locally with spark

  • sbt assembly
  • spark-submit --master "local[*]" target/scala-2.11/spark-windows.jar

Remarks

  • Change configuration application.conf in order to run against some other dataset with same scheme

About

An example of usage apache spark windows functions

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages