-
Notifications
You must be signed in to change notification settings - Fork 38
In Depth Look
jtbarbetta edited this page Nov 24, 2015
·
2 revisions
##A Day in the Life of an RDD
The following diagram represents the life-cycle for a simple Javascript lambda function (a.k.a. anonymous function) and the resulting RDD as they flow from the invocation of the function on the Node side of EclairsJS through the JVM stack to the Apache Spark workers.
The Javascript code gets stringified into a Nashorn template that is passed into the EclairJS interpreter where it is then converted into an equivalent Java call that wraps the lambda function with an EclairJS Nashorn wrapper such that it can be executed in the JVM via Nashorn on the Spark worker.