Installation

###Local Installation

• Clone ducktape:

  git clone https://github.com/Data2Semantics/ducktape.git

• Install PJ2 library in local maven repository. It is currently available under lib dir, but need to be installed locally since it is not available in public maven repository.

  ./mvn-install-pj2.sh or manually using maven

  mvn install:install-file -Dfile=lib/pj2.jar -DgroupId=edu.rit.pj2 -DartifactId=parallel-java -Dversion=1.0 -Dpackaging=jar

• Build ducktape-run.jar :

  mvn assembly:assembly

• Running workflow can be done with :

  $ java -jar ducktape-run.jar [workflow file name, default:workflow.yaml]

• Additional options to provide:

  --domainpath : A directory containing source code and resources to be loaded. Each source file should be in a directory that matches the name of its controller (ie. java files should be in a directory called 'java'). (default: none)

  --output FILE : The output directory (default: the working directory)

  --profile [LOCAL | THREADED | CLUSTER] : Execution profile to be used LOCAL THREADED CLUSTER (default: LOCAL)

  --tracker : tracker host:port for Cluster environment

  --workflowjar : Jar file name needed to run your modules for Cluster environment

###Cluster Installation

####Tracker

PJ2 Tracker have to be started on frontend node/cluster. Workflow jobs should be started on the same node.

java edu.rit.pj2.tracker.Tracker [tracker=<host>[:<port>]] [web=<host>[:<port>]] [name=<name>] [node=<name>,<cores>,<gpus>]

More Info : Tracker Package documentation

####Launchers

PJ2 Launchers can be started on any node that will be part of the computation.

java edu.rit.pj2.tracker.Launcher [tracker=<host>[:<port>]] [name=<name>] [cores=<cores>] [gpus=<gpus>] [command="<command>"]